Jun 12 18:38:19.061113 ip-10-0-141-181 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:38:19.487635 ip-10-0-141-181 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:38:19.487635 ip-10-0-141-181 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:38:19.487635 ip-10-0-141-181 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:38:19.487635 ip-10-0-141-181 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:38:19.487635 ip-10-0-141-181 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:38:19.488459 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.487695 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:38:19.494047 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494021 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:38:19.494047 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494041 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:38:19.494047 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494044 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:38:19.494047 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494048 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:38:19.494047 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494051 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:38:19.494047 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494054 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494057 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494060 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494063 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494066 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494068 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494071 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494074 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494076 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494079 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494082 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494084 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494087 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494089 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494092 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494094 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494097 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494099 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494101 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494104 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:38:19.494272 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494107 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494109 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494112 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494115 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494117 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494120 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494129 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494131 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494134 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494136 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494139 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494141 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494144 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494146 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494150 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494153 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494157 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494162 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494165 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:38:19.494821 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494168 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494171 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494173 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494176 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494179 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494182 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494185 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494188 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494190 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494194 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494196 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494199 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494201 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494204 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494207 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494209 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494212 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494214 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494217 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:38:19.495280 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494220 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494224 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494227 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494230 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494239 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494242 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494246 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494248 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494251 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494254 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494257 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494259 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494262 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494265 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494267 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494270 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494272 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494276 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494278 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:38:19.495742 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494281 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494289 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494292 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494294 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494297 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494299 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494303 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494307 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494311 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494314 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494316 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494319 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494322 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494324 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494327 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494330 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.494332 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495086 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495093 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:38:19.496222 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495096 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495099 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495102 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495104 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495107 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495109 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495112 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495115 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495117 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495120 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495122 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495125 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495128 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495131 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495133 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495137 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495140 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495142 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495145 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495148 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:38:19.496679 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495150 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495153 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495155 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495158 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495160 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495163 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495167 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495170 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495172 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495175 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495177 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495180 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495182 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495187 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495191 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495194 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495197 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495199 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495202 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:38:19.497208 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495205 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495208 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495210 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495213 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495216 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495218 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495221 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495223 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495226 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495228 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495231 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495233 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495236 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495238 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495241 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495243 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495246 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495248 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495251 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:38:19.497672 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495256 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495260 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495262 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495265 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495269 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495272 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495276 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495279 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495281 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495284 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495287 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495290 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495293 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495296 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495299 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495302 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495306 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495310 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495313 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495316 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:38:19.498176 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495319 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495322 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495324 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495328 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495331 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495333 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495336 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495339 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495341 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495344 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495346 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495349 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495351 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495354 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495356 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495359 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495361 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495364 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495366 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495787 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:38:19.498693 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495793 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495796 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495799 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495801 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495804 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495807 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495809 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495812 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495815 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495817 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495820 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495823 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495826 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495829 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495831 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495835 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495838 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495841 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495844 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495847 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:38:19.499210 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495849 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495852 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495855 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495858 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495860 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495863 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495866 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495868 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495871 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495873 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495876 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495878 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495881 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495883 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495886 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495888 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495891 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495893 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495896 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495898 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:38:19.499709 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495901 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495903 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495906 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495908 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495914 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495917 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495924 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495928 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495934 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495937 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495940 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495942 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495945 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495947 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495950 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495952 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495954 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495957 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495959 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:38:19.500239 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495962 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495965 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495967 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495970 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495973 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495977 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495980 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495982 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495985 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495987 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495989 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495992 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495995 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.495999 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496002 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496004 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496006 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496009 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496012 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:38:19.500703 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496016 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496020 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496024 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496027 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496030 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496033 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496036 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496039 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496042 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496045 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496047 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496049 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496052 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496054 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496057 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496059 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496062 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496064 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496067 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496069 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:38:19.501195 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496142 2571 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496149 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496156 2571 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496161 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496165 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496168 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496173 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496177 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496180 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496185 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496188 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496192 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496197 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496200 2571 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496202 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496205 2571 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496209 2571 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496212 2571 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496216 2571 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496219 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496222 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496226 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496229 2571 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496233 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:38:19.501708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496236 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496239 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496243 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496246 2571 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496249 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496252 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496255 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496258 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496262 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496265 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496268 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496271 2571 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496274 2571 flags.go:64] FLAG: --enable-server="true" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496277 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496282 2571 flags.go:64] FLAG: --event-burst="100" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496285 2571 flags.go:64] FLAG: --event-qps="50" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496287 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496292 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496295 2571 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496299 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496303 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496305 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496308 2571 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496311 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496314 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:38:19.502396 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496317 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496320 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496323 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496326 2571 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496329 2571 flags.go:64] FLAG: --feature-gates="" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496333 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496336 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496339 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496342 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496345 2571 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496348 2571 flags.go:64] FLAG: --help="false" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496351 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496354 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496357 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496360 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496363 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496366 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496370 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496372 2571 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496375 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496378 2571 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496380 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496383 2571 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496386 2571 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:38:19.503048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496390 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496393 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496396 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496399 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496402 2571 flags.go:64] FLAG: --lock-file="" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496405 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496408 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496411 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496416 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496420 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496423 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496426 2571 flags.go:64] FLAG: --logging-format="text" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496428 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496432 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496434 2571 flags.go:64] FLAG: --manifest-url="" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496437 2571 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496441 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496444 2571 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496449 2571 flags.go:64] FLAG: --max-pods="110" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496452 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496454 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496457 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496461 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496464 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496467 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:38:19.503643 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496470 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496479 2571 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496482 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496485 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496488 2571 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496490 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496496 2571 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496498 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496503 2571 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496506 2571 flags.go:64] FLAG: --port="10250" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496509 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496511 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7d33f9bc610afb4" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496515 2571 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496518 2571 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496521 2571 flags.go:64] FLAG: --register-node="true" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496524 2571 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496528 2571 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496532 2571 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496535 2571 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496538 2571 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496541 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496544 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496547 2571 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496550 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496553 2571 flags.go:64] FLAG: --runonce="false" Jun 12 18:38:19.504313 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496556 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496558 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496561 2571 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496564 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496567 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496570 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496573 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496576 2571 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496578 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496581 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496584 2571 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496586 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496590 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496592 2571 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496595 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496602 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496605 2571 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496608 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496612 2571 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496615 2571 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496618 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496620 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496623 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496626 2571 flags.go:64] FLAG: --v="2" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496630 2571 flags.go:64] FLAG: --version="false" Jun 12 18:38:19.504966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496634 2571 flags.go:64] FLAG: --vmodule="" Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496638 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.496642 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496779 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496784 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496787 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496791 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496794 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496796 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496799 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496801 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496804 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496807 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496809 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496812 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496815 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496819 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496821 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496824 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496826 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:38:19.505638 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496829 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496832 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496836 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496840 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496844 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496847 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496850 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496853 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496856 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496858 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496861 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496863 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496866 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496870 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496873 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496875 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496878 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496880 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496883 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:38:19.506168 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496886 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496889 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496891 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496894 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496896 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496899 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496902 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496904 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496907 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496911 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496914 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496917 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496919 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496922 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496924 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496929 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496931 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496934 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496936 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496939 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:38:19.506647 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496941 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496944 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496947 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496949 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496952 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496955 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496957 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496961 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496963 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496966 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496969 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496971 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496974 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496976 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496985 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496988 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496990 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496993 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.496997 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:38:19.507157 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497001 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497005 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497010 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497013 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497016 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497019 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497022 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497025 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497029 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497033 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497036 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497038 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497041 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497043 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497046 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497048 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497051 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497054 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497056 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497059 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:38:19.507628 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497061 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497069 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497072 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.497075 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.497081 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.505527 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.505544 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.505565 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.505575 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505641 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505646 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505649 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505653 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505656 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505660 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:38:19.508154 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505663 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505666 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505668 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505671 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505674 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505676 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505680 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505682 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505686 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505688 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505691 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505694 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505696 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505699 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505702 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505705 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505707 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505710 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505713 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505716 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:38:19.508542 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505719 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505722 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505724 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505727 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505729 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505732 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505735 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505737 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505740 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505742 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505745 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505748 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505766 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505770 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505775 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505778 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505780 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505783 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505786 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505789 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:38:19.509062 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505792 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505795 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505798 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505800 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505803 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505806 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505809 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505811 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505814 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505817 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505820 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505823 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505826 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505829 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505831 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505834 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505837 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505840 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505842 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505845 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:38:19.509572 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505847 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505850 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505852 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505855 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505858 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505860 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505863 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505866 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505868 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505871 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505874 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505876 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505879 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505883 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505887 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505890 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505893 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505896 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505898 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505901 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:38:19.510092 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505904 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505907 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505909 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505912 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505917 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505920 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505923 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505927 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505930 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505932 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505935 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505938 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.505941 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.505946 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:38:19.510574 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506064 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506068 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506072 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506075 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506078 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506081 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506084 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506087 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506091 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506094 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506097 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506100 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506103 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506106 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506109 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506112 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506115 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506118 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506121 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506123 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:38:19.510988 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506126 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506129 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506131 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506134 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506137 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506140 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506143 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506145 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506148 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506150 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506153 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506155 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506158 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506161 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506163 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506166 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506168 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506171 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506175 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:38:19.511483 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506178 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506181 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506184 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506187 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506190 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506192 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506195 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506197 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506200 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506204 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506207 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506210 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506213 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506215 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506218 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506221 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506224 2571 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506227 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506230 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506232 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:38:19.512126 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506235 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506238 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506240 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506243 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506245 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506249 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506252 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506255 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506257 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506260 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506263 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506265 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506268 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506270 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506273 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506276 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506278 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506280 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506283 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:38:19.512625 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506286 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506290 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506292 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506295 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506298 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506300 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506303 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506306 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506308 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506314 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506316 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506319 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506321 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506324 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506327 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506329 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506332 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506334 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506337 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506339 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:38:19.513119 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:19.506342 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:38:19.513630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.506347 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:38:19.513630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.506476 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:38:19.513630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.509175 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:38:19.513630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.511189 2571 server.go:1019] "Starting client certificate rotation" Jun 12 18:38:19.513630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.511293 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:38:19.513630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.511330 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:38:19.514005 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.513990 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:38:19.516808 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.516780 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:38:19.524709 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.524691 2571 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:38:19.528523 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.528508 2571 log.go:25] "Validated CRI v1 image API" Jun 12 18:38:19.530184 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.530165 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:38:19.533047 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.533025 2571 fs.go:135] Filesystem UUIDs: map[68f9fbd1-109e-461a-b3ac-0010bbce0441:/dev/nvme0n1p4 776f820a-fc62-41c0-8d55-02f45a013892:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 12 18:38:19.533137 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.533046 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:38:19.538076 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.537956 2571 manager.go:216] Machine: {Timestamp:2026-06-12 18:38:19.536766937 +0000 UTC m=+0.354080156 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100081 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5f09fc10ab4b57191f28814b1160 SystemUUID:ec2e5f09-fc10-ab4b-5719-1f28814b1160 BootID:d92d55c7-fcd2-4c7c-aab7-4cdabc28cfec Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:a1:21:19:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:a1:21:19:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:a3:4a:3d:fc:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:38:19.538076 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.538070 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:38:19.538232 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.538183 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:38:19.539793 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.539776 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:38:19.541336 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.541308 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:38:19.541478 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.541339 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-181.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:38:19.542102 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.542090 2571 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:38:19.542142 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.542106 2571 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:38:19.542142 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.542134 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:38:19.542871 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.542859 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:38:19.544242 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.544231 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:38:19.547419 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547407 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:38:19.547552 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547542 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:38:19.547588 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547576 2571 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:38:19.547615 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547589 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:38:19.547615 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547601 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:38:19.547615 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547611 2571 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:38:19.547714 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.547621 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:38:19.548030 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.548017 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:38:19.548082 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.548034 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:38:19.550168 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.550151 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:38:19.551966 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.551952 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:38:19.552054 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.551990 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:38:19.553187 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553173 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553195 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553204 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553212 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553225 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553233 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553248 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:38:19.553255 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553256 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:38:19.553476 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553266 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:38:19.553476 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553275 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:38:19.553476 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553287 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:38:19.553476 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.553296 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:38:19.554027 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.554016 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:38:19.554088 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.554030 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:38:19.557667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.557645 2571 server.go:1268] "Started kubelet" Jun 12 18:38:19.557911 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.557884 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 18:38:19.558047 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.558018 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-181.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 18:38:19.558146 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.558123 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:38:19.558208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.558151 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:38:19.558208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.558174 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:38:19.558349 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.558208 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:38:19.558908 ip-10-0-141-181 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:38:19.559932 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.559903 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:38:19.560640 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.560627 2571 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:38:19.564722 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.564701 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:38:19.566040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566022 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:38:19.566040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566034 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:38:19.566182 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.566154 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:19.566737 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566716 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:38:19.566737 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566734 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:38:19.566890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566736 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:38:19.566890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566859 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:38:19.566890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566873 2571 factory.go:55] Registering systemd factory Jun 12 18:38:19.566890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566878 2571 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:38:19.566890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566887 2571 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:38:19.567100 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.566881 2571 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:38:19.567254 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.567229 2571 factory.go:153] Registering CRI-O factory Jun 12 18:38:19.567254 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.566237 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-181.ec2.internal.18b8695cb743dadf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-181.ec2.internal,UID:ip-10-0-141-181.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-181.ec2.internal,},FirstTimestamp:2026-06-12 18:38:19.557616351 +0000 UTC m=+0.374929581,LastTimestamp:2026-06-12 18:38:19.557616351 +0000 UTC m=+0.374929581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-181.ec2.internal,}" Jun 12 18:38:19.567254 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.567243 2571 factory.go:223] Registration of the crio container factory successfully Jun 12 18:38:19.567423 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.567280 2571 factory.go:103] Registering Raw factory Jun 12 18:38:19.567423 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.567297 2571 manager.go:1196] Started watching for new ooms in manager Jun 12 18:38:19.567707 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.567695 2571 manager.go:349] Starting recovery of all containers Jun 12 18:38:19.569805 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.569779 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vj4pw" Jun 12 18:38:19.575332 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.575164 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vj4pw" Jun 12 18:38:19.575417 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.575322 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 18:38:19.575482 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.575456 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 18:38:19.577905 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.577888 2571 manager.go:354] Recovery completed Jun 12 18:38:19.579307 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.579290 2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 12 18:38:19.582822 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.582810 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.585186 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585169 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.585250 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585199 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.585250 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585210 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.585748 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585735 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:38:19.585748 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585746 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:38:19.585857 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585777 2571 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:38:19.585857 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.585776 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.586430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.586417 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.586477 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.586442 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.586477 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.586451 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.586835 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.586824 2571 policy_none.go:49] "None policy: Start" Jun 12 18:38:19.586867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.586841 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:38:19.586867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.586855 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:38:19.587873 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.587860 2571 policy_none.go:47] "Start" Jun 12 18:38:19.629786 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.629742 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.631107 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.631147 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.631170 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.631216 2571 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.632477 2571 manager.go:337] "Starting Device Plugin manager" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.632505 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.632514 2571 server.go:87] "Starting device plugin registration server" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.632828 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.632840 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.632935 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.633034 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.633045 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.633289 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.633697 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:38:19.634198 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.633735 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:19.731822 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.731783 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal"] Jun 12 18:38:19.731988 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.731865 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.733238 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.733223 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.733518 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.733501 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.733600 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.733529 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.733600 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.733541 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.733989 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.733971 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.734058 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.734004 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.734058 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.734020 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.734058 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.734049 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.734921 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.734909 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.735036 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735023 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.735071 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735054 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.735809 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735792 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.735880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735824 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.735880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735834 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.735880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735797 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.736005 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735896 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.736005 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.735910 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.737188 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.737175 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.737236 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.737197 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:38:19.737823 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.737774 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:38:19.737823 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.737801 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:38:19.737823 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.737811 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:38:19.742811 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.742796 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.742899 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.742820 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-181.ec2.internal\": node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:19.757923 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.757905 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:19.764543 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.764527 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-181.ec2.internal\" not found" node="ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.767849 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.767833 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c14988cbd2e9ef1c9d799f005dd042f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal\" (UID: \"c14988cbd2e9ef1c9d799f005dd042f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.767923 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.767857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/513823f35fc74f143c6d0ffe57151679-config\") pod \"kube-apiserver-proxy-ip-10-0-141-181.ec2.internal\" (UID: \"513823f35fc74f143c6d0ffe57151679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.767923 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.767878 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c14988cbd2e9ef1c9d799f005dd042f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal\" (UID: \"c14988cbd2e9ef1c9d799f005dd042f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.769052 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.769035 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-181.ec2.internal\" not found" node="ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.858683 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.858650 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:19.868672 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.868650 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c14988cbd2e9ef1c9d799f005dd042f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal\" (UID: \"c14988cbd2e9ef1c9d799f005dd042f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.868781 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.868684 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c14988cbd2e9ef1c9d799f005dd042f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal\" (UID: \"c14988cbd2e9ef1c9d799f005dd042f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.868781 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.868707 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/513823f35fc74f143c6d0ffe57151679-config\") pod \"kube-apiserver-proxy-ip-10-0-141-181.ec2.internal\" (UID: \"513823f35fc74f143c6d0ffe57151679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.868880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.868781 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c14988cbd2e9ef1c9d799f005dd042f2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal\" (UID: \"c14988cbd2e9ef1c9d799f005dd042f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.868880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.868787 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c14988cbd2e9ef1c9d799f005dd042f2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal\" (UID: \"c14988cbd2e9ef1c9d799f005dd042f2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.868880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:19.868780 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/513823f35fc74f143c6d0ffe57151679-config\") pod \"kube-apiserver-proxy-ip-10-0-141-181.ec2.internal\" (UID: \"513823f35fc74f143c6d0ffe57151679\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" Jun 12 18:38:19.959649 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:19.959600 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.060505 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.060432 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.067702 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.067679 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:20.072472 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.072430 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" Jun 12 18:38:20.161147 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.161107 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.261640 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.261604 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.362218 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.362137 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.462648 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.462614 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.510112 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.510079 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:38:20.510785 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.510244 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:38:20.562822 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.562790 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.576909 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.576888 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:38:20.579277 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:20.579245 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513823f35fc74f143c6d0ffe57151679.slice/crio-f41930b193ccb0ce5b930ddd2c82b15dd965e2c6e46100d8108a9d42aeeb4cfd WatchSource:0}: Error finding container f41930b193ccb0ce5b930ddd2c82b15dd965e2c6e46100d8108a9d42aeeb4cfd: Status 404 returned error can't find the container with id f41930b193ccb0ce5b930ddd2c82b15dd965e2c6e46100d8108a9d42aeeb4cfd Jun 12 18:38:20.579512 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:20.579495 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14988cbd2e9ef1c9d799f005dd042f2.slice/crio-0d8e1c825ddbc906754a184c81070830b653b7c269fa7dbd6948e6c6a8cbcbe6 WatchSource:0}: Error finding container 0d8e1c825ddbc906754a184c81070830b653b7c269fa7dbd6948e6c6a8cbcbe6: Status 404 returned error can't find the container with id 0d8e1c825ddbc906754a184c81070830b653b7c269fa7dbd6948e6c6a8cbcbe6 Jun 12 18:38:20.580615 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.580588 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:33:19 +0000 UTC" deadline="2028-02-01 09:12:08.387475976 +0000 UTC" Jun 12 18:38:20.580661 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.580616 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14366h33m47.806862643s" Jun 12 18:38:20.584413 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.584397 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:38:20.635013 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.634904 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" event={"ID":"c14988cbd2e9ef1c9d799f005dd042f2","Type":"ContainerStarted","Data":"0d8e1c825ddbc906754a184c81070830b653b7c269fa7dbd6948e6c6a8cbcbe6"} Jun 12 18:38:20.635964 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.635942 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" event={"ID":"513823f35fc74f143c6d0ffe57151679","Type":"ContainerStarted","Data":"f41930b193ccb0ce5b930ddd2c82b15dd965e2c6e46100d8108a9d42aeeb4cfd"} Jun 12 18:38:20.663127 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.663094 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.763660 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.763627 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.864185 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.864148 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:20.904897 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:20.904823 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:38:20.964875 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:20.964843 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-181.ec2.internal\" not found" Jun 12 18:38:21.052502 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.052312 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:38:21.066782 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.066571 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" Jun 12 18:38:21.081027 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.080942 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:38:21.082189 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.081964 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" Jun 12 18:38:21.091685 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.091659 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:38:21.548772 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.548720 2571 apiserver.go:52] "Watching apiserver" Jun 12 18:38:21.555898 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.555873 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:38:21.556858 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.556828 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-w4d76","openshift-cluster-node-tuning-operator/tuned-9pb2j","openshift-image-registry/node-ca-7j7x2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal","openshift-multus/multus-42n7k","openshift-multus/multus-additional-cni-plugins-bkz5q","openshift-ovn-kubernetes/ovnkube-node-55rhx","kube-system/konnectivity-agent-rj6jz","kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb","openshift-dns/node-resolver-xw5bq","openshift-multus/network-metrics-daemon-28pfq","openshift-network-diagnostics/network-check-target-bkzdl","openshift-network-operator/iptables-alerter-n2cn5"] Jun 12 18:38:21.558425 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.558400 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.559500 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.559477 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:21.559614 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.559543 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:21.560642 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.560621 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.561146 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.561118 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:38:21.561146 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.561138 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4wbmx\"" Jun 12 18:38:21.561291 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.561138 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.561291 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.561127 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.561860 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.561828 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.563158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.563072 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.563158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.563082 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:38:21.563158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.563131 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qxrsv\"" Jun 12 18:38:21.563158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.563133 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.563499 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.563476 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.564197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.564044 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.564197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.564056 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.564197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.564070 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:38:21.564197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.564059 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zcm6k\"" Jun 12 18:38:21.564826 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.564806 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.565514 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.565495 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:38:21.566071 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.566049 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.566071 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.566067 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:38:21.566625 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.566323 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:38:21.566625 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.566388 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.566625 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.566560 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6hk5r\"" Jun 12 18:38:21.566830 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.566743 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.567245 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.567123 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:38:21.567245 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.567185 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d8767\"" Jun 12 18:38:21.567245 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.567191 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:38:21.568468 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.568254 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.571192 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571166 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8cbdr\"" Jun 12 18:38:21.571558 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571352 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:38:21.571558 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571354 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:38:21.571558 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571475 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:38:21.571558 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571173 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.571801 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571663 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.571801 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571692 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.571801 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.571767 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:21.572196 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.571935 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:38:21.572196 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.572029 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.572330 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.572224 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zhqd4\"" Jun 12 18:38:21.572920 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.572887 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:38:21.573002 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.572973 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:38:21.573328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.573306 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.574104 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.574074 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.574275 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.574254 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nm9qw\"" Jun 12 18:38:21.574359 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.574343 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.574681 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.574664 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:21.574785 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.574727 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:21.575598 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.575579 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9s6dh\"" Jun 12 18:38:21.575698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.575608 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:38:21.575698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.575627 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:38:21.577649 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577623 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-env-overrides\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.577736 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-os-release\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.577736 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577681 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-cni-multus\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.577736 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577704 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovn-node-metrics-cert\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.577736 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577727 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-etc-kubernetes\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.577946 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrwg\" (UniqueName: \"kubernetes.io/projected/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-kube-api-access-zmrwg\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.577946 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577787 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-var-lib-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.577946 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577830 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-etc-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.577946 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577870 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovnkube-script-lib\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.577946 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577897 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4246\" (UniqueName: \"kubernetes.io/projected/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-kube-api-access-h4246\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.577946 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577924 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577964 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xlh\" (UniqueName: \"kubernetes.io/projected/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-kube-api-access-v5xlh\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.577991 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-cni-bin\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578019 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84v8f\" (UniqueName: \"kubernetes.io/projected/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-kube-api-access-84v8f\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578043 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-hostroot\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578065 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovnkube-config\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578088 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-cnibin\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578110 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-socket-dir-parent\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578132 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-conf-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-multus-certs\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578176 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578177 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578233 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cnibin\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578261 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-systemd-units\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578284 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-log-socket\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578307 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-run-ovn-kubernetes\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578337 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578362 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-socket-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578386 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-host-slash\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578409 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578436 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578457 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-device-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f091a1a-4b22-49b7-9406-8f75ca5d1c37-agent-certs\") pod \"konnectivity-agent-rj6jz\" (UID: \"5f091a1a-4b22-49b7-9406-8f75ca5d1c37\") " pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578495 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-host\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578510 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-cni-binary-copy\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.578563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f091a1a-4b22-49b7-9406-8f75ca5d1c37-konnectivity-ca\") pod \"konnectivity-agent-rj6jz\" (UID: \"5f091a1a-4b22-49b7-9406-8f75ca5d1c37\") " pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578590 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-run-netns\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578643 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578684 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-cni-bin\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578720 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gbkr\" (UniqueName: \"kubernetes.io/projected/de89c567-7cc9-4707-830f-922d4c404be4-kube-api-access-5gbkr\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578763 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-netns\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578791 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-system-cni-dir\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578814 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578830 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578864 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck5bn\" (UniqueName: \"kubernetes.io/projected/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-kube-api-access-ck5bn\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578883 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-kubelet\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578904 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-k8s-cni-cncf-io\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578927 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-sys-fs\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.578972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-kubelet\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579012 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-ovn\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579040 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-registration-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.579191 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579065 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-serviceca\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579087 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-system-cni-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579110 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-daemon-config\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579133 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579157 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-node-log\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579230 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-cni-netd\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579281 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-iptables-alerter-script\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579319 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-os-release\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579372 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-cni-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579398 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-slash\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.579877 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.579420 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-systemd\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.581031 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.581000 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:38:21.605315 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.605294 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jcjn2" Jun 12 18:38:21.612197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.612177 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jcjn2" Jun 12 18:38:21.667451 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.667422 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:38:21.680277 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680245 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cnibin\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.680446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680287 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-systemd-units\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680312 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-log-socket\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680337 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-run-ovn-kubernetes\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680407 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-systemd-units\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680406 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-log-socket\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680443 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-run-ovn-kubernetes\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680487 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680540 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cnibin\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680583 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680609 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-modprobe-d\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680637 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-systemd\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.680667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680663 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-socket-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-host-slash\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680730 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680770 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-lib-modules\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680793 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-tuned\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680800 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-host-slash\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680816 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqh9\" (UniqueName: \"kubernetes.io/projected/ca31a26a-4bab-404e-975f-f4043ad6d818-kube-api-access-pwqh9\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680841 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680870 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-device-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680893 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f091a1a-4b22-49b7-9406-8f75ca5d1c37-agent-certs\") pod \"konnectivity-agent-rj6jz\" (UID: \"5f091a1a-4b22-49b7-9406-8f75ca5d1c37\") " pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680915 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-host\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680924 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-device-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680947 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680940 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-cni-binary-copy\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.680978 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680979 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea0e87f-8b1f-4a0b-b20f-796703eed425-tmp-dir\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680998 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f091a1a-4b22-49b7-9406-8f75ca5d1c37-konnectivity-ca\") pod \"konnectivity-agent-rj6jz\" (UID: \"5f091a1a-4b22-49b7-9406-8f75ca5d1c37\") " pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681015 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-run-netns\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681031 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681309 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-cni-bin\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681346 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ea0e87f-8b1f-4a0b-b20f-796703eed425-hosts-file\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681379 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysctl-conf\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681418 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5tpp\" (UniqueName: \"kubernetes.io/projected/eee93665-037c-49c4-b1e3-b7d46a5a2df9-kube-api-access-m5tpp\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681454 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gbkr\" (UniqueName: \"kubernetes.io/projected/de89c567-7cc9-4707-830f-922d4c404be4-kube-api-access-5gbkr\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681482 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-netns\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681504 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-system-cni-dir\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681531 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681565 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.681603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681603 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck5bn\" (UniqueName: \"kubernetes.io/projected/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-kube-api-access-ck5bn\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681634 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-kubelet\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681665 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-kubelet-config\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681700 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-k8s-cni-cncf-io\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.680871 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-socket-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681727 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-cni-binary-copy\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681801 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-host\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.681908 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:38:21.682172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682014 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cni-binary-copy\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.682525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682222 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-system-cni-dir\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.682525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682299 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-kubelet\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.682525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682488 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.682525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682486 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f091a1a-4b22-49b7-9406-8f75ca5d1c37-konnectivity-ca\") pod \"konnectivity-agent-rj6jz\" (UID: \"5f091a1a-4b22-49b7-9406-8f75ca5d1c37\") " pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.682698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682545 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-run-netns\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.682698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682666 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.682698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682686 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-cni-bin\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.682698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682687 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.682891 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682740 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-k8s-cni-cncf-io\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.682891 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.682796 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-netns\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.684935 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.684907 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-sys-fs\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.685054 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.684963 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-kubelet\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.685054 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.684993 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-ovn\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.685054 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685019 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysconfig\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.685222 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685076 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysctl-d\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.685222 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685103 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-run\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.685222 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-registration-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.685222 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685178 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-serviceca\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.685420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685232 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-system-cni-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.685420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685272 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-daemon-config\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.685420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685300 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.685420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685338 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-node-log\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.685420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685373 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-cni-netd\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.685420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-iptables-alerter-script\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685438 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-os-release\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685465 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685504 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-cni-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685525 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-slash\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685553 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-systemd\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-env-overrides\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685643 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz2gr\" (UniqueName: \"kubernetes.io/projected/0ea0e87f-8b1f-4a0b-b20f-796703eed425-kube-api-access-kz2gr\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.685690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685672 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-os-release\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685695 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-cni-multus\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685734 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovn-node-metrics-cert\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685777 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-dbus\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685830 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-etc-kubernetes\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685831 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-node-log\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685853 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrwg\" (UniqueName: \"kubernetes.io/projected/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-kube-api-access-zmrwg\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.686079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.685949 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-systemd\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.686545 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.686517 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-cni-netd\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.686638 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.686558 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-cni-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.686823 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.686795 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-etc-kubernetes\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.686951 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.686896 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-host-slash\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.687009 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.686975 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-os-release\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.687063 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.687033 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-env-overrides\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.687151 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.687108 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-system-cni-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.688136 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.687664 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-os-release\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.688136 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.687602 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-kubelet\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.688136 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688125 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-daemon-config\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.688338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.687572 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-iptables-alerter-script\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.688338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688174 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-serviceca\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.688338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688202 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-run-ovn\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688219 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f091a1a-4b22-49b7-9406-8f75ca5d1c37-agent-certs\") pod \"konnectivity-agent-rj6jz\" (UID: \"5f091a1a-4b22-49b7-9406-8f75ca5d1c37\") " pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.688338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688252 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-cni-multus\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.688338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688324 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-var-lib-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688359 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-etc-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688388 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovnkube-script-lib\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688424 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-var-lib-kubelet\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688430 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-sys-fs\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688447 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-host\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688389 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-registration-dir\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688461 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-var-lib-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688472 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4246\" (UniqueName: \"kubernetes.io/projected/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-kube-api-access-h4246\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688431 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-etc-openvswitch\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688498 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688521 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca31a26a-4bab-404e-975f-f4043ad6d818-tmp\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688545 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688571 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xlh\" (UniqueName: \"kubernetes.io/projected/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-kube-api-access-v5xlh\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688594 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-kubernetes\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.688616 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688619 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-sys\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688642 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-cni-bin\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688683 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84v8f\" (UniqueName: \"kubernetes.io/projected/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-kube-api-access-84v8f\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-hostroot\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688728 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovnkube-config\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688770 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-cnibin\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688794 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-socket-dir-parent\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688819 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-conf-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688844 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-multus-certs\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688948 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-hostroot\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688951 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovnkube-script-lib\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.688999 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de89c567-7cc9-4707-830f-922d4c404be4-etc-selinux\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.689007 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-socket-dir-parent\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.689030 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-var-lib-cni-bin\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.689050 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-multus-conf-dir\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.689086 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-cnibin\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.689395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.689094 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-host-run-multus-certs\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.690208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.689519 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovnkube-config\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.690579 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.690539 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gbkr\" (UniqueName: \"kubernetes.io/projected/de89c567-7cc9-4707-830f-922d4c404be4-kube-api-access-5gbkr\") pod \"aws-ebs-csi-driver-node-6q9mb\" (UID: \"de89c567-7cc9-4707-830f-922d4c404be4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.690682 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.690662 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-ovn-node-metrics-cert\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.691282 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.691261 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck5bn\" (UniqueName: \"kubernetes.io/projected/22a420ce-3b09-41eb-81b1-31ee62bb7c1d-kube-api-access-ck5bn\") pod \"multus-additional-cni-plugins-bkz5q\" (UID: \"22a420ce-3b09-41eb-81b1-31ee62bb7c1d\") " pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.693974 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.693955 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrwg\" (UniqueName: \"kubernetes.io/projected/50b2aecc-cc91-4152-b9ae-372efaa2dfd8-kube-api-access-zmrwg\") pod \"multus-42n7k\" (UID: \"50b2aecc-cc91-4152-b9ae-372efaa2dfd8\") " pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.696522 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.696493 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:21.696617 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.696527 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:21.696617 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.696541 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:21.696617 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.696609 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:38:22.196588676 +0000 UTC m=+3.013901897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:21.699058 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.699030 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4246\" (UniqueName: \"kubernetes.io/projected/c1d311cb-c9b6-42fb-891e-4ef4183acf5a-kube-api-access-h4246\") pod \"iptables-alerter-n2cn5\" (UID: \"c1d311cb-c9b6-42fb-891e-4ef4183acf5a\") " pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.699238 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.699211 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xlh\" (UniqueName: \"kubernetes.io/projected/a58fa68c-b09e-4bf4-b7b5-222ebca33eb3-kube-api-access-v5xlh\") pod \"ovnkube-node-55rhx\" (UID: \"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3\") " pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.699337 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.699308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84v8f\" (UniqueName: \"kubernetes.io/projected/4b0b1c8c-5cd1-457b-8fa3-a85616991fbe-kube-api-access-84v8f\") pod \"node-ca-7j7x2\" (UID: \"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe\") " pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.751876 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.751848 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:38:21.789841 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789801 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-kubernetes\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.789841 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789839 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-sys\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-modprobe-d\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789890 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-systemd\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789913 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-lib-modules\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789940 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-kubernetes\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789932 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-sys\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.789933 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-tuned\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790000 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqh9\" (UniqueName: \"kubernetes.io/projected/ca31a26a-4bab-404e-975f-f4043ad6d818-kube-api-access-pwqh9\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790072 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790016 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-systemd\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790093 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-lib-modules\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790119 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-modprobe-d\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790138 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea0e87f-8b1f-4a0b-b20f-796703eed425-tmp-dir\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790330 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ea0e87f-8b1f-4a0b-b20f-796703eed425-hosts-file\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790358 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysctl-conf\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790386 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5tpp\" (UniqueName: \"kubernetes.io/projected/eee93665-037c-49c4-b1e3-b7d46a5a2df9-kube-api-access-m5tpp\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790420 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea0e87f-8b1f-4a0b-b20f-796703eed425-tmp-dir\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.790445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790434 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-kubelet-config\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790540 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0ea0e87f-8b1f-4a0b-b20f-796703eed425-hosts-file\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790552 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysconfig\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790579 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysctl-d\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790579 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-kubelet-config\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790604 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysconfig\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790609 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-run\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790642 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790651 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-run\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790608 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysctl-conf\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790670 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz2gr\" (UniqueName: \"kubernetes.io/projected/0ea0e87f-8b1f-4a0b-b20f-796703eed425-kube-api-access-kz2gr\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790706 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-sysctl-d\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.790776 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-dbus\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.790856 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.790837 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:22.290818603 +0000 UTC m=+3.108131834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-var-lib-kubelet\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790893 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-host\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790922 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-dbus\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790941 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-var-lib-kubelet\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790927 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca31a26a-4bab-404e-975f-f4043ad6d818-tmp\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790962 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca31a26a-4bab-404e-975f-f4043ad6d818-host\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.790988 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.791081 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:21.791544 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:21.791131 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:22.291111927 +0000 UTC m=+3.108425151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:21.792880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.792853 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca31a26a-4bab-404e-975f-f4043ad6d818-etc-tuned\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.793193 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.793175 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca31a26a-4bab-404e-975f-f4043ad6d818-tmp\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.798713 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.798692 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5tpp\" (UniqueName: \"kubernetes.io/projected/eee93665-037c-49c4-b1e3-b7d46a5a2df9-kube-api-access-m5tpp\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:21.798843 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.798773 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz2gr\" (UniqueName: \"kubernetes.io/projected/0ea0e87f-8b1f-4a0b-b20f-796703eed425-kube-api-access-kz2gr\") pod \"node-resolver-xw5bq\" (UID: \"0ea0e87f-8b1f-4a0b-b20f-796703eed425\") " pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:21.798918 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.798902 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqh9\" (UniqueName: \"kubernetes.io/projected/ca31a26a-4bab-404e-975f-f4043ad6d818-kube-api-access-pwqh9\") pod \"tuned-9pb2j\" (UID: \"ca31a26a-4bab-404e-975f-f4043ad6d818\") " pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.870961 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.870929 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" Jun 12 18:38:21.881201 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.881171 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7j7x2" Jun 12 18:38:21.890479 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.890458 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2cn5" Jun 12 18:38:21.896964 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.896943 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-42n7k" Jun 12 18:38:21.903685 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.903664 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" Jun 12 18:38:21.911543 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.911520 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:21.916339 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.916319 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:21.922092 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.922075 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" Jun 12 18:38:21.927773 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:21.927742 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xw5bq" Jun 12 18:38:22.294407 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.294375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:22.294573 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.294430 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:22.294573 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.294455 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:22.294573 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294532 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:22.294573 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294545 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:22.294796 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294599 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:23.294582367 +0000 UTC m=+4.111895573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:22.294796 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294604 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:22.294796 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294620 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:23.2946098 +0000 UTC m=+4.111923008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:22.294796 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294622 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:22.294796 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294635 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:22.294796 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:22.294701 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:38:23.294685286 +0000 UTC m=+4.111998512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:22.474519 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.474482 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b2aecc_cc91_4152_b9ae_372efaa2dfd8.slice/crio-95251cbeee33ffdf726df2182538cec283c625cbe05e2120075beeae9940f364 WatchSource:0}: Error finding container 95251cbeee33ffdf726df2182538cec283c625cbe05e2120075beeae9940f364: Status 404 returned error can't find the container with id 95251cbeee33ffdf726df2182538cec283c625cbe05e2120075beeae9940f364 Jun 12 18:38:22.476435 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.476410 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde89c567_7cc9_4707_830f_922d4c404be4.slice/crio-7e102bcd548bb6b14fd30873c1405f9faba75fd0b1b27664ebbcf176bf815bea WatchSource:0}: Error finding container 7e102bcd548bb6b14fd30873c1405f9faba75fd0b1b27664ebbcf176bf815bea: Status 404 returned error can't find the container with id 7e102bcd548bb6b14fd30873c1405f9faba75fd0b1b27664ebbcf176bf815bea Jun 12 18:38:22.481994 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.481716 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d311cb_c9b6_42fb_891e_4ef4183acf5a.slice/crio-e86caeb3ec92cd046d8fc569e40702e9312007b054572c6dee600c6ac022f6bb WatchSource:0}: Error finding container e86caeb3ec92cd046d8fc569e40702e9312007b054572c6dee600c6ac022f6bb: Status 404 returned error can't find the container with id e86caeb3ec92cd046d8fc569e40702e9312007b054572c6dee600c6ac022f6bb Jun 12 18:38:22.484006 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.483936 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea0e87f_8b1f_4a0b_b20f_796703eed425.slice/crio-bb7a847fd12ff05d34f1df2a3a5e31a4ac9a42e06322fe9eda854d1059bff6d7 WatchSource:0}: Error finding container bb7a847fd12ff05d34f1df2a3a5e31a4ac9a42e06322fe9eda854d1059bff6d7: Status 404 returned error can't find the container with id bb7a847fd12ff05d34f1df2a3a5e31a4ac9a42e06322fe9eda854d1059bff6d7 Jun 12 18:38:22.485666 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.485644 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f091a1a_4b22_49b7_9406_8f75ca5d1c37.slice/crio-1a0d83c770c9d334e7081fe87f3a8570ecafccb7cd5d2a19a410fff9b784eb9f WatchSource:0}: Error finding container 1a0d83c770c9d334e7081fe87f3a8570ecafccb7cd5d2a19a410fff9b784eb9f: Status 404 returned error can't find the container with id 1a0d83c770c9d334e7081fe87f3a8570ecafccb7cd5d2a19a410fff9b784eb9f Jun 12 18:38:22.486463 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.486406 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0b1c8c_5cd1_457b_8fa3_a85616991fbe.slice/crio-1bb9d5a46dc361417d3a4ab26a91cdd6e9ef2c0a38d91e3d20149e9f604db3c7 WatchSource:0}: Error finding container 1bb9d5a46dc361417d3a4ab26a91cdd6e9ef2c0a38d91e3d20149e9f604db3c7: Status 404 returned error can't find the container with id 1bb9d5a46dc361417d3a4ab26a91cdd6e9ef2c0a38d91e3d20149e9f604db3c7 Jun 12 18:38:22.487551 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.487470 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a420ce_3b09_41eb_81b1_31ee62bb7c1d.slice/crio-ee38fcc894e5f211ad0259dedf330cf6b56855396b138cf70fb84c04c41e39e6 WatchSource:0}: Error finding container ee38fcc894e5f211ad0259dedf330cf6b56855396b138cf70fb84c04c41e39e6: Status 404 returned error can't find the container with id ee38fcc894e5f211ad0259dedf330cf6b56855396b138cf70fb84c04c41e39e6 Jun 12 18:38:22.488575 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:22.488519 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca31a26a_4bab_404e_975f_f4043ad6d818.slice/crio-5dd0b7391729672a57fa505e22b0b580f049fb7d4b48b8534ee9e2dcc948aa6d WatchSource:0}: Error finding container 5dd0b7391729672a57fa505e22b0b580f049fb7d4b48b8534ee9e2dcc948aa6d: Status 404 returned error can't find the container with id 5dd0b7391729672a57fa505e22b0b580f049fb7d4b48b8534ee9e2dcc948aa6d Jun 12 18:38:22.614654 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.614433 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:33:21 +0000 UTC" deadline="2027-11-30 07:16:29.574423584 +0000 UTC" Jun 12 18:38:22.614654 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.614652 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12852h38m6.959776968s" Jun 12 18:38:22.640464 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.640428 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerStarted","Data":"ee38fcc894e5f211ad0259dedf330cf6b56855396b138cf70fb84c04c41e39e6"} Jun 12 18:38:22.641552 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.641529 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7j7x2" event={"ID":"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe","Type":"ContainerStarted","Data":"1bb9d5a46dc361417d3a4ab26a91cdd6e9ef2c0a38d91e3d20149e9f604db3c7"} Jun 12 18:38:22.642683 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.642651 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2cn5" event={"ID":"c1d311cb-c9b6-42fb-891e-4ef4183acf5a","Type":"ContainerStarted","Data":"e86caeb3ec92cd046d8fc569e40702e9312007b054572c6dee600c6ac022f6bb"} Jun 12 18:38:22.643743 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.643719 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"5014795a45e4f3419d8d2870d21259b8581ef03cb52d4f83fba59cf3f3cb485c"} Jun 12 18:38:22.644802 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.644781 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" event={"ID":"ca31a26a-4bab-404e-975f-f4043ad6d818","Type":"ContainerStarted","Data":"5dd0b7391729672a57fa505e22b0b580f049fb7d4b48b8534ee9e2dcc948aa6d"} Jun 12 18:38:22.645922 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.645901 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rj6jz" event={"ID":"5f091a1a-4b22-49b7-9406-8f75ca5d1c37","Type":"ContainerStarted","Data":"1a0d83c770c9d334e7081fe87f3a8570ecafccb7cd5d2a19a410fff9b784eb9f"} Jun 12 18:38:22.647166 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.647147 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xw5bq" event={"ID":"0ea0e87f-8b1f-4a0b-b20f-796703eed425","Type":"ContainerStarted","Data":"bb7a847fd12ff05d34f1df2a3a5e31a4ac9a42e06322fe9eda854d1059bff6d7"} Jun 12 18:38:22.648292 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.648267 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" event={"ID":"de89c567-7cc9-4707-830f-922d4c404be4","Type":"ContainerStarted","Data":"7e102bcd548bb6b14fd30873c1405f9faba75fd0b1b27664ebbcf176bf815bea"} Jun 12 18:38:22.649563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.649542 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-42n7k" event={"ID":"50b2aecc-cc91-4152-b9ae-372efaa2dfd8","Type":"ContainerStarted","Data":"95251cbeee33ffdf726df2182538cec283c625cbe05e2120075beeae9940f364"} Jun 12 18:38:22.651350 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.651327 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" event={"ID":"513823f35fc74f143c6d0ffe57151679","Type":"ContainerStarted","Data":"3a5aeda5be4bac3bd7b3354c3f33c81bca312142f6120ec80a1d07771be262a9"} Jun 12 18:38:22.667082 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:22.667022 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-181.ec2.internal" podStartSLOduration=1.6670061409999999 podStartE2EDuration="1.667006141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:22.666235807 +0000 UTC m=+3.483549035" watchObservedRunningTime="2026-06-12 18:38:22.667006141 +0000 UTC m=+3.484319369" Jun 12 18:38:23.303473 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.303435 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:23.303697 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.303490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:23.303697 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.303556 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:23.303697 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.303691 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:23.303917 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.303774 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:25.303738793 +0000 UTC m=+6.121052017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:23.304219 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.304198 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:23.304301 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.304226 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:23.304301 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.304238 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:23.304301 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.304288 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:38:25.304271024 +0000 UTC m=+6.121584232 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:23.304466 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.304360 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:23.304466 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.304393 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:25.304382055 +0000 UTC m=+6.121695268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:23.615874 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.615745 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:33:21 +0000 UTC" deadline="2028-01-03 18:55:57.754554536 +0000 UTC" Jun 12 18:38:23.615874 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.615807 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13680h17m34.138752798s" Jun 12 18:38:23.634579 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.634545 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:23.634780 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.634673 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:23.635109 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.635085 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:23.635211 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.635190 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:23.635289 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.635259 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:23.635363 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:23.635343 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:23.666364 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.666328 2571 generic.go:356] "Generic (PLEG): container finished" podID="c14988cbd2e9ef1c9d799f005dd042f2" containerID="f2eb635897e299bea97158d86a35abc359483349a99b81b1585ef4918dce1d3b" exitCode=0 Jun 12 18:38:23.666591 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:23.666511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" event={"ID":"c14988cbd2e9ef1c9d799f005dd042f2","Type":"ContainerDied","Data":"f2eb635897e299bea97158d86a35abc359483349a99b81b1585ef4918dce1d3b"} Jun 12 18:38:24.690098 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:24.690049 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" event={"ID":"c14988cbd2e9ef1c9d799f005dd042f2","Type":"ContainerStarted","Data":"134277b49853245371bb1f496ceb404d2fea97c0f302edcee62aac8ab0b80f22"} Jun 12 18:38:24.706080 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:24.706021 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-181.ec2.internal" podStartSLOduration=3.706001868 podStartE2EDuration="3.706001868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:24.705936621 +0000 UTC m=+5.523249851" watchObservedRunningTime="2026-06-12 18:38:24.706001868 +0000 UTC m=+5.523315100" Jun 12 18:38:25.319352 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:25.319309 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:25.319525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:25.319382 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:25.319525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:25.319412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:25.319642 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.319549 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:25.319642 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.319609 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:29.31959188 +0000 UTC m=+10.136905090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:25.320074 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.320043 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:25.320169 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.320109 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:29.32009131 +0000 UTC m=+10.137404519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:25.320251 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.320192 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:25.320251 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.320205 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:25.320251 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.320218 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:25.320391 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.320253 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:38:29.320241438 +0000 UTC m=+10.137554649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:25.632253 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:25.631859 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:25.632253 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.631989 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:25.632253 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:25.632146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:25.632513 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.632250 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:25.632513 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:25.632390 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:25.632513 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:25.632472 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:27.632355 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:27.632319 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:27.632355 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:27.632358 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:27.632860 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:27.632319 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:27.632860 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:27.632457 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:27.632860 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:27.632544 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:27.632860 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:27.632611 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:29.351137 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:29.351095 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:29.351184 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:29.351223 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351364 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351387 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351399 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351399 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351457 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:37.351438871 +0000 UTC m=+18.168752096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351478 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:38:37.35146895 +0000 UTC m=+18.168782175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351478 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:29.351577 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.351509 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:37.351500647 +0000 UTC m=+18.168813867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:29.633325 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:29.633239 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:29.633491 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.633338 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:29.633491 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:29.633359 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:29.633491 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.633462 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:29.633636 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:29.633526 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:29.633636 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:29.633611 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:31.632769 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:31.632454 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:31.632769 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:31.632456 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:31.632769 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:31.632596 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:31.632769 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:31.632700 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:31.632769 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:31.632454 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:31.633441 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:31.633236 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:32.714799 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:32.712485 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" event={"ID":"ca31a26a-4bab-404e-975f-f4043ad6d818","Type":"ContainerStarted","Data":"32f8edb69263cf4b1855270e5faf08e39c33aa16f4de0138ec492a3a6f62b9a0"} Jun 12 18:38:32.716827 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:32.716731 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rj6jz" event={"ID":"5f091a1a-4b22-49b7-9406-8f75ca5d1c37","Type":"ContainerStarted","Data":"f578545c0e36fac5c1e5f95c12a9608790937b6d2d6068029699be118fafa456"} Jun 12 18:38:32.729575 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:32.729282 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9pb2j" podStartSLOduration=3.657400565 podStartE2EDuration="13.729263421s" totalImagesPullingTime="10.071862856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:32.728891839 +0000 UTC m=+13.546205070" watchObservedRunningTime="2026-06-12 18:38:32.729263421 +0000 UTC m=+13.546576651" Jun 12 18:38:33.632105 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.631815 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:33.632300 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.631815 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:33.632300 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:33.632181 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:33.632411 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:33.632294 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:33.632411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.631835 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:33.632411 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:33.632390 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:33.720216 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.720145 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7j7x2" event={"ID":"4b0b1c8c-5cd1-457b-8fa3-a85616991fbe","Type":"ContainerStarted","Data":"3dc396ed10ef3fd8068ee0b6e05563ece8eba6d0cb7ab4b5f6d360c2e7fb40d2"} Jun 12 18:38:33.721798 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.721748 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xw5bq" event={"ID":"0ea0e87f-8b1f-4a0b-b20f-796703eed425","Type":"ContainerStarted","Data":"16a36cf05122afc266dc3a60a0bbee1a680d2f2a6506216c4023244c35f2d76a"} Jun 12 18:38:33.723358 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.723330 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" event={"ID":"de89c567-7cc9-4707-830f-922d4c404be4","Type":"ContainerStarted","Data":"0838d083cd5ec3f06cb777553a0c9cfe6f9af95e697bfbcc4a01fc4d30a1530a"} Jun 12 18:38:33.724868 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.724843 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerStarted","Data":"bc30f1c7a3368c14631fe7f35abb7111b898ee9d7ae9a7278236c4a7b55f119b"} Jun 12 18:38:33.733630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.733591 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7j7x2" podStartSLOduration=4.711248476 podStartE2EDuration="14.733578146s" totalImagesPullingTime="10.02232967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:33.733526476 +0000 UTC m=+14.550839704" watchObservedRunningTime="2026-06-12 18:38:33.733578146 +0000 UTC m=+14.550891375" Jun 12 18:38:33.769247 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.769192 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rj6jz" podStartSLOduration=4.750792595 podStartE2EDuration="14.769175264s" totalImagesPullingTime="10.018382669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:33.768847076 +0000 UTC m=+14.586160305" watchObservedRunningTime="2026-06-12 18:38:33.769175264 +0000 UTC m=+14.586488514" Jun 12 18:38:33.784708 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:33.784645 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xw5bq" podStartSLOduration=4.732462939 podStartE2EDuration="14.78462895s" totalImagesPullingTime="10.052166011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:33.784626643 +0000 UTC m=+14.601939873" watchObservedRunningTime="2026-06-12 18:38:33.78462895 +0000 UTC m=+14.601942178" Jun 12 18:38:34.728726 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:34.728685 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2cn5" event={"ID":"c1d311cb-c9b6-42fb-891e-4ef4183acf5a","Type":"ContainerStarted","Data":"562ef58ec0a3bd694728d562c7cd2b4399e68ac59bb578989e7961f86a255dc2"} Jun 12 18:38:34.746934 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:34.746887 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n2cn5" podStartSLOduration=5.719392732 podStartE2EDuration="15.74686661s" totalImagesPullingTime="10.027473878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:34.746491521 +0000 UTC m=+15.563804750" watchObservedRunningTime="2026-06-12 18:38:34.74686661 +0000 UTC m=+15.564179839" Jun 12 18:38:35.547030 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:35.546987 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:35.547697 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:35.547678 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:35.631625 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:35.631541 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:35.631625 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:35.631564 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:35.631901 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:35.631545 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:35.631901 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:35.631672 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:35.631901 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:35.631778 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:35.631901 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:35.631846 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:36.735507 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:36.735474 2571 generic.go:356] "Generic (PLEG): container finished" podID="22a420ce-3b09-41eb-81b1-31ee62bb7c1d" containerID="bc30f1c7a3368c14631fe7f35abb7111b898ee9d7ae9a7278236c4a7b55f119b" exitCode=0 Jun 12 18:38:36.736223 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:36.735569 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:38:36.736223 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:36.735561 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerDied","Data":"bc30f1c7a3368c14631fe7f35abb7111b898ee9d7ae9a7278236c4a7b55f119b"} Jun 12 18:38:37.413231 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:37.413189 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:37.413231 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:37.413248 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:37.413273 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413359 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413365 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413380 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413404 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413418 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413420 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:53.413404621 +0000 UTC m=+34.230717830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:37.413489 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413485 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:38:53.413467441 +0000 UTC m=+34.230780649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:37.413890 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.413501 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:38:53.413493771 +0000 UTC m=+34.230806978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:37.631774 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:37.631734 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:37.631953 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:37.631734 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:37.631953 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.631878 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:37.632067 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.631949 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:37.632067 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:37.631734 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:37.632168 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:37.632088 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:39.632710 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:39.632667 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:39.633214 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:39.632799 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:39.633214 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:39.632826 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:39.633214 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:39.632933 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:39.633214 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:39.632968 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:39.633214 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:39.633085 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:41.633283 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.632058 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:41.633283 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.632073 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:41.633283 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.632104 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:41.633283 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:41.632471 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:41.633283 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:41.632590 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:41.633283 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:41.632690 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:41.644022 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.643984 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:38:41.747819 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.747787 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" event={"ID":"de89c567-7cc9-4707-830f-922d4c404be4","Type":"ContainerStarted","Data":"8936c0bfa1a3b708ea8bcfe0c5ba55c570df2b3ced809eea4d21a36374417218"} Jun 12 18:38:41.749001 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.748971 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-42n7k" event={"ID":"50b2aecc-cc91-4152-b9ae-372efaa2dfd8","Type":"ContainerStarted","Data":"5d32e66175953eb614ac454578dd64580cb7d72e3b2d7ee8e62632a6549f2ec9"} Jun 12 18:38:41.751022 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.751003 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"9fe492e9d025ee8909f5233d0f20c00464d3432c806a0d0b4c83ef2b4b52ba74"} Jun 12 18:38:41.751106 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.751057 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"22cd1d6f46d2a8f0058dedd6873b980138d55473b5429771adc639753d6c2ebc"} Jun 12 18:38:41.751106 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.751085 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"22d92d32d0b5f64346b9c284328bd527ebaa2a8f87dd8cc1415e35eff23f8e52"} Jun 12 18:38:41.751173 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.751112 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"1727251dd28b2261c2f6a23b5ac4059e311dc0e31a64b396719db841bae4655c"} Jun 12 18:38:41.768445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:41.768407 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-42n7k" podStartSLOduration=3.998060041 podStartE2EDuration="22.768392744s" totalImagesPullingTime="18.770332703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:41.76801224 +0000 UTC m=+22.585325469" watchObservedRunningTime="2026-06-12 18:38:41.768392744 +0000 UTC m=+22.585705974" Jun 12 18:38:42.642635 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:42.642555 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:38:41.644001836Z","UUID":"02d059f0-c3be-4bc7-b55b-967a429da8d4","Handler":null,"Name":"","Endpoint":""} Jun 12 18:38:42.644063 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:42.644044 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:38:42.644174 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:42.644083 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:38:42.756636 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:42.756585 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"2f1f1f32b61bd6e0f39e782a4fb392193fcbd66582de3be6a528b070b98466f5"} Jun 12 18:38:42.756803 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:42.756689 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"fd44a83adbeff885848d02dd0ddc5af799b05d27b9a9a24a4c2f6eec2473350f"} Jun 12 18:38:43.632336 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:43.632303 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:43.632516 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:43.632415 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:43.632516 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:43.632433 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:43.632686 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:43.632576 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:43.632686 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:43.632633 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:43.632828 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:43.632711 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:43.762620 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:43.762578 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" event={"ID":"de89c567-7cc9-4707-830f-922d4c404be4","Type":"ContainerStarted","Data":"2510856849b7895658f8037da4412bb9ec4c3929d5d70cb7888d05d3c01187ae"} Jun 12 18:38:43.781765 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:43.781719 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6q9mb" podStartSLOduration=4.755717636 podStartE2EDuration="24.781705323s" totalImagesPullingTime="20.025987687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:43.781385184 +0000 UTC m=+24.598698414" watchObservedRunningTime="2026-06-12 18:38:43.781705323 +0000 UTC m=+24.599018552" Jun 12 18:38:45.632044 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:45.631990 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:45.632423 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:45.632120 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:45.632423 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:45.631990 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:45.632423 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:45.632198 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:45.632423 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:45.632020 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:45.632423 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:45.632338 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:45.769890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:45.769817 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"ce572bdeb25abe23a34e8dc356993ccd6939181ecd6d062d5bcb28921f108e72"} Jun 12 18:38:45.771387 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:45.771365 2571 generic.go:356] "Generic (PLEG): container finished" podID="22a420ce-3b09-41eb-81b1-31ee62bb7c1d" containerID="92c41f9f0e3c12cf284b4d85327e9e790b0653c7f3533e3fbed604eeabdd4553" exitCode=0 Jun 12 18:38:45.771479 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:45.771397 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerDied","Data":"92c41f9f0e3c12cf284b4d85327e9e790b0653c7f3533e3fbed604eeabdd4553"} Jun 12 18:38:46.775328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:46.775244 2571 generic.go:356] "Generic (PLEG): container finished" podID="22a420ce-3b09-41eb-81b1-31ee62bb7c1d" containerID="b7576d37821d01211581c46647c88ea1b6cf6f775d5fb7d86238cbbf85338b2f" exitCode=0 Jun 12 18:38:46.775328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:46.775314 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerDied","Data":"b7576d37821d01211581c46647c88ea1b6cf6f775d5fb7d86238cbbf85338b2f"} Jun 12 18:38:47.631578 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.631550 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:47.631737 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.631573 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:47.631737 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.631575 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:47.631737 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:47.631674 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:47.631916 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:47.631784 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:47.631972 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:47.631908 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:47.781849 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.781563 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" event={"ID":"a58fa68c-b09e-4bf4-b7b5-222ebca33eb3","Type":"ContainerStarted","Data":"eccdf848fe65591f6b337b9af64f12880eda868fae15a7d442d1ae6c9cc4b3b4"} Jun 12 18:38:47.782389 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.781881 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:47.782389 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.781935 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:47.782389 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.781976 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:47.784405 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.784371 2571 generic.go:356] "Generic (PLEG): container finished" podID="22a420ce-3b09-41eb-81b1-31ee62bb7c1d" containerID="de64bdae89eedd3a150aa1d8bab9abfa219a8647d3f36e6b579e033f0a96799c" exitCode=0 Jun 12 18:38:47.784519 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.784420 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerDied","Data":"de64bdae89eedd3a150aa1d8bab9abfa219a8647d3f36e6b579e033f0a96799c"} Jun 12 18:38:47.798493 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.798465 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:47.798651 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.798638 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:38:47.815612 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:47.815558 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" podStartSLOduration=10.050345038 podStartE2EDuration="28.815543416s" totalImagesPullingTime="18.765198378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:47.815103179 +0000 UTC m=+28.632416408" watchObservedRunningTime="2026-06-12 18:38:47.815543416 +0000 UTC m=+28.632856644" Jun 12 18:38:49.580514 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:49.580479 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bkzdl"] Jun 12 18:38:49.581026 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:49.580667 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:49.581026 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:49.580805 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:49.583727 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:49.583682 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28pfq"] Jun 12 18:38:49.583895 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:49.583830 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:49.583969 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:49.583940 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:49.584519 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:49.584490 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4d76"] Jun 12 18:38:49.584623 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:49.584598 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:49.584740 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:49.584716 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:50.619832 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:50.619796 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:50.620336 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:50.619963 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 18:38:50.620436 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:50.620419 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rj6jz" Jun 12 18:38:51.631739 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:51.631701 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:51.632210 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:51.631701 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:51.632210 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:51.631706 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:51.632210 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:51.631856 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:51.632210 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:51.632004 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:51.632210 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:51.632102 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:53.433462 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.433288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.433478 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.433498 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433431 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433593 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433610 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:39:25.433587192 +0000 UTC m=+66.250900416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433629 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433642 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret podName:ba4a2530-a5e7-4530-b7e8-a07b6c401ba8 nodeName:}" failed. No retries permitted until 2026-06-12 18:39:25.433625514 +0000 UTC m=+66.250938733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret") pod "global-pull-secret-syncer-w4d76" (UID: "ba4a2530-a5e7-4530-b7e8-a07b6c401ba8") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433646 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433659 2571 projected.go:196] Error preparing data for projected volume kube-api-access-8n8wg for pod openshift-network-diagnostics/network-check-target-bkzdl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:53.433979 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.433692 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg podName:cc675826-39cf-4198-9f37-fe06588f574d nodeName:}" failed. No retries permitted until 2026-06-12 18:39:25.433683673 +0000 UTC m=+66.250996880 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8n8wg" (UniqueName: "kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg") pod "network-check-target-bkzdl" (UID: "cc675826-39cf-4198-9f37-fe06588f574d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:38:53.631987 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.631903 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:53.632136 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.632002 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:53.632136 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.632005 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w4d76" podUID="ba4a2530-a5e7-4530-b7e8-a07b6c401ba8" Jun 12 18:38:53.632136 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.632029 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:53.632136 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.632093 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:38:53.632377 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:53.632148 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bkzdl" podUID="cc675826-39cf-4198-9f37-fe06588f574d" Jun 12 18:38:53.801329 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.801299 2571 generic.go:356] "Generic (PLEG): container finished" podID="22a420ce-3b09-41eb-81b1-31ee62bb7c1d" containerID="b5b7517067f4fbd7e635622aabd85d029364bd8ec2378e8557841b5cfc95925b" exitCode=0 Jun 12 18:38:53.801487 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:53.801348 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerDied","Data":"b5b7517067f4fbd7e635622aabd85d029364bd8ec2378e8557841b5cfc95925b"} Jun 12 18:38:54.017233 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.017203 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-181.ec2.internal" event="NodeReady" Jun 12 18:38:54.017376 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.017356 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:38:54.064772 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.064714 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f8hr6"] Jun 12 18:38:54.078965 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.078938 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n862q"] Jun 12 18:38:54.079113 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.079070 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.082075 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.082057 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:38:54.082075 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.082072 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:38:54.082905 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.082891 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwzlp\"" Jun 12 18:38:54.097187 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.097162 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8hr6"] Jun 12 18:38:54.097315 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.097205 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n862q"] Jun 12 18:38:54.097315 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.097267 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.104854 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.104829 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:38:54.105069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.105053 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bw8dq\"" Jun 12 18:38:54.105164 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.105088 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:38:54.110906 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.110886 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:38:54.240317 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.240286 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.240462 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.240348 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wklsj\" (UniqueName: \"kubernetes.io/projected/253a8844-6bd5-4235-ace2-438275e231ea-kube-api-access-wklsj\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.240462 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.240420 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/253a8844-6bd5-4235-ace2-438275e231ea-tmp-dir\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.240462 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.240455 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a744247-be6a-4fb4-8fb1-243bc547f48b-cert\") pod \"ingress-canary-n862q\" (UID: \"0a744247-be6a-4fb4-8fb1-243bc547f48b\") " pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.240691 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.240537 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s2vz\" (UniqueName: \"kubernetes.io/projected/0a744247-be6a-4fb4-8fb1-243bc547f48b-kube-api-access-7s2vz\") pod \"ingress-canary-n862q\" (UID: \"0a744247-be6a-4fb4-8fb1-243bc547f48b\") " pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.240691 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.240592 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/253a8844-6bd5-4235-ace2-438275e231ea-config-volume\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.341636 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.341599 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s2vz\" (UniqueName: \"kubernetes.io/projected/0a744247-be6a-4fb4-8fb1-243bc547f48b-kube-api-access-7s2vz\") pod \"ingress-canary-n862q\" (UID: \"0a744247-be6a-4fb4-8fb1-243bc547f48b\") " pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.341825 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.341650 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/253a8844-6bd5-4235-ace2-438275e231ea-config-volume\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.341825 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.341744 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.341825 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.341801 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wklsj\" (UniqueName: \"kubernetes.io/projected/253a8844-6bd5-4235-ace2-438275e231ea-kube-api-access-wklsj\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.341968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.341830 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/253a8844-6bd5-4235-ace2-438275e231ea-tmp-dir\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.341968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.341851 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a744247-be6a-4fb4-8fb1-243bc547f48b-cert\") pod \"ingress-canary-n862q\" (UID: \"0a744247-be6a-4fb4-8fb1-243bc547f48b\") " pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.341968 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:54.341917 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:38:54.342131 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:54.341992 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:38:54.841973244 +0000 UTC m=+35.659286457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:38:54.342204 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.342181 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/253a8844-6bd5-4235-ace2-438275e231ea-tmp-dir\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.342431 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.342408 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/253a8844-6bd5-4235-ace2-438275e231ea-config-volume\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.345988 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.345966 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a744247-be6a-4fb4-8fb1-243bc547f48b-cert\") pod \"ingress-canary-n862q\" (UID: \"0a744247-be6a-4fb4-8fb1-243bc547f48b\") " pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.352861 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.352839 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s2vz\" (UniqueName: \"kubernetes.io/projected/0a744247-be6a-4fb4-8fb1-243bc547f48b-kube-api-access-7s2vz\") pod \"ingress-canary-n862q\" (UID: \"0a744247-be6a-4fb4-8fb1-243bc547f48b\") " pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.352956 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.352927 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wklsj\" (UniqueName: \"kubernetes.io/projected/253a8844-6bd5-4235-ace2-438275e231ea-kube-api-access-wklsj\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.409160 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.409118 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n862q" Jun 12 18:38:54.618607 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.618425 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n862q"] Jun 12 18:38:54.622263 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:38:54.622240 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a744247_be6a_4fb4_8fb1_243bc547f48b.slice/crio-f65a6fdbec152f6cfd7a00168182034cc265e21eb3f9dc25d37aeedd8235de11 WatchSource:0}: Error finding container f65a6fdbec152f6cfd7a00168182034cc265e21eb3f9dc25d37aeedd8235de11: Status 404 returned error can't find the container with id f65a6fdbec152f6cfd7a00168182034cc265e21eb3f9dc25d37aeedd8235de11 Jun 12 18:38:54.806614 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.806508 2571 generic.go:356] "Generic (PLEG): container finished" podID="22a420ce-3b09-41eb-81b1-31ee62bb7c1d" containerID="9fba42a9f35ceff7825d316df9bf87e60b3397f57b234d006839daab55e292f5" exitCode=0 Jun 12 18:38:54.806614 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.806580 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerDied","Data":"9fba42a9f35ceff7825d316df9bf87e60b3397f57b234d006839daab55e292f5"} Jun 12 18:38:54.807638 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.807619 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n862q" event={"ID":"0a744247-be6a-4fb4-8fb1-243bc547f48b","Type":"ContainerStarted","Data":"f65a6fdbec152f6cfd7a00168182034cc265e21eb3f9dc25d37aeedd8235de11"} Jun 12 18:38:54.845617 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:54.845588 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:54.845800 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:54.845766 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:38:54.845923 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:54.845850 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:38:55.845828804 +0000 UTC m=+36.663142028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:38:55.631603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.631569 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:38:55.632076 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.631569 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:38:55.632076 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.631701 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:38:55.635362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.635204 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lhhs9\"" Jun 12 18:38:55.635362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.635219 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:38:55.635362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.635246 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5xp2\"" Jun 12 18:38:55.635362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.635246 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:38:55.635362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.635292 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:38:55.635362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.635245 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:38:55.813456 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.813421 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" event={"ID":"22a420ce-3b09-41eb-81b1-31ee62bb7c1d","Type":"ContainerStarted","Data":"66bb1037acc2580d27018a8b59aae84ded18731f8f4c2ac4b195d6841856484e"} Jun 12 18:38:55.836028 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.835986 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bkz5q" podStartSLOduration=11.057523959 podStartE2EDuration="36.835971419s" totalImagesPullingTime="25.77844746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:55.835114833 +0000 UTC m=+36.652428062" watchObservedRunningTime="2026-06-12 18:38:55.835971419 +0000 UTC m=+36.653284648" Jun 12 18:38:55.853129 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:55.853066 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:55.853254 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:55.853230 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:38:55.853319 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:55.853306 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:38:57.853286791 +0000 UTC m=+38.670600002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:38:57.818774 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:57.818721 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n862q" event={"ID":"0a744247-be6a-4fb4-8fb1-243bc547f48b","Type":"ContainerStarted","Data":"2549bcb4f755b5ec30304ebadf25158b5fae8df05b57314e6367085b35846aa5"} Jun 12 18:38:57.837320 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:57.837274 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n862q" podStartSLOduration=1.468026848 podStartE2EDuration="3.837259776s" totalImagesPullingTime="2.369232928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:38:57.836397542 +0000 UTC m=+38.653710770" watchObservedRunningTime="2026-06-12 18:38:57.837259776 +0000 UTC m=+38.654573005" Jun 12 18:38:57.866368 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:38:57.866339 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:38:57.866525 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:57.866487 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:38:57.866587 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:38:57.866554 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:39:01.866534849 +0000 UTC m=+42.683848077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:39:01.894476 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:01.894432 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:39:01.894936 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:01.894580 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:39:01.894936 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:01.894652 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:39:09.894635503 +0000 UTC m=+50.711948710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:39:09.655358 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.655323 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb"] Jun 12 18:39:09.679225 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.679189 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb"] Jun 12 18:39:09.679384 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.679308 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.682562 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.682541 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 12 18:39:09.682562 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.682548 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 12 18:39:09.682741 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.682606 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:39:09.682741 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.682606 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:39:09.682741 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.682651 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:39:09.683194 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.683178 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 12 18:39:09.683194 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.683191 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 12 18:39:09.742421 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.742386 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42l8l\" (UniqueName: \"kubernetes.io/projected/cf806d77-b487-4082-aa8d-3d6dcf27fac7-kube-api-access-42l8l\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.742581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.742443 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.742581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.742483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-ca\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.742581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.742526 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-hub\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.742581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.742554 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.742581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.742577 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf806d77-b487-4082-aa8d-3d6dcf27fac7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.843310 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.843277 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.843310 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.843313 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-ca\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.843566 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.843354 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-hub\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.843566 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.843476 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.843566 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.843522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf806d77-b487-4082-aa8d-3d6dcf27fac7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.843712 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.843580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42l8l\" (UniqueName: \"kubernetes.io/projected/cf806d77-b487-4082-aa8d-3d6dcf27fac7-kube-api-access-42l8l\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.844443 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.844414 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf806d77-b487-4082-aa8d-3d6dcf27fac7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.847494 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.847464 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-ca\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.847608 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.847564 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.847608 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.847566 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.847771 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.847729 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf806d77-b487-4082-aa8d-3d6dcf27fac7-hub\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.857551 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.857529 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42l8l\" (UniqueName: \"kubernetes.io/projected/cf806d77-b487-4082-aa8d-3d6dcf27fac7-kube-api-access-42l8l\") pod \"cluster-proxy-proxy-agent-d8d647ddc-cw6zb\" (UID: \"cf806d77-b487-4082-aa8d-3d6dcf27fac7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:09.944168 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.944067 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:39:09.944322 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:09.944218 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:39:09.944322 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:09.944283 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:39:25.944266794 +0000 UTC m=+66.761580001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:39:09.999551 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:09.999517 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:39:10.162509 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:10.162479 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb"] Jun 12 18:39:10.165696 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:39:10.165673 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf806d77_b487_4082_aa8d_3d6dcf27fac7.slice/crio-91d75e2c08d56403e254ed43c98c71923903bcf75463c2ad77d2f2610f2f29be WatchSource:0}: Error finding container 91d75e2c08d56403e254ed43c98c71923903bcf75463c2ad77d2f2610f2f29be: Status 404 returned error can't find the container with id 91d75e2c08d56403e254ed43c98c71923903bcf75463c2ad77d2f2610f2f29be Jun 12 18:39:10.849420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:10.849376 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" event={"ID":"cf806d77-b487-4082-aa8d-3d6dcf27fac7","Type":"ContainerStarted","Data":"91d75e2c08d56403e254ed43c98c71923903bcf75463c2ad77d2f2610f2f29be"} Jun 12 18:39:14.861487 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:14.861450 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" event={"ID":"cf806d77-b487-4082-aa8d-3d6dcf27fac7","Type":"ContainerStarted","Data":"36288dc4f082ad67e42bb4729e38294738a15f9f47553ff02af57c6d8eb98852"} Jun 12 18:39:14.861963 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:14.861499 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" event={"ID":"cf806d77-b487-4082-aa8d-3d6dcf27fac7","Type":"ContainerStarted","Data":"a7318bade77056527e2b7709d1c0f47c4b159a52710230183b5eb9c1866e985f"} Jun 12 18:39:14.861963 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:14.861519 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" event={"ID":"cf806d77-b487-4082-aa8d-3d6dcf27fac7","Type":"ContainerStarted","Data":"160923d843c72e5b2f505e4a632f1172614312164fced4d27c75633de30a392c"} Jun 12 18:39:14.910357 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:14.910300 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" podStartSLOduration=2.250285747 podStartE2EDuration="5.910284834s" totalImagesPullingTime="3.659999087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:14.897452402 +0000 UTC m=+55.714765631" watchObservedRunningTime="2026-06-12 18:39:14.910284834 +0000 UTC m=+55.727598100" Jun 12 18:39:19.800485 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:19.800457 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55rhx" Jun 12 18:39:25.452713 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.452668 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:39:25.453175 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.452726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:39:25.453175 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.452767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:39:25.457093 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.457073 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:39:25.458345 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.458333 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:39:25.458639 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.458626 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:39:25.463103 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:25.463085 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:39:25.463189 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:25.463159 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:40:29.463138779 +0000 UTC m=+130.280452007 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : secret "metrics-daemon-secret" not found Jun 12 18:39:25.465178 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.465158 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba4a2530-a5e7-4530-b7e8-a07b6c401ba8-original-pull-secret\") pod \"global-pull-secret-syncer-w4d76\" (UID: \"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8\") " pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:39:25.467362 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.467347 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:39:25.475302 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.475283 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n8wg\" (UniqueName: \"kubernetes.io/projected/cc675826-39cf-4198-9f37-fe06588f574d-kube-api-access-8n8wg\") pod \"network-check-target-bkzdl\" (UID: \"cc675826-39cf-4198-9f37-fe06588f574d\") " pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:39:25.648336 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.648303 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w4d76" Jun 12 18:39:25.656224 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.656190 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5xp2\"" Jun 12 18:39:25.663794 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.663774 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:39:25.825091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.825061 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w4d76"] Jun 12 18:39:25.829130 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:39:25.829099 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4a2530_a5e7_4530_b7e8_a07b6c401ba8.slice/crio-e032b072950cf3b6e9bff7c75967e96813cb8f79b7bcb3ec0012242017041243 WatchSource:0}: Error finding container e032b072950cf3b6e9bff7c75967e96813cb8f79b7bcb3ec0012242017041243: Status 404 returned error can't find the container with id e032b072950cf3b6e9bff7c75967e96813cb8f79b7bcb3ec0012242017041243 Jun 12 18:39:25.843614 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.843592 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bkzdl"] Jun 12 18:39:25.849446 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:39:25.849418 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc675826_39cf_4198_9f37_fe06588f574d.slice/crio-90b81e79b79df2a1be8649c043eee3bc1306f9c0b3329c4ac17e75a34e8a2b46 WatchSource:0}: Error finding container 90b81e79b79df2a1be8649c043eee3bc1306f9c0b3329c4ac17e75a34e8a2b46: Status 404 returned error can't find the container with id 90b81e79b79df2a1be8649c043eee3bc1306f9c0b3329c4ac17e75a34e8a2b46 Jun 12 18:39:25.889411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.889373 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4d76" event={"ID":"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8","Type":"ContainerStarted","Data":"e032b072950cf3b6e9bff7c75967e96813cb8f79b7bcb3ec0012242017041243"} Jun 12 18:39:25.890475 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.890451 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bkzdl" event={"ID":"cc675826-39cf-4198-9f37-fe06588f574d","Type":"ContainerStarted","Data":"90b81e79b79df2a1be8649c043eee3bc1306f9c0b3329c4ac17e75a34e8a2b46"} Jun 12 18:39:25.957097 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:25.957072 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:39:25.957240 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:25.957223 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:39:25.957298 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:25.957286 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:39:57.957269274 +0000 UTC m=+98.774582481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:39:30.906449 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:30.906349 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w4d76" event={"ID":"ba4a2530-a5e7-4530-b7e8-a07b6c401ba8","Type":"ContainerStarted","Data":"287162b1f309276d5de4be65f8b0a103a88e88f701d24beeddfcf502fa9fa3fb"} Jun 12 18:39:30.907935 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:30.907908 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bkzdl" event={"ID":"cc675826-39cf-4198-9f37-fe06588f574d","Type":"ContainerStarted","Data":"3a49c36e0fed058c875320d2011d257a3a9dc873da885bb1e9c00274b43235d4"} Jun 12 18:39:30.908063 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:30.908045 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:39:30.925804 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:30.925738 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w4d76" podStartSLOduration=67.133799 podStartE2EDuration="1m11.925722122s" totalImagesPullingTime="4.791923122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:30.925699676 +0000 UTC m=+71.743012907" watchObservedRunningTime="2026-06-12 18:39:30.925722122 +0000 UTC m=+71.743035350" Jun 12 18:39:30.945467 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:30.945423 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bkzdl" podStartSLOduration=67.177443029 podStartE2EDuration="1m11.945407321s" totalImagesPullingTime="4.767964292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:30.945301484 +0000 UTC m=+71.762614713" watchObservedRunningTime="2026-06-12 18:39:30.945407321 +0000 UTC m=+71.762720550" Jun 12 18:39:57.980787 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:39:57.980648 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:39:57.980787 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:57.980781 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:39:57.981214 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:39:57.980853 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:41:01.980835741 +0000 UTC m=+162.798148949 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:40:01.914104 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:40:01.914072 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bkzdl" Jun 12 18:40:29.487920 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:40:29.487868 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:40:29.488318 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:40:29.488009 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:40:29.488318 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:40:29.488075 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:31.488056784 +0000 UTC m=+252.305370000 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : secret "metrics-daemon-secret" not found Jun 12 18:40:57.087550 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:40:57.087505 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8hr6" podUID="253a8844-6bd5-4235-ace2-438275e231ea" Jun 12 18:40:57.153916 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:40:57.153890 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8hr6" Jun 12 18:40:58.642558 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:40:58.642508 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:41:02.013854 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:41:02.013813 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:41:02.014343 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:41:02.014010 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:41:02.014343 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:41:02.014093 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls podName:253a8844-6bd5-4235-ace2-438275e231ea nodeName:}" failed. No retries permitted until 2026-06-12 18:43:04.014071302 +0000 UTC m=+284.831384531 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls") pod "dns-default-f8hr6" (UID: "253a8844-6bd5-4235-ace2-438275e231ea") : secret "dns-default-metrics-tls" not found Jun 12 18:41:11.632182 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:41:11.632093 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:42:17.601791 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.601740 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-7mf2j"] Jun 12 18:42:17.603607 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.603590 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:17.606633 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.606612 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pw2vq\"" Jun 12 18:42:17.620301 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.620273 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 12 18:42:17.620513 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.620498 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 12 18:42:17.621287 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.621269 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-7mf2j"] Jun 12 18:42:17.736724 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.736682 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:17.736932 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.736779 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98fc618d-6053-4279-8be3-0147d2495949-nginx-conf\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:17.837704 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.837668 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:17.837896 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.837733 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98fc618d-6053-4279-8be3-0147d2495949-nginx-conf\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:17.837896 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:17.837832 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 18:42:17.837978 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:17.837909 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert podName:98fc618d-6053-4279-8be3-0147d2495949 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:18.337893817 +0000 UTC m=+239.155207024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7mf2j" (UID: "98fc618d-6053-4279-8be3-0147d2495949") : secret "networking-console-plugin-cert" not found Jun 12 18:42:17.838302 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:17.838284 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98fc618d-6053-4279-8be3-0147d2495949-nginx-conf\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:18.341347 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:18.341304 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:18.341525 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:18.341460 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 18:42:18.341525 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:18.341525 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert podName:98fc618d-6053-4279-8be3-0147d2495949 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:19.341510229 +0000 UTC m=+240.158823436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7mf2j" (UID: "98fc618d-6053-4279-8be3-0147d2495949") : secret "networking-console-plugin-cert" not found Jun 12 18:42:19.350046 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:19.349994 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:19.350449 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:19.350155 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 18:42:19.350449 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:19.350218 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert podName:98fc618d-6053-4279-8be3-0147d2495949 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:21.350203493 +0000 UTC m=+242.167516703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7mf2j" (UID: "98fc618d-6053-4279-8be3-0147d2495949") : secret "networking-console-plugin-cert" not found Jun 12 18:42:21.364223 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:21.364181 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:21.364712 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:21.364318 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 18:42:21.364712 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:21.364392 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert podName:98fc618d-6053-4279-8be3-0147d2495949 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:25.364370139 +0000 UTC m=+246.181683350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7mf2j" (UID: "98fc618d-6053-4279-8be3-0147d2495949") : secret "networking-console-plugin-cert" not found Jun 12 18:42:22.269845 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.269810 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh"] Jun 12 18:42:22.271741 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.271721 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" Jun 12 18:42:22.274292 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.274269 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gr49v\"" Jun 12 18:42:22.274979 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.274955 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 12 18:42:22.275075 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.274958 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 12 18:42:22.289960 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.289933 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh"] Jun 12 18:42:22.304378 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.304352 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8k42c"] Jun 12 18:42:22.306343 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.306328 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.312069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.311849 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:42:22.312069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.311854 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:42:22.314996 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.314976 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t6vkb\"" Jun 12 18:42:22.315592 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.315579 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:42:22.315634 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.315603 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:42:22.320592 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.320570 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k42c"] Jun 12 18:42:22.372796 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.372744 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5frm8\" (UniqueName: \"kubernetes.io/projected/d6c50cb1-ccd4-41e1-9be6-7205bb930206-kube-api-access-5frm8\") pod \"migrator-d4bcd4867-pgjqh\" (UID: \"d6c50cb1-ccd4-41e1-9be6-7205bb930206\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" Jun 12 18:42:22.474167 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.474134 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5frm8\" (UniqueName: \"kubernetes.io/projected/d6c50cb1-ccd4-41e1-9be6-7205bb930206-kube-api-access-5frm8\") pod \"migrator-d4bcd4867-pgjqh\" (UID: \"d6c50cb1-ccd4-41e1-9be6-7205bb930206\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" Jun 12 18:42:22.474364 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.474187 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3183726e-5b75-4631-8696-c551bd525152-data-volume\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.474364 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.474242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.474364 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.474267 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3183726e-5b75-4631-8696-c551bd525152-crio-socket\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.474364 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.474290 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhkhq\" (UniqueName: \"kubernetes.io/projected/3183726e-5b75-4631-8696-c551bd525152-kube-api-access-hhkhq\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.474522 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.474398 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.482208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.482179 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5frm8\" (UniqueName: \"kubernetes.io/projected/d6c50cb1-ccd4-41e1-9be6-7205bb930206-kube-api-access-5frm8\") pod \"migrator-d4bcd4867-pgjqh\" (UID: \"d6c50cb1-ccd4-41e1-9be6-7205bb930206\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" Jun 12 18:42:22.575622 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575525 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.575622 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575579 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3183726e-5b75-4631-8696-c551bd525152-data-volume\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.575880 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:22.575703 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:42:22.575880 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:22.575775 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:42:22.575880 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:22.575803 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:23.075781702 +0000 UTC m=+243.893094925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : secret "insights-runtime-extractor-tls" not found Jun 12 18:42:22.575880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.575880 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:22.575838 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:23.075825625 +0000 UTC m=+243.893138831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : configmap "kube-rbac-proxy" not found Jun 12 18:42:22.575880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575871 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3183726e-5b75-4631-8696-c551bd525152-crio-socket\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.576159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575887 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhkhq\" (UniqueName: \"kubernetes.io/projected/3183726e-5b75-4631-8696-c551bd525152-kube-api-access-hhkhq\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.576159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575909 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3183726e-5b75-4631-8696-c551bd525152-crio-socket\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.576159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.575872 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3183726e-5b75-4631-8696-c551bd525152-data-volume\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.580804 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.580789 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" Jun 12 18:42:22.585140 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.585120 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhkhq\" (UniqueName: \"kubernetes.io/projected/3183726e-5b75-4631-8696-c551bd525152-kube-api-access-hhkhq\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:22.702903 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:22.702872 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh"] Jun 12 18:42:22.706391 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:42:22.706362 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c50cb1_ccd4_41e1_9be6_7205bb930206.slice/crio-d64b09dc90a94b1ec19b3c3565649c14edb4668bcea5493026102e387342e703 WatchSource:0}: Error finding container d64b09dc90a94b1ec19b3c3565649c14edb4668bcea5493026102e387342e703: Status 404 returned error can't find the container with id d64b09dc90a94b1ec19b3c3565649c14edb4668bcea5493026102e387342e703 Jun 12 18:42:23.081315 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:23.081280 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:23.081563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:23.081335 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:23.081563 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:23.081427 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:42:23.081563 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:23.081466 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:42:23.081563 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:23.081507 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:24.081485928 +0000 UTC m=+244.898799135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : configmap "kube-rbac-proxy" not found Jun 12 18:42:23.081563 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:23.081526 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:24.081517619 +0000 UTC m=+244.898830826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : secret "insights-runtime-extractor-tls" not found Jun 12 18:42:23.389880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:23.389798 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" event={"ID":"d6c50cb1-ccd4-41e1-9be6-7205bb930206","Type":"ContainerStarted","Data":"d64b09dc90a94b1ec19b3c3565649c14edb4668bcea5493026102e387342e703"} Jun 12 18:42:24.089344 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:24.089305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:24.089543 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:24.089377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:24.089543 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:24.089439 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:42:24.089543 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:24.089482 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:42:24.089543 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:24.089491 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:26.08947659 +0000 UTC m=+246.906789796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : configmap "kube-rbac-proxy" not found Jun 12 18:42:24.089708 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:24.089559 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:26.089538652 +0000 UTC m=+246.906851860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : secret "insights-runtime-extractor-tls" not found Jun 12 18:42:24.394049 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:24.394020 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" event={"ID":"d6c50cb1-ccd4-41e1-9be6-7205bb930206","Type":"ContainerStarted","Data":"3e86b8d34a6461c8341ba72926bca5baac9fc76db6dc3e65e5f9387847bcc563"} Jun 12 18:42:24.394469 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:24.394074 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" event={"ID":"d6c50cb1-ccd4-41e1-9be6-7205bb930206","Type":"ContainerStarted","Data":"95abf1d79cde19ba3c80c3ccefdbd7388384a71d7354b0075699ce52fb24535c"} Jun 12 18:42:24.409422 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:24.409366 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-pgjqh" podStartSLOduration=1.260390825 podStartE2EDuration="2.409349327s" totalImagesPullingTime="1.148958502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:24.409247064 +0000 UTC m=+245.226560294" watchObservedRunningTime="2026-06-12 18:42:24.409349327 +0000 UTC m=+245.226662559" Jun 12 18:42:24.466172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:24.466147 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xw5bq_0ea0e87f-8b1f-4a0b-b20f-796703eed425/dns-node-resolver/0.log" Jun 12 18:42:25.065621 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:25.065597 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7j7x2_4b0b1c8c-5cd1-457b-8fa3-a85616991fbe/node-ca/0.log" Jun 12 18:42:25.399002 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:25.398923 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:25.399341 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:25.399062 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 18:42:25.399341 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:25.399115 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert podName:98fc618d-6053-4279-8be3-0147d2495949 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:33.399099317 +0000 UTC m=+254.216412525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7mf2j" (UID: "98fc618d-6053-4279-8be3-0147d2495949") : secret "networking-console-plugin-cert" not found Jun 12 18:42:26.104002 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:26.103966 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:26.104186 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:26.104021 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:26.104186 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:26.104094 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:42:26.104186 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:26.104143 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:42:26.104186 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:26.104161 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:30.104143676 +0000 UTC m=+250.921456888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : configmap "kube-rbac-proxy" not found Jun 12 18:42:26.104186 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:26.104188 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:30.104175998 +0000 UTC m=+250.921489206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : secret "insights-runtime-extractor-tls" not found Jun 12 18:42:26.268623 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:26.268595 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n862q_0a744247-be6a-4fb4-8fb1-243bc547f48b/serve-healthcheck-canary/0.log" Jun 12 18:42:30.133984 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:30.133937 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:30.134469 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:30.134002 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:30.134469 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:30.134080 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:42:30.134469 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:30.134100 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:42:30.134469 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:30.134147 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:38.134135251 +0000 UTC m=+258.951448458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : secret "insights-runtime-extractor-tls" not found Jun 12 18:42:30.134469 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:30.134159 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm podName:3183726e-5b75-4631-8696-c551bd525152 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:38.134153943 +0000 UTC m=+258.951467150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8k42c" (UID: "3183726e-5b75-4631-8696-c551bd525152") : configmap "kube-rbac-proxy" not found Jun 12 18:42:31.545918 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:31.545878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:42:31.546377 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:31.546050 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:42:31.546377 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:31.546127 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs podName:eee93665-037c-49c4-b1e3-b7d46a5a2df9 nodeName:}" failed. No retries permitted until 2026-06-12 18:44:33.546108006 +0000 UTC m=+374.363421226 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs") pod "network-metrics-daemon-28pfq" (UID: "eee93665-037c-49c4-b1e3-b7d46a5a2df9") : secret "metrics-daemon-secret" not found Jun 12 18:42:33.461610 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:33.461573 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:33.462020 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:33.461741 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 12 18:42:33.462020 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:33.461859 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert podName:98fc618d-6053-4279-8be3-0147d2495949 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:49.461841115 +0000 UTC m=+270.279154321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-7mf2j" (UID: "98fc618d-6053-4279-8be3-0147d2495949") : secret "networking-console-plugin-cert" not found Jun 12 18:42:38.195159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.195066 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:38.195578 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.195192 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:38.195853 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.195831 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3183726e-5b75-4631-8696-c551bd525152-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:38.197431 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.197411 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3183726e-5b75-4631-8696-c551bd525152-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k42c\" (UID: \"3183726e-5b75-4631-8696-c551bd525152\") " pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:38.214414 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.214384 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k42c" Jun 12 18:42:38.342512 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.342481 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k42c"] Jun 12 18:42:38.345556 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:42:38.345528 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3183726e_5b75_4631_8696_c551bd525152.slice/crio-7ed6a3952c99095c01de9176e7371730756ea2a4b8ae71caa69691cc3a3c8c4f WatchSource:0}: Error finding container 7ed6a3952c99095c01de9176e7371730756ea2a4b8ae71caa69691cc3a3c8c4f: Status 404 returned error can't find the container with id 7ed6a3952c99095c01de9176e7371730756ea2a4b8ae71caa69691cc3a3c8c4f Jun 12 18:42:38.434198 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:38.434158 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k42c" event={"ID":"3183726e-5b75-4631-8696-c551bd525152","Type":"ContainerStarted","Data":"7ed6a3952c99095c01de9176e7371730756ea2a4b8ae71caa69691cc3a3c8c4f"} Jun 12 18:42:42.448092 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:42.448056 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k42c" event={"ID":"3183726e-5b75-4631-8696-c551bd525152","Type":"ContainerStarted","Data":"577cbf412dd74a3743c35c674f3b4a71a1263b64f66ee9c5460db73d9a06335c"} Jun 12 18:42:42.448466 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:42.448117 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k42c" event={"ID":"3183726e-5b75-4631-8696-c551bd525152","Type":"ContainerStarted","Data":"ee82b56fd39ce5db21126f337e70fec71c7e3f189718fd6f9e542087d3ebb3bb"} Jun 12 18:42:44.456042 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:44.455948 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k42c" event={"ID":"3183726e-5b75-4631-8696-c551bd525152","Type":"ContainerStarted","Data":"293c80a947b9fbbd2e5c15fe0560e9073997c54b571285a7803b73b0b85cccde"} Jun 12 18:42:44.475169 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:44.475122 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8k42c" podStartSLOduration=16.894251492 podStartE2EDuration="22.475102422s" totalImagesPullingTime="5.58085093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:42:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:44.474294262 +0000 UTC m=+265.291607491" watchObservedRunningTime="2026-06-12 18:42:44.475102422 +0000 UTC m=+265.292415652" Jun 12 18:42:49.439965 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.439926 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b8b995864-rh57z"] Jun 12 18:42:49.442974 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.442958 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.445519 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.445499 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 18:42:49.445693 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.445678 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ksm8k\"" Jun 12 18:42:49.445793 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.445741 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 18:42:49.448941 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.448921 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 18:42:49.453867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.453846 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 18:42:49.458394 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.458367 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8b995864-rh57z"] Jun 12 18:42:49.485738 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.485709 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e084b1fc-66ce-4eaa-a732-32fc515cb70e-trusted-ca\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.485898 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.485746 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-bound-sa-token\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.485898 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.485816 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:49.485979 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.485961 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e084b1fc-66ce-4eaa-a732-32fc515cb70e-registry-certificates\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.486023 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.485992 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e084b1fc-66ce-4eaa-a732-32fc515cb70e-installation-pull-secrets\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.486066 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.486033 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-registry-tls\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.486110 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.486060 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e084b1fc-66ce-4eaa-a732-32fc515cb70e-ca-trust-extracted\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.486110 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.486097 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npwbd\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-kube-api-access-npwbd\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.486202 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.486128 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e084b1fc-66ce-4eaa-a732-32fc515cb70e-image-registry-private-configuration\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.488204 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.488181 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98fc618d-6053-4279-8be3-0147d2495949-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-7mf2j\" (UID: \"98fc618d-6053-4279-8be3-0147d2495949\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:49.587170 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587114 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e084b1fc-66ce-4eaa-a732-32fc515cb70e-trusted-ca\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587170 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587175 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-bound-sa-token\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587458 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587222 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e084b1fc-66ce-4eaa-a732-32fc515cb70e-registry-certificates\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587458 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587241 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e084b1fc-66ce-4eaa-a732-32fc515cb70e-installation-pull-secrets\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587458 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587264 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-registry-tls\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587458 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587289 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e084b1fc-66ce-4eaa-a732-32fc515cb70e-ca-trust-extracted\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587458 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587317 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npwbd\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-kube-api-access-npwbd\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.587458 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.587347 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e084b1fc-66ce-4eaa-a732-32fc515cb70e-image-registry-private-configuration\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.588096 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.588071 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e084b1fc-66ce-4eaa-a732-32fc515cb70e-ca-trust-extracted\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.588415 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.588389 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e084b1fc-66ce-4eaa-a732-32fc515cb70e-trusted-ca\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.588481 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.588396 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e084b1fc-66ce-4eaa-a732-32fc515cb70e-registry-certificates\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.590069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.590040 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e084b1fc-66ce-4eaa-a732-32fc515cb70e-image-registry-private-configuration\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.590161 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.590098 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e084b1fc-66ce-4eaa-a732-32fc515cb70e-installation-pull-secrets\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.590161 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.590106 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-registry-tls\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.594916 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.594896 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npwbd\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-kube-api-access-npwbd\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.596508 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.596487 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e084b1fc-66ce-4eaa-a732-32fc515cb70e-bound-sa-token\") pod \"image-registry-6b8b995864-rh57z\" (UID: \"e084b1fc-66ce-4eaa-a732-32fc515cb70e\") " pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.717459 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.717381 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pw2vq\"" Jun 12 18:42:49.726368 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.726347 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" Jun 12 18:42:49.751768 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.751732 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:49.867868 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.867831 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-7mf2j"] Jun 12 18:42:49.871283 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:42:49.871258 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98fc618d_6053_4279_8be3_0147d2495949.slice/crio-3e33e33a76e4c26e1fc8b287289df2f9c9374ffaa4c52188764e51476c38fccf WatchSource:0}: Error finding container 3e33e33a76e4c26e1fc8b287289df2f9c9374ffaa4c52188764e51476c38fccf: Status 404 returned error can't find the container with id 3e33e33a76e4c26e1fc8b287289df2f9c9374ffaa4c52188764e51476c38fccf Jun 12 18:42:49.891056 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:49.891027 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8b995864-rh57z"] Jun 12 18:42:49.894357 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:42:49.894333 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode084b1fc_66ce_4eaa_a732_32fc515cb70e.slice/crio-2f7f3d340b1345608c04065522c11baf7dd1f9f325a86bf00c9e72d08d77bfcd WatchSource:0}: Error finding container 2f7f3d340b1345608c04065522c11baf7dd1f9f325a86bf00c9e72d08d77bfcd: Status 404 returned error can't find the container with id 2f7f3d340b1345608c04065522c11baf7dd1f9f325a86bf00c9e72d08d77bfcd Jun 12 18:42:50.001357 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:50.001315 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" podUID="cf806d77-b487-4082-aa8d-3d6dcf27fac7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:42:50.474827 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:50.474790 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" event={"ID":"98fc618d-6053-4279-8be3-0147d2495949","Type":"ContainerStarted","Data":"3e33e33a76e4c26e1fc8b287289df2f9c9374ffaa4c52188764e51476c38fccf"} Jun 12 18:42:50.476128 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:50.476103 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" event={"ID":"e084b1fc-66ce-4eaa-a732-32fc515cb70e","Type":"ContainerStarted","Data":"65e2250a591e1dcee7fbe9686b8e295e8148574c52729adc077ecb1efc69d322"} Jun 12 18:42:50.476216 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:50.476141 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" event={"ID":"e084b1fc-66ce-4eaa-a732-32fc515cb70e","Type":"ContainerStarted","Data":"2f7f3d340b1345608c04065522c11baf7dd1f9f325a86bf00c9e72d08d77bfcd"} Jun 12 18:42:50.476271 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:50.476242 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:42:50.498361 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:50.498318 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" podStartSLOduration=1.498301309 podStartE2EDuration="1.498301309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:50.496675797 +0000 UTC m=+271.313989026" watchObservedRunningTime="2026-06-12 18:42:50.498301309 +0000 UTC m=+271.315614538" Jun 12 18:42:51.483091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:51.483048 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" event={"ID":"98fc618d-6053-4279-8be3-0147d2495949","Type":"ContainerStarted","Data":"90e3c62eff98a62bfc0bebe291eedde9fa702e080280cdcaa693a38f84dfc87b"} Jun 12 18:42:51.499914 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:51.499858 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-7mf2j" podStartSLOduration=33.248424126 podStartE2EDuration="34.499840008s" totalImagesPullingTime="1.251415882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:51.498187535 +0000 UTC m=+272.315500773" watchObservedRunningTime="2026-06-12 18:42:51.499840008 +0000 UTC m=+272.317153263" Jun 12 18:42:56.305140 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.305106 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4"] Jun 12 18:42:56.309749 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.309732 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.312197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.312174 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 12 18:42:56.312197 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.312195 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 12 18:42:56.313146 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.313127 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:42:56.313429 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.313413 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hgnfs\"" Jun 12 18:42:56.313933 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.313917 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:42:56.314032 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.313989 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:42:56.320416 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.320390 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4"] Jun 12 18:42:56.439180 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.439123 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbzt\" (UniqueName: \"kubernetes.io/projected/9c369fd2-8d43-4240-bcb6-68e9122c3be8-kube-api-access-5rbzt\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.439180 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.439197 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.439439 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.439290 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.439439 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.439339 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c369fd2-8d43-4240-bcb6-68e9122c3be8-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.540141 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.540103 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.540342 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.540158 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c369fd2-8d43-4240-bcb6-68e9122c3be8-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.540342 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.540230 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbzt\" (UniqueName: \"kubernetes.io/projected/9c369fd2-8d43-4240-bcb6-68e9122c3be8-kube-api-access-5rbzt\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.540342 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.540271 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.540501 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:56.540382 2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 12 18:42:56.540501 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:42:56.540452 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-tls podName:9c369fd2-8d43-4240-bcb6-68e9122c3be8 nodeName:}" failed. No retries permitted until 2026-06-12 18:42:57.040432217 +0000 UTC m=+277.857745441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-5q9n4" (UID: "9c369fd2-8d43-4240-bcb6-68e9122c3be8") : secret "prometheus-operator-tls" not found Jun 12 18:42:56.541059 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.541038 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c369fd2-8d43-4240-bcb6-68e9122c3be8-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.542468 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.542450 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:56.550716 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:56.550696 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbzt\" (UniqueName: \"kubernetes.io/projected/9c369fd2-8d43-4240-bcb6-68e9122c3be8-kube-api-access-5rbzt\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:57.044184 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:57.044144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:57.046587 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:57.046568 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c369fd2-8d43-4240-bcb6-68e9122c3be8-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-5q9n4\" (UID: \"9c369fd2-8d43-4240-bcb6-68e9122c3be8\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:57.220961 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:57.220925 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" Jun 12 18:42:57.348365 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:57.348328 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4"] Jun 12 18:42:57.351087 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:42:57.351058 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c369fd2_8d43_4240_bcb6_68e9122c3be8.slice/crio-b5f369502c698907d6197d14a019b643b14a45b08326c0b6a7e1bca8d3202cf3 WatchSource:0}: Error finding container b5f369502c698907d6197d14a019b643b14a45b08326c0b6a7e1bca8d3202cf3: Status 404 returned error can't find the container with id b5f369502c698907d6197d14a019b643b14a45b08326c0b6a7e1bca8d3202cf3 Jun 12 18:42:57.501967 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:57.501932 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" event={"ID":"9c369fd2-8d43-4240-bcb6-68e9122c3be8","Type":"ContainerStarted","Data":"b5f369502c698907d6197d14a019b643b14a45b08326c0b6a7e1bca8d3202cf3"} Jun 12 18:42:59.510081 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:59.510046 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" event={"ID":"9c369fd2-8d43-4240-bcb6-68e9122c3be8","Type":"ContainerStarted","Data":"63c63c485058d23ea1c800534904d629a76c731e27132fb6e6110ee938e4097e"} Jun 12 18:42:59.510455 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:59.510102 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" event={"ID":"9c369fd2-8d43-4240-bcb6-68e9122c3be8","Type":"ContainerStarted","Data":"bd7e80316acfb103dc0f08beeaddfe9bd0a33bd8f7cc812c3fbecba49401a70b"} Jun 12 18:42:59.528143 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:42:59.528097 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-5q9n4" podStartSLOduration=2.293668208 podStartE2EDuration="3.528080991s" totalImagesPullingTime="1.234412783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:42:59.527638183 +0000 UTC m=+280.344951411" watchObservedRunningTime="2026-06-12 18:42:59.528080991 +0000 UTC m=+280.345394219" Jun 12 18:43:00.001244 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:00.001201 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" podUID="cf806d77-b487-4082-aa8d-3d6dcf27fac7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:43:00.155215 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:43:00.155178 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f8hr6" podUID="253a8844-6bd5-4235-ace2-438275e231ea" Jun 12 18:43:00.512958 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:00.512929 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8hr6" Jun 12 18:43:01.804803 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.804772 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m27cv"] Jun 12 18:43:01.808972 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.808955 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.812159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.812136 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:43:01.813011 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.812991 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:43:01.814867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.814762 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:43:01.824216 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.824192 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6h9q4\"" Jun 12 18:43:01.880829 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.880792 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acfce14f-5ef3-4645-871d-d951b2cd902c-metrics-client-ca\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.880829 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.880829 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-wtmp\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.880849 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-sys\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.880926 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-accelerators-collector-config\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.880958 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wv4x\" (UniqueName: \"kubernetes.io/projected/acfce14f-5ef3-4645-871d-d951b2cd902c-kube-api-access-2wv4x\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.880983 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-tls\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.881022 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-textfile\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.881039 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.881286 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.881055 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-root\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982030 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.981986 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-accelerators-collector-config\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982030 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982032 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wv4x\" (UniqueName: \"kubernetes.io/projected/acfce14f-5ef3-4645-871d-d951b2cd902c-kube-api-access-2wv4x\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982230 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982148 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-tls\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982230 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982202 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-textfile\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982230 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982225 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982342 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982247 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-root\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982342 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982307 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acfce14f-5ef3-4645-871d-d951b2cd902c-metrics-client-ca\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982438 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982379 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-root\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982438 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982419 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-wtmp\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982541 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982467 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-sys\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982541 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982510 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-textfile\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982642 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982544 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-sys\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982642 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982578 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-wtmp\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982739 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982694 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-accelerators-collector-config\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.982805 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.982794 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acfce14f-5ef3-4645-871d-d951b2cd902c-metrics-client-ca\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.984552 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.984531 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.984741 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.984721 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/acfce14f-5ef3-4645-871d-d951b2cd902c-node-exporter-tls\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:01.991867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:01.991844 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wv4x\" (UniqueName: \"kubernetes.io/projected/acfce14f-5ef3-4645-871d-d951b2cd902c-kube-api-access-2wv4x\") pod \"node-exporter-m27cv\" (UID: \"acfce14f-5ef3-4645-871d-d951b2cd902c\") " pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:02.117483 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:02.117392 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m27cv" Jun 12 18:43:02.130584 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:43:02.130559 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfce14f_5ef3_4645_871d_d951b2cd902c.slice/crio-bc7eeb79ee37cc0b6553de96852b7ef644d1eb773f89dc85d519c5b947e91279 WatchSource:0}: Error finding container bc7eeb79ee37cc0b6553de96852b7ef644d1eb773f89dc85d519c5b947e91279: Status 404 returned error can't find the container with id bc7eeb79ee37cc0b6553de96852b7ef644d1eb773f89dc85d519c5b947e91279 Jun 12 18:43:02.520413 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:02.520381 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m27cv" event={"ID":"acfce14f-5ef3-4645-871d-d951b2cd902c","Type":"ContainerStarted","Data":"bc7eeb79ee37cc0b6553de96852b7ef644d1eb773f89dc85d519c5b947e91279"} Jun 12 18:43:03.525320 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:03.525290 2571 generic.go:356] "Generic (PLEG): container finished" podID="acfce14f-5ef3-4645-871d-d951b2cd902c" containerID="ab5e8a7d3c8dbdc922c8e87793adfd9703e4a0ed9ccf59080140ffc0610d9fff" exitCode=0 Jun 12 18:43:03.525679 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:03.525377 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m27cv" event={"ID":"acfce14f-5ef3-4645-871d-d951b2cd902c","Type":"ContainerDied","Data":"ab5e8a7d3c8dbdc922c8e87793adfd9703e4a0ed9ccf59080140ffc0610d9fff"} Jun 12 18:43:04.097246 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.097191 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:43:04.099601 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.099567 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/253a8844-6bd5-4235-ace2-438275e231ea-metrics-tls\") pod \"dns-default-f8hr6\" (UID: \"253a8844-6bd5-4235-ace2-438275e231ea\") " pod="openshift-dns/dns-default-f8hr6" Jun 12 18:43:04.115765 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.115732 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xwzlp\"" Jun 12 18:43:04.123890 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.123872 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8hr6" Jun 12 18:43:04.262809 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.262776 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8hr6"] Jun 12 18:43:04.266683 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:43:04.266654 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253a8844_6bd5_4235_ace2_438275e231ea.slice/crio-bddc164216240ca91ad5a7ed93a624fc200c59768f534d9b62bc9b51985ddaee WatchSource:0}: Error finding container bddc164216240ca91ad5a7ed93a624fc200c59768f534d9b62bc9b51985ddaee: Status 404 returned error can't find the container with id bddc164216240ca91ad5a7ed93a624fc200c59768f534d9b62bc9b51985ddaee Jun 12 18:43:04.530659 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.530627 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m27cv" event={"ID":"acfce14f-5ef3-4645-871d-d951b2cd902c","Type":"ContainerStarted","Data":"a731220ba52e3ce9246b4bafde3e602418774803388a2333a3cd4c5a2b2901a1"} Jun 12 18:43:04.531137 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.530677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m27cv" event={"ID":"acfce14f-5ef3-4645-871d-d951b2cd902c","Type":"ContainerStarted","Data":"ba57440f2541279efb7d1c87fceead958f52d5fb55f358906202355fd9975599"} Jun 12 18:43:04.531697 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.531677 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8hr6" event={"ID":"253a8844-6bd5-4235-ace2-438275e231ea","Type":"ContainerStarted","Data":"bddc164216240ca91ad5a7ed93a624fc200c59768f534d9b62bc9b51985ddaee"} Jun 12 18:43:04.561783 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:04.558660 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m27cv" podStartSLOduration=2.492278328 podStartE2EDuration="3.558633653s" totalImagesPullingTime="1.00074309s" totalInitContainerRuntime="65.612235ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:04.556372555 +0000 UTC m=+285.373685783" watchObservedRunningTime="2026-06-12 18:43:04.558633653 +0000 UTC m=+285.375946883" Jun 12 18:43:06.541723 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:06.540348 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8hr6" event={"ID":"253a8844-6bd5-4235-ace2-438275e231ea","Type":"ContainerStarted","Data":"05e510ee1fcef145871225244d398d15e3afdf72fc94d40072d3e0858318f3e3"} Jun 12 18:43:06.541723 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:06.540412 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8hr6" event={"ID":"253a8844-6bd5-4235-ace2-438275e231ea","Type":"ContainerStarted","Data":"457dce634c2e6fb76e02da92e72af2e29a0bf7c8d27b5ff145c4dca02fabeb10"} Jun 12 18:43:06.541723 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:06.540562 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f8hr6" Jun 12 18:43:06.561809 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:06.561734 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f8hr6" podStartSLOduration=250.756123609 podStartE2EDuration="4m12.561712944s" totalImagesPullingTime="1.805589335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:06.560242939 +0000 UTC m=+287.377556168" watchObservedRunningTime="2026-06-12 18:43:06.561712944 +0000 UTC m=+287.379026174" Jun 12 18:43:08.141535 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.141496 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:43:08.144283 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.144253 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.153186 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.153164 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 18:43:08.153777 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.153744 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 18:43:08.153886 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.153798 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 18:43:08.153886 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.153830 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 18:43:08.170346 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.170321 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 18:43:08.170465 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.170438 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 18:43:08.170817 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.170803 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 18:43:08.173069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.172904 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 18:43:08.176003 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.175972 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 18:43:08.178196 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.178172 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 18:43:08.186641 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.186623 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p6gkb\"" Jun 12 18:43:08.186897 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.186882 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 18:43:08.187027 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.187002 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 18:43:08.187027 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.187014 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3n8267l68p6eo\"" Jun 12 18:43:08.187132 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.187042 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 18:43:08.187918 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.187905 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 18:43:08.196450 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.196431 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 18:43:08.200041 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.200021 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:43:08.234178 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234136 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-config\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234191 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234221 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234247 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234278 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234300 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234327 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br82d\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-kube-api-access-br82d\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234371 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234353 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234380 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234417 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234439 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234471 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234498 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234531 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234554 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234576 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234626 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234655 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.234715 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234681 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.235251 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.234721 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335284 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br82d\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-kube-api-access-br82d\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335485 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335485 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335311 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335485 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335332 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335485 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335351 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335695 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335554 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335695 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335596 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335695 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335695 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335643 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335695 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335668 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335714 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335747 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335826 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335863 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-config\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.335968 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335892 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.335954 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336000 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336032 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336056 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336290 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336441 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336493 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.336628 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.336623 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.337366 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.337339 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.337477 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.337453 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.338321 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.338294 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.338820 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.338727 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.338820 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.338799 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.339637 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.339586 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.339747 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.339725 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.339923 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.339901 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.340802 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.340775 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.341007 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.340966 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.341699 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.341679 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-config\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.341873 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.341853 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.341981 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.341961 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.342060 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.342045 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.342259 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.342240 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.348147 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.348112 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br82d\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-kube-api-access-br82d\") pod \"prometheus-k8s-0\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.456439 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.456354 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:08.623205 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:08.623169 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:43:08.626404 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:43:08.626376 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611412ef_476c_48d3_bbec_2a0913d383eb.slice/crio-f215722522478ff4a3c4f0b83abf832fdb6ac23a15089142ed8f9f8220108249 WatchSource:0}: Error finding container f215722522478ff4a3c4f0b83abf832fdb6ac23a15089142ed8f9f8220108249: Status 404 returned error can't find the container with id f215722522478ff4a3c4f0b83abf832fdb6ac23a15089142ed8f9f8220108249 Jun 12 18:43:09.557334 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:09.557297 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"f215722522478ff4a3c4f0b83abf832fdb6ac23a15089142ed8f9f8220108249"} Jun 12 18:43:10.000891 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.000856 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" podUID="cf806d77-b487-4082-aa8d-3d6dcf27fac7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:43:10.001042 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.000922 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" Jun 12 18:43:10.001410 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.001376 2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"36288dc4f082ad67e42bb4729e38294738a15f9f47553ff02af57c6d8eb98852"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 12 18:43:10.001525 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.001425 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" podUID="cf806d77-b487-4082-aa8d-3d6dcf27fac7" containerName="service-proxy" containerID="cri-o://36288dc4f082ad67e42bb4729e38294738a15f9f47553ff02af57c6d8eb98852" gracePeriod=30 Jun 12 18:43:10.562658 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.562624 2571 generic.go:356] "Generic (PLEG): container finished" podID="cf806d77-b487-4082-aa8d-3d6dcf27fac7" containerID="36288dc4f082ad67e42bb4729e38294738a15f9f47553ff02af57c6d8eb98852" exitCode=2 Jun 12 18:43:10.563074 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.562692 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" event={"ID":"cf806d77-b487-4082-aa8d-3d6dcf27fac7","Type":"ContainerDied","Data":"36288dc4f082ad67e42bb4729e38294738a15f9f47553ff02af57c6d8eb98852"} Jun 12 18:43:10.563074 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.562728 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d8d647ddc-cw6zb" event={"ID":"cf806d77-b487-4082-aa8d-3d6dcf27fac7","Type":"ContainerStarted","Data":"e24eef3842b2419dc1b00675f96051497a1c0a3fc61d312e26ceaac53164391f"} Jun 12 18:43:10.564221 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.564202 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="11116c92b44c8eba703e4644f126a7f678443befd17fbf23ac0a08c2251d2f61" exitCode=0 Jun 12 18:43:10.564300 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:10.564232 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"11116c92b44c8eba703e4644f126a7f678443befd17fbf23ac0a08c2251d2f61"} Jun 12 18:43:11.488398 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:11.488373 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b8b995864-rh57z" Jun 12 18:43:14.587611 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:14.587552 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"c34ec49a30514f9daa03debfdd6768fb63f9629533401da7da01f11f1a5a2576"} Jun 12 18:43:14.588031 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:14.587638 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"5cb643ec47dd7a7bd150db6c6bb97be2329813b7ed43c66e94cafd5584e0bcb6"} Jun 12 18:43:14.632728 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:43:14.632675 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-28pfq" podUID="eee93665-037c-49c4-b1e3-b7d46a5a2df9" Jun 12 18:43:16.545632 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:16.545557 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f8hr6" Jun 12 18:43:16.601333 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:16.601296 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"837534c42fd29af639c9da26a1dffde1572669448080d441ecd8c9af333616e3"} Jun 12 18:43:16.601502 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:16.601383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"2f77c0f986e8a451c352c2603327df18bf9ec47c197b659c158f6c41d16e89ed"} Jun 12 18:43:16.601502 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:16.601430 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"196552c027014fac5565d166277a2bcc3b540a95af2da0f55d6f7f9411fed79b"} Jun 12 18:43:16.601502 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:16.601471 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerStarted","Data":"5eaaed0cdade17c98a120b30ea1e01717a28522fdd6dca3a15b4fd9ca92cbf00"} Jun 12 18:43:18.456714 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:18.456674 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:43:19.595040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:19.595016 2571 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:43:29.633663 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:43:29.633617 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:44:08.456831 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:08.456711 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:44:08.476119 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:08.476092 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:44:08.506151 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:08.506089 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=54.041030233 podStartE2EDuration="1m0.50607075s" totalImagesPullingTime="6.447939996s" totalInitContainerRuntime="17.100521ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:43:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:43:16.653600469 +0000 UTC m=+297.470913701" watchObservedRunningTime="2026-06-12 18:44:08.50607075 +0000 UTC m=+349.323384009" Jun 12 18:44:08.792551 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:08.792524 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:44:26.604083 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604044 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:44:26.604581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604436 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="prometheus" containerID="cri-o://5cb643ec47dd7a7bd150db6c6bb97be2329813b7ed43c66e94cafd5584e0bcb6" gracePeriod=600 Jun 12 18:44:26.604581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604479 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://837534c42fd29af639c9da26a1dffde1572669448080d441ecd8c9af333616e3" gracePeriod=600 Jun 12 18:44:26.604581 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604539 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-web" containerID="cri-o://196552c027014fac5565d166277a2bcc3b540a95af2da0f55d6f7f9411fed79b" gracePeriod=600 Jun 12 18:44:26.604790 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604595 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="config-reloader" containerID="cri-o://c34ec49a30514f9daa03debfdd6768fb63f9629533401da7da01f11f1a5a2576" gracePeriod=600 Jun 12 18:44:26.604790 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604628 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="thanos-sidecar" containerID="cri-o://5eaaed0cdade17c98a120b30ea1e01717a28522fdd6dca3a15b4fd9ca92cbf00" gracePeriod=600 Jun 12 18:44:26.604790 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.604626 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy" containerID="cri-o://2f77c0f986e8a451c352c2603327df18bf9ec47c197b659c158f6c41d16e89ed" gracePeriod=600 Jun 12 18:44:26.840943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840910 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="837534c42fd29af639c9da26a1dffde1572669448080d441ecd8c9af333616e3" exitCode=0 Jun 12 18:44:26.840943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840935 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="2f77c0f986e8a451c352c2603327df18bf9ec47c197b659c158f6c41d16e89ed" exitCode=0 Jun 12 18:44:26.840943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840944 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="196552c027014fac5565d166277a2bcc3b540a95af2da0f55d6f7f9411fed79b" exitCode=0 Jun 12 18:44:26.840943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840949 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="5eaaed0cdade17c98a120b30ea1e01717a28522fdd6dca3a15b4fd9ca92cbf00" exitCode=0 Jun 12 18:44:26.840943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840955 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="c34ec49a30514f9daa03debfdd6768fb63f9629533401da7da01f11f1a5a2576" exitCode=0 Jun 12 18:44:26.840943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840960 2571 generic.go:356] "Generic (PLEG): container finished" podID="611412ef-476c-48d3-bbec-2a0913d383eb" containerID="5cb643ec47dd7a7bd150db6c6bb97be2329813b7ed43c66e94cafd5584e0bcb6" exitCode=0 Jun 12 18:44:26.841411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.840991 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"837534c42fd29af639c9da26a1dffde1572669448080d441ecd8c9af333616e3"} Jun 12 18:44:26.841411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.841061 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"2f77c0f986e8a451c352c2603327df18bf9ec47c197b659c158f6c41d16e89ed"} Jun 12 18:44:26.841411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.841094 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"196552c027014fac5565d166277a2bcc3b540a95af2da0f55d6f7f9411fed79b"} Jun 12 18:44:26.841411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.841144 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"5eaaed0cdade17c98a120b30ea1e01717a28522fdd6dca3a15b4fd9ca92cbf00"} Jun 12 18:44:26.841411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.841174 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"c34ec49a30514f9daa03debfdd6768fb63f9629533401da7da01f11f1a5a2576"} Jun 12 18:44:26.841411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.841200 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"5cb643ec47dd7a7bd150db6c6bb97be2329813b7ed43c66e94cafd5584e0bcb6"} Jun 12 18:44:26.863095 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.863032 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:44:26.912576 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912544 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-2\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.912768 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912610 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-trusted-ca-bundle\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.912768 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912638 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-tls\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.912768 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912657 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-metrics-client-ca\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912820 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br82d\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-kube-api-access-br82d\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912853 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-web-config\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912891 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-grpc-tls\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912920 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-config\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912945 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-kubelet-serving-ca-bundle\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.912976 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-thanos-prometheus-http-client-file\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913000 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-0\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913028 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-serving-certs-ca-bundle\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913050 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913062 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-metrics-client-certs\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913129 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-db\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913227 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-1\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.913303 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913288 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913319 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-kube-rbac-proxy\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913344 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-config-out\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913364 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913372 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-tls-assets\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913425 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"611412ef-476c-48d3-bbec-2a0913d383eb\" (UID: \"611412ef-476c-48d3-bbec-2a0913d383eb\") " Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913474 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913695 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913712 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-metrics-client-ca\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:26.914091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.913728 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:26.916421 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.916200 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.917132 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.916945 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:44:26.917585 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.917345 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.918563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.918085 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.918563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.918334 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-config" (OuterVolumeSpecName: "config") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.918563 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.918362 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:44:26.918775 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.918556 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-kube-api-access-br82d" (OuterVolumeSpecName: "kube-api-access-br82d") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "kube-api-access-br82d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:44:26.918775 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.918667 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.918775 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.918676 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.919140 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.919084 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:44:26.919221 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.919160 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.919688 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.919651 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.920858 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.920809 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.920956 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.920928 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.921301 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.921272 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:26.921703 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.921679 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-config-out" (OuterVolumeSpecName: "config-out") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:44:26.931230 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:26.931199 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-web-config" (OuterVolumeSpecName: "web-config") pod "611412ef-476c-48d3-bbec-2a0913d383eb" (UID: "611412ef-476c-48d3-bbec-2a0913d383eb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:44:27.014160 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014118 2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014160 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014151 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014160 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014164 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014160 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014174 2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-metrics-client-certs\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014183 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-db\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014194 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014207 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014217 2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-kube-rbac-proxy\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014227 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/611412ef-476c-48d3-bbec-2a0913d383eb-config-out\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014235 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-tls-assets\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014243 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014251 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014260 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br82d\" (UniqueName: \"kubernetes.io/projected/611412ef-476c-48d3-bbec-2a0913d383eb-kube-api-access-br82d\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014269 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-web-config\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014281 2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-secret-grpc-tls\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014292 2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/611412ef-476c-48d3-bbec-2a0913d383eb-config\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.014430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.014299 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/611412ef-476c-48d3-bbec-2a0913d383eb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:44:27.848120 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.848083 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"611412ef-476c-48d3-bbec-2a0913d383eb","Type":"ContainerDied","Data":"f215722522478ff4a3c4f0b83abf832fdb6ac23a15089142ed8f9f8220108249"} Jun 12 18:44:27.848553 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.848149 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:44:27.848553 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.848172 2571 scope.go:117] "RemoveContainer" containerID="837534c42fd29af639c9da26a1dffde1572669448080d441ecd8c9af333616e3" Jun 12 18:44:27.860406 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.860391 2571 scope.go:117] "RemoveContainer" containerID="2f77c0f986e8a451c352c2603327df18bf9ec47c197b659c158f6c41d16e89ed" Jun 12 18:44:27.867159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.867141 2571 scope.go:117] "RemoveContainer" containerID="196552c027014fac5565d166277a2bcc3b540a95af2da0f55d6f7f9411fed79b" Jun 12 18:44:27.870605 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.870553 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:44:27.873864 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.873848 2571 scope.go:117] "RemoveContainer" containerID="5eaaed0cdade17c98a120b30ea1e01717a28522fdd6dca3a15b4fd9ca92cbf00" Jun 12 18:44:27.875389 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.875371 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:44:27.880894 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.880876 2571 scope.go:117] "RemoveContainer" containerID="c34ec49a30514f9daa03debfdd6768fb63f9629533401da7da01f11f1a5a2576" Jun 12 18:44:27.887365 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.887348 2571 scope.go:117] "RemoveContainer" containerID="5cb643ec47dd7a7bd150db6c6bb97be2329813b7ed43c66e94cafd5584e0bcb6" Jun 12 18:44:27.894482 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:27.894454 2571 scope.go:117] "RemoveContainer" containerID="11116c92b44c8eba703e4644f126a7f678443befd17fbf23ac0a08c2251d2f61" Jun 12 18:44:29.636538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:29.636505 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" path="/var/lib/kubelet/pods/611412ef-476c-48d3-bbec-2a0913d383eb/volumes" Jun 12 18:44:33.560710 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:33.560669 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:44:33.563060 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:33.563033 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eee93665-037c-49c4-b1e3-b7d46a5a2df9-metrics-certs\") pod \"network-metrics-daemon-28pfq\" (UID: \"eee93665-037c-49c4-b1e3-b7d46a5a2df9\") " pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:44:33.837208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:33.837123 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lhhs9\"" Jun 12 18:44:33.844468 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:33.844447 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28pfq" Jun 12 18:44:33.970856 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:33.970822 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28pfq"] Jun 12 18:44:33.974846 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:44:33.974811 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee93665_037c_49c4_b1e3_b7d46a5a2df9.slice/crio-68d4681e392990fb3c16aaf72a32cfb1b61b900e8c7da319c5a195415fccd204 WatchSource:0}: Error finding container 68d4681e392990fb3c16aaf72a32cfb1b61b900e8c7da319c5a195415fccd204: Status 404 returned error can't find the container with id 68d4681e392990fb3c16aaf72a32cfb1b61b900e8c7da319c5a195415fccd204 Jun 12 18:44:33.976857 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:33.976841 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:44:34.874835 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:34.874798 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28pfq" event={"ID":"eee93665-037c-49c4-b1e3-b7d46a5a2df9","Type":"ContainerStarted","Data":"68d4681e392990fb3c16aaf72a32cfb1b61b900e8c7da319c5a195415fccd204"} Jun 12 18:44:35.880159 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:35.880125 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28pfq" event={"ID":"eee93665-037c-49c4-b1e3-b7d46a5a2df9","Type":"ContainerStarted","Data":"63176508761a40be9db10a672ea06357d1836346895152c69c3921de0f93cb11"} Jun 12 18:44:35.880603 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:35.880174 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28pfq" event={"ID":"eee93665-037c-49c4-b1e3-b7d46a5a2df9","Type":"ContainerStarted","Data":"82d749acfd55f3a79a0ea51c4e8b332a143c245cf4ce06dab223cb9869907c66"} Jun 12 18:44:35.899554 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:44:35.899504 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-28pfq" podStartSLOduration=375.960946704 podStartE2EDuration="6m16.899488095s" totalImagesPullingTime="938.541391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:44:35.898878698 +0000 UTC m=+376.716191926" watchObservedRunningTime="2026-06-12 18:44:35.899488095 +0000 UTC m=+376.716801323" Jun 12 18:46:00.966101 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966020 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-vb9g2"] Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966257 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="thanos-sidecar" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966268 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="thanos-sidecar" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966281 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-thanos" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966286 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-thanos" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966294 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="init-config-reloader" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966299 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="init-config-reloader" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966307 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="prometheus" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966312 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="prometheus" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966319 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966324 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966331 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-web" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966336 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-web" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966347 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="config-reloader" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966351 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="config-reloader" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966386 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="config-reloader" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966394 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="prometheus" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966400 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966407 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-thanos" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966414 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="thanos-sidecar" Jun 12 18:46:00.966538 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.966419 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611412ef-476c-48d3-bbec-2a0913d383eb" containerName="kube-rbac-proxy-web" Jun 12 18:46:00.969114 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.969100 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:00.972140 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.972118 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-r9xcp\"" Jun 12 18:46:00.972259 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.972229 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 18:46:00.972926 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.972909 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 18:46:00.978015 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:00.977992 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vb9g2"] Jun 12 18:46:01.062995 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.062943 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxz9\" (UniqueName: \"kubernetes.io/projected/523e6116-804c-4986-9e8b-2988d1bb561e-kube-api-access-rfxz9\") pod \"cert-manager-59c77684cc-vb9g2\" (UID: \"523e6116-804c-4986-9e8b-2988d1bb561e\") " pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.062995 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.062998 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523e6116-804c-4986-9e8b-2988d1bb561e-bound-sa-token\") pod \"cert-manager-59c77684cc-vb9g2\" (UID: \"523e6116-804c-4986-9e8b-2988d1bb561e\") " pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.163586 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.163545 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxz9\" (UniqueName: \"kubernetes.io/projected/523e6116-804c-4986-9e8b-2988d1bb561e-kube-api-access-rfxz9\") pod \"cert-manager-59c77684cc-vb9g2\" (UID: \"523e6116-804c-4986-9e8b-2988d1bb561e\") " pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.163739 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.163592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523e6116-804c-4986-9e8b-2988d1bb561e-bound-sa-token\") pod \"cert-manager-59c77684cc-vb9g2\" (UID: \"523e6116-804c-4986-9e8b-2988d1bb561e\") " pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.172046 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.172021 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/523e6116-804c-4986-9e8b-2988d1bb561e-bound-sa-token\") pod \"cert-manager-59c77684cc-vb9g2\" (UID: \"523e6116-804c-4986-9e8b-2988d1bb561e\") " pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.172147 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.172101 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxz9\" (UniqueName: \"kubernetes.io/projected/523e6116-804c-4986-9e8b-2988d1bb561e-kube-api-access-rfxz9\") pod \"cert-manager-59c77684cc-vb9g2\" (UID: \"523e6116-804c-4986-9e8b-2988d1bb561e\") " pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.278169 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.278140 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vb9g2" Jun 12 18:46:01.405367 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:01.405333 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vb9g2"] Jun 12 18:46:01.408702 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:01.408674 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod523e6116_804c_4986_9e8b_2988d1bb561e.slice/crio-5726d517f26b47638e42dd1d9974ff3b405047e61affebbea4813385f07696b2 WatchSource:0}: Error finding container 5726d517f26b47638e42dd1d9974ff3b405047e61affebbea4813385f07696b2: Status 404 returned error can't find the container with id 5726d517f26b47638e42dd1d9974ff3b405047e61affebbea4813385f07696b2 Jun 12 18:46:02.174935 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:02.174898 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vb9g2" event={"ID":"523e6116-804c-4986-9e8b-2988d1bb561e","Type":"ContainerStarted","Data":"5726d517f26b47638e42dd1d9974ff3b405047e61affebbea4813385f07696b2"} Jun 12 18:46:05.186585 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:05.186545 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vb9g2" event={"ID":"523e6116-804c-4986-9e8b-2988d1bb561e","Type":"ContainerStarted","Data":"da7c688b2d2f6202fa1cce9ccd8275d10ce2aef67394f496523d3e2372849453"} Jun 12 18:46:05.203097 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:05.203048 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-vb9g2" podStartSLOduration=2.1944891 podStartE2EDuration="5.203032608s" totalImagesPullingTime="3.008543508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:05.202006977 +0000 UTC m=+466.019320203" watchObservedRunningTime="2026-06-12 18:46:05.203032608 +0000 UTC m=+466.020345838" Jun 12 18:46:25.870807 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.870773 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5"] Jun 12 18:46:25.873844 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.873825 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:25.877727 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.877700 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m6wb2\"" Jun 12 18:46:25.877727 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.877704 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:46:25.877876 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.877781 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:46:25.877876 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.877783 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:46:25.878138 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.878122 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:46:25.915487 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.915456 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5"] Jun 12 18:46:25.937193 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.937163 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-tmp\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:25.937363 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.937206 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-manifests\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:25.937363 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.937242 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:25.937363 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.937274 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:25.937363 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:25.937293 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z268l\" (UniqueName: \"kubernetes.io/projected/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-kube-api-access-z268l\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.037821 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.037782 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-manifests\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.038034 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.037838 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.038034 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.037874 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.038034 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.037892 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z268l\" (UniqueName: \"kubernetes.io/projected/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-kube-api-access-z268l\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.038034 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.037914 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-tmp\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.038288 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.038264 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-manifests\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.040208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.040185 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-tmp\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.040420 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.040400 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.040550 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.040529 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.054223 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.054187 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z268l\" (UniqueName: \"kubernetes.io/projected/4afca98d-6d96-44eb-8d57-cf2c095a6bdf-kube-api-access-z268l\") pod \"opendatahub-operator-controller-manager-bc6c5cc78-tb2k5\" (UID: \"4afca98d-6d96-44eb-8d57-cf2c095a6bdf\") " pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.183369 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.183244 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:26.324450 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:26.324253 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5"] Jun 12 18:46:26.327343 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:26.327316 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4afca98d_6d96_44eb_8d57_cf2c095a6bdf.slice/crio-73756086f7dfb5a32581b9eeeb56f3bca2948ca6ef9b2d1e0340d914dd8585af WatchSource:0}: Error finding container 73756086f7dfb5a32581b9eeeb56f3bca2948ca6ef9b2d1e0340d914dd8585af: Status 404 returned error can't find the container with id 73756086f7dfb5a32581b9eeeb56f3bca2948ca6ef9b2d1e0340d914dd8585af Jun 12 18:46:27.264598 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:27.264551 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" event={"ID":"4afca98d-6d96-44eb-8d57-cf2c095a6bdf","Type":"ContainerStarted","Data":"73756086f7dfb5a32581b9eeeb56f3bca2948ca6ef9b2d1e0340d914dd8585af"} Jun 12 18:46:29.273912 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:29.273875 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" event={"ID":"4afca98d-6d96-44eb-8d57-cf2c095a6bdf","Type":"ContainerStarted","Data":"15c7fe47c398f2f5bdca388eb1db736855ef6dc3784446098677da62eef03d7d"} Jun 12 18:46:30.279239 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:30.279206 2571 generic.go:356] "Generic (PLEG): container finished" podID="4afca98d-6d96-44eb-8d57-cf2c095a6bdf" containerID="15c7fe47c398f2f5bdca388eb1db736855ef6dc3784446098677da62eef03d7d" exitCode=0 Jun 12 18:46:30.279600 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:30.279261 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" event={"ID":"4afca98d-6d96-44eb-8d57-cf2c095a6bdf","Type":"ContainerDied","Data":"15c7fe47c398f2f5bdca388eb1db736855ef6dc3784446098677da62eef03d7d"} Jun 12 18:46:31.284193 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:31.284146 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" event={"ID":"4afca98d-6d96-44eb-8d57-cf2c095a6bdf","Type":"ContainerStarted","Data":"173698de7eb311f6e6f4ed584091531aa4855a41c6fc4f2460b288c4d1d8510e"} Jun 12 18:46:31.284691 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:31.284279 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:31.312949 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:31.312894 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" podStartSLOduration=2.231464007 podStartE2EDuration="6.312875491s" totalImagesPullingTime="3.147971114s" totalInitContainerRuntime="933.44037ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:31.312235938 +0000 UTC m=+492.129549163" watchObservedRunningTime="2026-06-12 18:46:31.312875491 +0000 UTC m=+492.130188719" Jun 12 18:46:42.291446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:42.291414 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc6c5cc78-tb2k5" Jun 12 18:46:45.090736 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.090700 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq"] Jun 12 18:46:45.093211 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.093184 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.096479 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.096418 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:46:45.096656 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.096643 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:46:45.097398 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.097381 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:46:45.097494 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.097386 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:46:45.113774 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.113723 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq"] Jun 12 18:46:45.185612 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.185572 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/585d538a-59ac-47de-bda3-ad21954742fc-tmp\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.185846 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.185633 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc45r\" (UniqueName: \"kubernetes.io/projected/585d538a-59ac-47de-bda3-ad21954742fc-kube-api-access-mc45r\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.185846 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.185798 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585d538a-59ac-47de-bda3-ad21954742fc-tls-certs\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.286872 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.286841 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc45r\" (UniqueName: \"kubernetes.io/projected/585d538a-59ac-47de-bda3-ad21954742fc-kube-api-access-mc45r\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.287065 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.286891 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585d538a-59ac-47de-bda3-ad21954742fc-tls-certs\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.287065 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.286921 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/585d538a-59ac-47de-bda3-ad21954742fc-tmp\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.289288 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.289259 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/585d538a-59ac-47de-bda3-ad21954742fc-tmp\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.289413 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.289397 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585d538a-59ac-47de-bda3-ad21954742fc-tls-certs\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.312036 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.312004 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc45r\" (UniqueName: \"kubernetes.io/projected/585d538a-59ac-47de-bda3-ad21954742fc-kube-api-access-mc45r\") pod \"kube-auth-proxy-f9466d55b-lgxnq\" (UID: \"585d538a-59ac-47de-bda3-ad21954742fc\") " pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.326314 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.326283 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-z7szr"] Jun 12 18:46:45.328842 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.328824 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.331967 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.331949 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 12 18:46:45.332274 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.332253 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gkmgs\"" Jun 12 18:46:45.346107 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.346034 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-z7szr"] Jun 12 18:46:45.387454 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.387421 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjgfl\" (UniqueName: \"kubernetes.io/projected/7e0074ce-1953-4ecd-a645-eeb0e1132338-kube-api-access-hjgfl\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.387454 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.387457 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.402439 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.402406 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" Jun 12 18:46:45.488479 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.488217 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjgfl\" (UniqueName: \"kubernetes.io/projected/7e0074ce-1953-4ecd-a645-eeb0e1132338-kube-api-access-hjgfl\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.488479 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.488265 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.488479 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:46:45.488407 2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 12 18:46:45.488479 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:46:45.488464 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert podName:7e0074ce-1953-4ecd-a645-eeb0e1132338 nodeName:}" failed. No retries permitted until 2026-06-12 18:46:45.988444706 +0000 UTC m=+506.805757927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert") pod "odh-model-controller-6dc94f689f-z7szr" (UID: "7e0074ce-1953-4ecd-a645-eeb0e1132338") : secret "odh-model-controller-webhook-cert" not found Jun 12 18:46:45.498702 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.498664 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjgfl\" (UniqueName: \"kubernetes.io/projected/7e0074ce-1953-4ecd-a645-eeb0e1132338-kube-api-access-hjgfl\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.543952 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.543918 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq"] Jun 12 18:46:45.547200 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:45.547173 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585d538a_59ac_47de_bda3_ad21954742fc.slice/crio-d661a017e0135e7fb4d4f4f1398d272bbf0a4ae8a2524b37d8e11a1ddb229db9 WatchSource:0}: Error finding container d661a017e0135e7fb4d4f4f1398d272bbf0a4ae8a2524b37d8e11a1ddb229db9: Status 404 returned error can't find the container with id d661a017e0135e7fb4d4f4f1398d272bbf0a4ae8a2524b37d8e11a1ddb229db9 Jun 12 18:46:45.993201 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:45.993163 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:45.993419 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:46:45.993349 2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 12 18:46:45.993492 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:46:45.993429 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert podName:7e0074ce-1953-4ecd-a645-eeb0e1132338 nodeName:}" failed. No retries permitted until 2026-06-12 18:46:46.993404972 +0000 UTC m=+507.810718192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert") pod "odh-model-controller-6dc94f689f-z7szr" (UID: "7e0074ce-1953-4ecd-a645-eeb0e1132338") : secret "odh-model-controller-webhook-cert" not found Jun 12 18:46:46.095175 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.095138 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sf5z2"] Jun 12 18:46:46.098509 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.098484 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.100942 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.100911 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 18:46:46.118846 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.118818 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sf5z2"] Jun 12 18:46:46.194394 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.194357 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63134e23-dc57-451b-81ca-aaf18690b99f-tls-certs\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.194558 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.194436 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmzk5\" (UniqueName: \"kubernetes.io/projected/63134e23-dc57-451b-81ca-aaf18690b99f-kube-api-access-cmzk5\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.295295 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.295194 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmzk5\" (UniqueName: \"kubernetes.io/projected/63134e23-dc57-451b-81ca-aaf18690b99f-kube-api-access-cmzk5\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.295295 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.295275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63134e23-dc57-451b-81ca-aaf18690b99f-tls-certs\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.295512 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:46:46.295449 2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 12 18:46:46.295568 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:46:46.295514 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63134e23-dc57-451b-81ca-aaf18690b99f-tls-certs podName:63134e23-dc57-451b-81ca-aaf18690b99f nodeName:}" failed. No retries permitted until 2026-06-12 18:46:46.795491551 +0000 UTC m=+507.612804772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/63134e23-dc57-451b-81ca-aaf18690b99f-tls-certs") pod "model-serving-api-5dd488fc48-sf5z2" (UID: "63134e23-dc57-451b-81ca-aaf18690b99f") : secret "model-serving-api-tls" not found Jun 12 18:46:46.314959 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.314911 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmzk5\" (UniqueName: \"kubernetes.io/projected/63134e23-dc57-451b-81ca-aaf18690b99f-kube-api-access-cmzk5\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.340840 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.340795 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" event={"ID":"585d538a-59ac-47de-bda3-ad21954742fc","Type":"ContainerStarted","Data":"d661a017e0135e7fb4d4f4f1398d272bbf0a4ae8a2524b37d8e11a1ddb229db9"} Jun 12 18:46:46.799765 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.799716 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63134e23-dc57-451b-81ca-aaf18690b99f-tls-certs\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:46.802688 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:46.802649 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63134e23-dc57-451b-81ca-aaf18690b99f-tls-certs\") pod \"model-serving-api-5dd488fc48-sf5z2\" (UID: \"63134e23-dc57-451b-81ca-aaf18690b99f\") " pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:47.001196 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:47.000955 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:47.004562 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:47.004505 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e0074ce-1953-4ecd-a645-eeb0e1132338-cert\") pod \"odh-model-controller-6dc94f689f-z7szr\" (UID: \"7e0074ce-1953-4ecd-a645-eeb0e1132338\") " pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:47.012497 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:47.012261 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:47.140211 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:47.139938 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:47.241555 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:47.241500 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sf5z2"] Jun 12 18:46:47.825569 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:47.825528 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63134e23_dc57_451b_81ca_aaf18690b99f.slice/crio-545d19b791056f47ac54628bf76b43e05c0ee1fb954b7e9344680fd86ee93576 WatchSource:0}: Error finding container 545d19b791056f47ac54628bf76b43e05c0ee1fb954b7e9344680fd86ee93576: Status 404 returned error can't find the container with id 545d19b791056f47ac54628bf76b43e05c0ee1fb954b7e9344680fd86ee93576 Jun 12 18:46:48.351050 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:48.351013 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" event={"ID":"63134e23-dc57-451b-81ca-aaf18690b99f","Type":"ContainerStarted","Data":"545d19b791056f47ac54628bf76b43e05c0ee1fb954b7e9344680fd86ee93576"} Jun 12 18:46:48.637043 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:48.637003 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-z7szr"] Jun 12 18:46:48.641787 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:48.641743 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0074ce_1953_4ecd_a645_eeb0e1132338.slice/crio-d8eb13acbea1c32c232e927d07b03d774f8a1cfb17e0f66bc896e73396b295e9 WatchSource:0}: Error finding container d8eb13acbea1c32c232e927d07b03d774f8a1cfb17e0f66bc896e73396b295e9: Status 404 returned error can't find the container with id d8eb13acbea1c32c232e927d07b03d774f8a1cfb17e0f66bc896e73396b295e9 Jun 12 18:46:49.359143 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:49.358315 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" event={"ID":"585d538a-59ac-47de-bda3-ad21954742fc","Type":"ContainerStarted","Data":"bb7366c4f8872123352f2243e23ce13e04e6cc24e0be8703bd5adfd6b117973a"} Jun 12 18:46:49.361637 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:49.361605 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" event={"ID":"7e0074ce-1953-4ecd-a645-eeb0e1132338","Type":"ContainerStarted","Data":"d8eb13acbea1c32c232e927d07b03d774f8a1cfb17e0f66bc896e73396b295e9"} Jun 12 18:46:49.390904 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:49.390848 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f9466d55b-lgxnq" podStartSLOduration=1.390589103 podStartE2EDuration="4.390826434s" totalImagesPullingTime="3.000237331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:49.38886606 +0000 UTC m=+510.206179308" watchObservedRunningTime="2026-06-12 18:46:49.390826434 +0000 UTC m=+510.208139663" Jun 12 18:46:50.367625 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:50.367530 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" event={"ID":"63134e23-dc57-451b-81ca-aaf18690b99f","Type":"ContainerStarted","Data":"c1d8590a972008048b540281c66783032b5213e4460744c57c26d22d0b292f95"} Jun 12 18:46:50.368065 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:50.367870 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:46:50.388415 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:50.388353 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" podStartSLOduration=2.183574871 podStartE2EDuration="4.388334537s" totalImagesPullingTime="2.204759666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:50.386676548 +0000 UTC m=+511.203989776" watchObservedRunningTime="2026-06-12 18:46:50.388334537 +0000 UTC m=+511.205647766" Jun 12 18:46:52.377870 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:52.377832 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" event={"ID":"7e0074ce-1953-4ecd-a645-eeb0e1132338","Type":"ContainerStarted","Data":"322a1d131ad3816476b0276312397d0979c2c82926fb285b7511fe74bff0558b"} Jun 12 18:46:52.378316 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:52.377903 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:46:52.432601 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:52.432548 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" podStartSLOduration=4.525589674 podStartE2EDuration="7.432532182s" totalImagesPullingTime="2.906942508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:46:52.430451787 +0000 UTC m=+513.247765016" watchObservedRunningTime="2026-06-12 18:46:52.432532182 +0000 UTC m=+513.249845410" Jun 12 18:46:56.999544 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:56.999508 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-p4bhn"] Jun 12 18:46:57.002376 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.002353 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7"] Jun 12 18:46:57.002514 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.002471 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.005410 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.005388 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.007897 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.007857 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 18:46:57.008192 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.008173 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nkqpl\"" Jun 12 18:46:57.015261 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.015240 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-kzw58\"" Jun 12 18:46:57.018281 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.018251 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 18:46:57.037481 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.037454 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-p4bhn"] Jun 12 18:46:57.038913 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.038834 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7"] Jun 12 18:46:57.086471 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.086438 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6060f2c-bfd1-44b7-879e-2d8f4b06371b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hc7q7\" (UID: \"b6060f2c-bfd1-44b7-879e-2d8f4b06371b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.086665 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.086478 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbsl\" (UniqueName: \"kubernetes.io/projected/8a994e59-deb6-4090-9c07-85a2e5aef3a8-kube-api-access-qxbsl\") pod \"kserve-controller-manager-69fc866d76-p4bhn\" (UID: \"8a994e59-deb6-4090-9c07-85a2e5aef3a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.086665 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.086556 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a994e59-deb6-4090-9c07-85a2e5aef3a8-cert\") pod \"kserve-controller-manager-69fc866d76-p4bhn\" (UID: \"8a994e59-deb6-4090-9c07-85a2e5aef3a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.086665 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.086605 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8pfl\" (UniqueName: \"kubernetes.io/projected/b6060f2c-bfd1-44b7-879e-2d8f4b06371b-kube-api-access-x8pfl\") pod \"llmisvc-controller-manager-864bfd7bc9-hc7q7\" (UID: \"b6060f2c-bfd1-44b7-879e-2d8f4b06371b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.187411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.187377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a994e59-deb6-4090-9c07-85a2e5aef3a8-cert\") pod \"kserve-controller-manager-69fc866d76-p4bhn\" (UID: \"8a994e59-deb6-4090-9c07-85a2e5aef3a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.187411 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.187419 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8pfl\" (UniqueName: \"kubernetes.io/projected/b6060f2c-bfd1-44b7-879e-2d8f4b06371b-kube-api-access-x8pfl\") pod \"llmisvc-controller-manager-864bfd7bc9-hc7q7\" (UID: \"b6060f2c-bfd1-44b7-879e-2d8f4b06371b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.187661 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.187443 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6060f2c-bfd1-44b7-879e-2d8f4b06371b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hc7q7\" (UID: \"b6060f2c-bfd1-44b7-879e-2d8f4b06371b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.187661 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.187468 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbsl\" (UniqueName: \"kubernetes.io/projected/8a994e59-deb6-4090-9c07-85a2e5aef3a8-kube-api-access-qxbsl\") pod \"kserve-controller-manager-69fc866d76-p4bhn\" (UID: \"8a994e59-deb6-4090-9c07-85a2e5aef3a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.190081 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.190057 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a994e59-deb6-4090-9c07-85a2e5aef3a8-cert\") pod \"kserve-controller-manager-69fc866d76-p4bhn\" (UID: \"8a994e59-deb6-4090-9c07-85a2e5aef3a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.190190 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.190118 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6060f2c-bfd1-44b7-879e-2d8f4b06371b-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hc7q7\" (UID: \"b6060f2c-bfd1-44b7-879e-2d8f4b06371b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.208026 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.207996 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8pfl\" (UniqueName: \"kubernetes.io/projected/b6060f2c-bfd1-44b7-879e-2d8f4b06371b-kube-api-access-x8pfl\") pod \"llmisvc-controller-manager-864bfd7bc9-hc7q7\" (UID: \"b6060f2c-bfd1-44b7-879e-2d8f4b06371b\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.208614 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.208592 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbsl\" (UniqueName: \"kubernetes.io/projected/8a994e59-deb6-4090-9c07-85a2e5aef3a8-kube-api-access-qxbsl\") pod \"kserve-controller-manager-69fc866d76-p4bhn\" (UID: \"8a994e59-deb6-4090-9c07-85a2e5aef3a8\") " pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.315318 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.315221 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:46:57.321655 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.321635 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:46:57.479167 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.479135 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-p4bhn"] Jun 12 18:46:57.482680 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:57.482655 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a994e59_deb6_4090_9c07_85a2e5aef3a8.slice/crio-71e00ac9ce552bd3c2561e5976bbc0e3a1be789e1c1892544faa94e0251791a6 WatchSource:0}: Error finding container 71e00ac9ce552bd3c2561e5976bbc0e3a1be789e1c1892544faa94e0251791a6: Status 404 returned error can't find the container with id 71e00ac9ce552bd3c2561e5976bbc0e3a1be789e1c1892544faa94e0251791a6 Jun 12 18:46:57.501646 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:57.501616 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7"] Jun 12 18:46:57.505436 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:46:57.505408 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6060f2c_bfd1_44b7_879e_2d8f4b06371b.slice/crio-39961a1b522397b023d94415d399b7902b3aaeec5eea0e212e9b87655197356a WatchSource:0}: Error finding container 39961a1b522397b023d94415d399b7902b3aaeec5eea0e212e9b87655197356a: Status 404 returned error can't find the container with id 39961a1b522397b023d94415d399b7902b3aaeec5eea0e212e9b87655197356a Jun 12 18:46:58.401582 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:58.401545 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" event={"ID":"8a994e59-deb6-4090-9c07-85a2e5aef3a8","Type":"ContainerStarted","Data":"71e00ac9ce552bd3c2561e5976bbc0e3a1be789e1c1892544faa94e0251791a6"} Jun 12 18:46:58.402904 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:46:58.402878 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" event={"ID":"b6060f2c-bfd1-44b7-879e-2d8f4b06371b","Type":"ContainerStarted","Data":"39961a1b522397b023d94415d399b7902b3aaeec5eea0e212e9b87655197356a"} Jun 12 18:47:01.377201 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.377174 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sf5z2" Jun 12 18:47:01.419085 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.419046 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" event={"ID":"8a994e59-deb6-4090-9c07-85a2e5aef3a8","Type":"ContainerStarted","Data":"1b108519a00b9e2a548383e4d8d55db90edef99629d0d86b3e24690035a4dc60"} Jun 12 18:47:01.419260 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.419109 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:47:01.420500 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.420480 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" event={"ID":"b6060f2c-bfd1-44b7-879e-2d8f4b06371b","Type":"ContainerStarted","Data":"65d4eb9221616b2a7fe95ac58a14fd7312ee90e8a992bee4fc1409e244cad171"} Jun 12 18:47:01.420567 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.420533 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:47:01.475263 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.475195 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" podStartSLOduration=2.347778764 podStartE2EDuration="5.475179443s" totalImagesPullingTime="3.127400679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:01.474380313 +0000 UTC m=+522.291693544" watchObservedRunningTime="2026-06-12 18:47:01.475179443 +0000 UTC m=+522.292492671" Jun 12 18:47:01.549501 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:01.549438 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" podStartSLOduration=2.401580103 podStartE2EDuration="5.54942121s" totalImagesPullingTime="3.147841107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:01.544660443 +0000 UTC m=+522.361973672" watchObservedRunningTime="2026-06-12 18:47:01.54942121 +0000 UTC m=+522.366734439" Jun 12 18:47:03.383728 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:03.383699 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-z7szr" Jun 12 18:47:04.515050 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.515007 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k"] Jun 12 18:47:04.517653 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.517630 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.521065 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.521040 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rtdcl\"" Jun 12 18:47:04.521193 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.521136 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 18:47:04.521365 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.521349 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 18:47:04.583111 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.583073 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k"] Jun 12 18:47:04.654160 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.654127 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/81f04e3d-1172-415f-8e45-e75f45a89bb9-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d6z5k\" (UID: \"81f04e3d-1172-415f-8e45-e75f45a89bb9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.654351 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.654266 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tvmv\" (UniqueName: \"kubernetes.io/projected/81f04e3d-1172-415f-8e45-e75f45a89bb9-kube-api-access-5tvmv\") pod \"servicemesh-operator3-57f65f65fb-d6z5k\" (UID: \"81f04e3d-1172-415f-8e45-e75f45a89bb9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.755091 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.755050 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tvmv\" (UniqueName: \"kubernetes.io/projected/81f04e3d-1172-415f-8e45-e75f45a89bb9-kube-api-access-5tvmv\") pod \"servicemesh-operator3-57f65f65fb-d6z5k\" (UID: \"81f04e3d-1172-415f-8e45-e75f45a89bb9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.755268 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.755102 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/81f04e3d-1172-415f-8e45-e75f45a89bb9-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d6z5k\" (UID: \"81f04e3d-1172-415f-8e45-e75f45a89bb9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.757645 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.757618 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/81f04e3d-1172-415f-8e45-e75f45a89bb9-operator-config\") pod \"servicemesh-operator3-57f65f65fb-d6z5k\" (UID: \"81f04e3d-1172-415f-8e45-e75f45a89bb9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.766611 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.766544 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tvmv\" (UniqueName: \"kubernetes.io/projected/81f04e3d-1172-415f-8e45-e75f45a89bb9-kube-api-access-5tvmv\") pod \"servicemesh-operator3-57f65f65fb-d6z5k\" (UID: \"81f04e3d-1172-415f-8e45-e75f45a89bb9\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.826530 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.826494 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:04.985868 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:04.985834 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k"] Jun 12 18:47:04.991129 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:47:04.991096 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f04e3d_1172_415f_8e45_e75f45a89bb9.slice/crio-65bb17053b8a7b11a310d3b6d61203ae54076404d54ccd306a68b9d29c30e466 WatchSource:0}: Error finding container 65bb17053b8a7b11a310d3b6d61203ae54076404d54ccd306a68b9d29c30e466: Status 404 returned error can't find the container with id 65bb17053b8a7b11a310d3b6d61203ae54076404d54ccd306a68b9d29c30e466 Jun 12 18:47:05.437955 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:05.437919 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" event={"ID":"81f04e3d-1172-415f-8e45-e75f45a89bb9","Type":"ContainerStarted","Data":"65bb17053b8a7b11a310d3b6d61203ae54076404d54ccd306a68b9d29c30e466"} Jun 12 18:47:08.451859 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:08.451775 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" event={"ID":"81f04e3d-1172-415f-8e45-e75f45a89bb9","Type":"ContainerStarted","Data":"faf09ae8f41e8ef1feda7caad37a447acf988a80f86f740b89d9b3dd5b4818a3"} Jun 12 18:47:08.452237 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:08.451907 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:08.526244 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:08.526185 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" podStartSLOduration=2.115765471 podStartE2EDuration="4.526163021s" totalImagesPullingTime="2.41039755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:08.523578208 +0000 UTC m=+529.340891438" watchObservedRunningTime="2026-06-12 18:47:08.526163021 +0000 UTC m=+529.343476252" Jun 12 18:47:19.463906 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:19.463872 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-d6z5k" Jun 12 18:47:21.126147 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.126113 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-55f6479cff-8jqd8"] Jun 12 18:47:21.134520 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.134492 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.137656 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.137622 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 18:47:21.137826 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.137656 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mcgzg\"" Jun 12 18:47:21.144714 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.144685 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-55f6479cff-8jqd8"] Jun 12 18:47:21.187404 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.187366 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da-redirect-config\") pod \"dashboard-redirect-55f6479cff-8jqd8\" (UID: \"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da\") " pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.187561 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.187420 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6bg\" (UniqueName: \"kubernetes.io/projected/a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da-kube-api-access-cp6bg\") pod \"dashboard-redirect-55f6479cff-8jqd8\" (UID: \"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da\") " pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.288222 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.288186 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da-redirect-config\") pod \"dashboard-redirect-55f6479cff-8jqd8\" (UID: \"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da\") " pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.288391 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.288252 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6bg\" (UniqueName: \"kubernetes.io/projected/a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da-kube-api-access-cp6bg\") pod \"dashboard-redirect-55f6479cff-8jqd8\" (UID: \"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da\") " pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.289009 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.288983 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da-redirect-config\") pod \"dashboard-redirect-55f6479cff-8jqd8\" (UID: \"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da\") " pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.299335 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.299310 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6bg\" (UniqueName: \"kubernetes.io/projected/a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da-kube-api-access-cp6bg\") pod \"dashboard-redirect-55f6479cff-8jqd8\" (UID: \"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da\") " pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.448583 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.448498 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" Jun 12 18:47:21.603594 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:21.603560 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-55f6479cff-8jqd8"] Jun 12 18:47:21.606795 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:47:21.606743 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d0dd03_3f3d_4cb6_bb76_bb8f1b00f4da.slice/crio-226f519d77d8338e0eb3f710478e7ab58118e521c41e201f058d37643b5999f8 WatchSource:0}: Error finding container 226f519d77d8338e0eb3f710478e7ab58118e521c41e201f058d37643b5999f8: Status 404 returned error can't find the container with id 226f519d77d8338e0eb3f710478e7ab58118e521c41e201f058d37643b5999f8 Jun 12 18:47:22.515169 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:22.515131 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" event={"ID":"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da","Type":"ContainerStarted","Data":"226f519d77d8338e0eb3f710478e7ab58118e521c41e201f058d37643b5999f8"} Jun 12 18:47:25.528842 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:25.528809 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" event={"ID":"a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da","Type":"ContainerStarted","Data":"2a16689852246683d558533b723a77f1ae1fac690960e43eb4e961523590f8e1"} Jun 12 18:47:25.547655 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:25.547606 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-55f6479cff-8jqd8" podStartSLOduration=1.279020694 podStartE2EDuration="4.547589598s" totalImagesPullingTime="3.268568904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:25.545820909 +0000 UTC m=+546.363134137" watchObservedRunningTime="2026-06-12 18:47:25.547589598 +0000 UTC m=+546.364902830" Jun 12 18:47:32.426912 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:32.426882 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hc7q7" Jun 12 18:47:32.430048 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:32.430028 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-p4bhn" Jun 12 18:47:33.467184 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.467150 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5"] Jun 12 18:47:33.472495 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.472470 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.475070 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.475042 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 18:47:33.475192 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.475075 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 18:47:33.475192 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.475101 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 18:47:33.475192 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.475160 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 18:47:33.475531 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.475514 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-p5cks\"" Jun 12 18:47:33.481898 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.481874 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5"] Jun 12 18:47:33.590335 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590298 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.590521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590340 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18b0b814-9873-49bd-a5ad-491120b746a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.590521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590364 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b0b814-9873-49bd-a5ad-491120b746a7-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.590521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590461 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b0b814-9873-49bd-a5ad-491120b746a7-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.590521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590504 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2rg\" (UniqueName: \"kubernetes.io/projected/18b0b814-9873-49bd-a5ad-491120b746a7-kube-api-access-wt2rg\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.590685 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590528 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.590685 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.590549 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.691927 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.691880 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692121 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.691933 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18b0b814-9873-49bd-a5ad-491120b746a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692121 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.691971 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b0b814-9873-49bd-a5ad-491120b746a7-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692121 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.692026 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b0b814-9873-49bd-a5ad-491120b746a7-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692121 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.692062 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2rg\" (UniqueName: \"kubernetes.io/projected/18b0b814-9873-49bd-a5ad-491120b746a7-kube-api-access-wt2rg\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692121 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.692092 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692404 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.692127 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.692673 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.692643 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/18b0b814-9873-49bd-a5ad-491120b746a7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.694995 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.694970 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.695098 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.694967 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.695098 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.694973 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/18b0b814-9873-49bd-a5ad-491120b746a7-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.695172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.695152 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/18b0b814-9873-49bd-a5ad-491120b746a7-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.699691 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.699669 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18b0b814-9873-49bd-a5ad-491120b746a7-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.700466 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.700445 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2rg\" (UniqueName: \"kubernetes.io/projected/18b0b814-9873-49bd-a5ad-491120b746a7-kube-api-access-wt2rg\") pod \"istiod-openshift-gateway-75c67f8887-sz6w5\" (UID: \"18b0b814-9873-49bd-a5ad-491120b746a7\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.785981 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.785944 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:33.929235 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:33.929192 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5"] Jun 12 18:47:33.932457 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:47:33.932425 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18b0b814_9873_49bd_a5ad_491120b746a7.slice/crio-ca1494f7a2ec470bb5a856708f48db23593cd81fee094c7c7c79b73905ecb9e9 WatchSource:0}: Error finding container ca1494f7a2ec470bb5a856708f48db23593cd81fee094c7c7c79b73905ecb9e9: Status 404 returned error can't find the container with id ca1494f7a2ec470bb5a856708f48db23593cd81fee094c7c7c79b73905ecb9e9 Jun 12 18:47:34.572710 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:34.572675 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" event={"ID":"18b0b814-9873-49bd-a5ad-491120b746a7","Type":"ContainerStarted","Data":"ca1494f7a2ec470bb5a856708f48db23593cd81fee094c7c7c79b73905ecb9e9"} Jun 12 18:47:36.223819 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:36.223780 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 18:47:36.224082 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:36.223852 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 12 18:47:36.583584 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:36.583540 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" event={"ID":"18b0b814-9873-49bd-a5ad-491120b746a7","Type":"ContainerStarted","Data":"61da249ba8d07bb6486cff2e185bae9198aef7b2155db8c0ccbaa2f9bf968c87"} Jun 12 18:47:36.583814 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:36.583677 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:47:36.607558 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:36.607489 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" podStartSLOduration=1.318811752 podStartE2EDuration="3.607467671s" totalImagesPullingTime="2.288655919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:47:36.60706031 +0000 UTC m=+557.424373542" watchObservedRunningTime="2026-06-12 18:47:36.607467671 +0000 UTC m=+557.424780902" Jun 12 18:47:37.590780 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:47:37.590734 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-sz6w5" Jun 12 18:48:18.023683 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.023644 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q"] Jun 12 18:48:18.025936 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.025919 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.028967 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.028942 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:48:18.029084 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.028977 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:48:18.029084 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.029044 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8dlhh\"" Jun 12 18:48:18.045501 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.045474 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q"] Jun 12 18:48:18.070702 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.070665 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2bc724a-3d25-425b-8859-a9922ae7cf3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.070887 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.070711 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndfnf\" (UniqueName: \"kubernetes.io/projected/b2bc724a-3d25-425b-8859-a9922ae7cf3d-kube-api-access-ndfnf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.172042 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.172003 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2bc724a-3d25-425b-8859-a9922ae7cf3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.172212 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.172063 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndfnf\" (UniqueName: \"kubernetes.io/projected/b2bc724a-3d25-425b-8859-a9922ae7cf3d-kube-api-access-ndfnf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.172482 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.172459 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2bc724a-3d25-425b-8859-a9922ae7cf3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.190748 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.190719 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndfnf\" (UniqueName: \"kubernetes.io/projected/b2bc724a-3d25-425b-8859-a9922ae7cf3d-kube-api-access-ndfnf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.336318 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.336218 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:18.471119 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.471093 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q"] Jun 12 18:48:18.473860 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:48:18.473817 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bc724a_3d25_425b_8859_a9922ae7cf3d.slice/crio-176f9a1024d520282889c9478fdfdc2ebd9e9b3b5309dfea3be2e7d43d13ef5d WatchSource:0}: Error finding container 176f9a1024d520282889c9478fdfdc2ebd9e9b3b5309dfea3be2e7d43d13ef5d: Status 404 returned error can't find the container with id 176f9a1024d520282889c9478fdfdc2ebd9e9b3b5309dfea3be2e7d43d13ef5d Jun 12 18:48:18.761951 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:18.761918 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" event={"ID":"b2bc724a-3d25-425b-8859-a9922ae7cf3d","Type":"ContainerStarted","Data":"176f9a1024d520282889c9478fdfdc2ebd9e9b3b5309dfea3be2e7d43d13ef5d"} Jun 12 18:48:23.786792 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:23.786734 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" event={"ID":"b2bc724a-3d25-425b-8859-a9922ae7cf3d","Type":"ContainerStarted","Data":"cb65e5b70df8d5a210251075c3fc6671adfc34dfc280edd5e8d306544723e804"} Jun 12 18:48:23.787308 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:23.786814 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:23.824575 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:23.824503 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" podStartSLOduration=2.244738022 podStartE2EDuration="6.82448341s" totalImagesPullingTime="4.579745388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:23.823099155 +0000 UTC m=+604.640412385" watchObservedRunningTime="2026-06-12 18:48:23.82448341 +0000 UTC m=+604.641796639" Jun 12 18:48:34.793834 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:34.793800 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:36.218059 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.218022 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx"] Jun 12 18:48:36.226882 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.226853 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.245299 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.245266 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx"] Jun 12 18:48:36.312146 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.312108 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kxsf\" (UniqueName: \"kubernetes.io/projected/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-kube-api-access-7kxsf\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.312329 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.312245 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.413151 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.413104 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.413151 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.413153 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kxsf\" (UniqueName: \"kubernetes.io/projected/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-kube-api-access-7kxsf\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.413575 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.413555 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.422137 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.422108 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kxsf\" (UniqueName: \"kubernetes.io/projected/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-kube-api-access-7kxsf\") pod \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.538162 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.538123 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.613341 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.613268 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx"] Jun 12 18:48:36.626920 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.626883 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx"] Jun 12 18:48:36.653785 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.653740 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs"] Jun 12 18:48:36.658290 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.658267 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.672059 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.672028 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q"] Jun 12 18:48:36.672282 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.672256 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" containerName="manager" containerID="cri-o://cb65e5b70df8d5a210251075c3fc6671adfc34dfc280edd5e8d306544723e804" gracePeriod=2 Jun 12 18:48:36.673819 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.673793 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs"] Jun 12 18:48:36.687270 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.687232 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q"] Jun 12 18:48:36.700125 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:36.700077 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" is forbidden: User \"system:node:ip-10-0-141-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-181.ec2.internal' and this object" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:36.716746 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.716707 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/616741dc-de1c-4de4-8e25-e57792293dee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-s22gs\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.716949 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.716829 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fhmv\" (UniqueName: \"kubernetes.io/projected/616741dc-de1c-4de4-8e25-e57792293dee-kube-api-access-5fhmv\") pod \"kuadrant-operator-controller-manager-55467d9f7-s22gs\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.818867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.818377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/616741dc-de1c-4de4-8e25-e57792293dee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-s22gs\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.818867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.818477 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fhmv\" (UniqueName: \"kubernetes.io/projected/616741dc-de1c-4de4-8e25-e57792293dee-kube-api-access-5fhmv\") pod \"kuadrant-operator-controller-manager-55467d9f7-s22gs\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.818867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.818841 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/616741dc-de1c-4de4-8e25-e57792293dee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-s22gs\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.838054 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.838028 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fhmv\" (UniqueName: \"kubernetes.io/projected/616741dc-de1c-4de4-8e25-e57792293dee-kube-api-access-5fhmv\") pod \"kuadrant-operator-controller-manager-55467d9f7-s22gs\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:36.841313 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:36.841270 2571 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 12 18:48:36.841313 ip-10-0-141-181 kubenswrapper[2571]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gh2tx_kuadrant-system_b57cfde8-152f-43b7-a5bb-ec0eae3d1318_0(f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gh2tx to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb" Netns:"/var/run/netns/56c1f064-e26d-49d0-b4be-9bf9ee53cc6c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-gh2tx;K8S_POD_INFRA_CONTAINER_ID=f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb;K8S_POD_UID=b57cfde8-152f-43b7-a5bb-ec0eae3d1318" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx/b57cfde8-152f-43b7-a5bb-ec0eae3d1318:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:1a [10.134.0.26/23] Jun 12 18:48:36.841313 ip-10-0-141-181 kubenswrapper[2571]: ' Jun 12 18:48:36.841313 ip-10-0-141-181 kubenswrapper[2571]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 12 18:48:36.841313 ip-10-0-141-181 kubenswrapper[2571]: > Jun 12 18:48:36.841615 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:36.841340 2571 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 12 18:48:36.841615 ip-10-0-141-181 kubenswrapper[2571]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gh2tx_kuadrant-system_b57cfde8-152f-43b7-a5bb-ec0eae3d1318_0(f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gh2tx to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb" Netns:"/var/run/netns/56c1f064-e26d-49d0-b4be-9bf9ee53cc6c" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-gh2tx;K8S_POD_INFRA_CONTAINER_ID=f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb;K8S_POD_UID=b57cfde8-152f-43b7-a5bb-ec0eae3d1318" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx/b57cfde8-152f-43b7-a5bb-ec0eae3d1318:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx f31e6c10a9e2bef36be718c9305c648b9aa393b58b351cb439b434d3f31512cb network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:1a [10.134.0.26/23] Jun 12 18:48:36.841615 ip-10-0-141-181 kubenswrapper[2571]: ' Jun 12 18:48:36.841615 ip-10-0-141-181 kubenswrapper[2571]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 12 18:48:36.841615 ip-10-0-141-181 kubenswrapper[2571]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:36.845533 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.845493 2571 generic.go:356] "Generic (PLEG): container finished" podID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" containerID="cb65e5b70df8d5a210251075c3fc6671adfc34dfc280edd5e8d306544723e804" exitCode=0 Jun 12 18:48:36.911812 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.911788 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:36.914544 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:36.914520 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwf2q\" is forbidden: User \"system:node:ip-10-0-141-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-181.ec2.internal' and this object" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:36.970300 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:36.970263 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:37.020820 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.020790 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bc724a-3d25-425b-8859-a9922ae7cf3d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2bc724a-3d25-425b-8859-a9922ae7cf3d" (UID: "b2bc724a-3d25-425b-8859-a9922ae7cf3d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:48:37.020936 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.020382 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2bc724a-3d25-425b-8859-a9922ae7cf3d-extensions-socket-volume\") pod \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " Jun 12 18:48:37.020936 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.020884 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndfnf\" (UniqueName: \"kubernetes.io/projected/b2bc724a-3d25-425b-8859-a9922ae7cf3d-kube-api-access-ndfnf\") pod \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\" (UID: \"b2bc724a-3d25-425b-8859-a9922ae7cf3d\") " Jun 12 18:48:37.021376 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.021357 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2bc724a-3d25-425b-8859-a9922ae7cf3d-extensions-socket-volume\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:48:37.023791 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.023764 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bc724a-3d25-425b-8859-a9922ae7cf3d-kube-api-access-ndfnf" (OuterVolumeSpecName: "kube-api-access-ndfnf") pod "b2bc724a-3d25-425b-8859-a9922ae7cf3d" (UID: "b2bc724a-3d25-425b-8859-a9922ae7cf3d"). InnerVolumeSpecName "kube-api-access-ndfnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:48:37.122280 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.122200 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndfnf\" (UniqueName: \"kubernetes.io/projected/b2bc724a-3d25-425b-8859-a9922ae7cf3d-kube-api-access-ndfnf\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:48:37.148496 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.148467 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs"] Jun 12 18:48:37.150467 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:48:37.150439 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616741dc_de1c_4de4_8e25_e57792293dee.slice/crio-a873c03b1dfb61752ff6e44cde0f15083115442793a3beafe3e78dca4761209c WatchSource:0}: Error finding container a873c03b1dfb61752ff6e44cde0f15083115442793a3beafe3e78dca4761209c: Status 404 returned error can't find the container with id a873c03b1dfb61752ff6e44cde0f15083115442793a3beafe3e78dca4761209c Jun 12 18:48:37.638226 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.638192 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" path="/var/lib/kubelet/pods/b2bc724a-3d25-425b-8859-a9922ae7cf3d/volumes" Jun 12 18:48:37.851783 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.851701 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwf2q" Jun 12 18:48:37.851783 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.851716 2571 scope.go:117] "RemoveContainer" containerID="cb65e5b70df8d5a210251075c3fc6671adfc34dfc280edd5e8d306544723e804" Jun 12 18:48:37.853665 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.853620 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" event={"ID":"616741dc-de1c-4de4-8e25-e57792293dee","Type":"ContainerStarted","Data":"a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a"} Jun 12 18:48:37.853815 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.853794 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" event={"ID":"616741dc-de1c-4de4-8e25-e57792293dee","Type":"ContainerStarted","Data":"a873c03b1dfb61752ff6e44cde0f15083115442793a3beafe3e78dca4761209c"} Jun 12 18:48:37.853887 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.853831 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:37.853887 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.853831 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:37.861550 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.861533 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:37.887031 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.886980 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" podStartSLOduration=1.886963967 podStartE2EDuration="1.886963967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:37.886353979 +0000 UTC m=+618.703667220" watchObservedRunningTime="2026-06-12 18:48:37.886963967 +0000 UTC m=+618.704277195" Jun 12 18:48:37.889239 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:37.889191 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" is forbidden: User \"system:node:ip-10-0-141-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-181.ec2.internal' and this object" podUID="b57cfde8-152f-43b7-a5bb-ec0eae3d1318" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:37.928330 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.928291 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-extensions-socket-volume\") pod \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " Jun 12 18:48:37.928502 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.928379 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7kxsf\" (UniqueName: \"kubernetes.io/projected/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-kube-api-access-7kxsf\") pod \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\" (UID: \"b57cfde8-152f-43b7-a5bb-ec0eae3d1318\") " Jun 12 18:48:37.928600 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.928575 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b57cfde8-152f-43b7-a5bb-ec0eae3d1318" (UID: "b57cfde8-152f-43b7-a5bb-ec0eae3d1318"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:48:37.930447 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:37.930425 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-kube-api-access-7kxsf" (OuterVolumeSpecName: "kube-api-access-7kxsf") pod "b57cfde8-152f-43b7-a5bb-ec0eae3d1318" (UID: "b57cfde8-152f-43b7-a5bb-ec0eae3d1318"). InnerVolumeSpecName "kube-api-access-7kxsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:48:38.029439 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:38.029398 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-extensions-socket-volume\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:48:38.029439 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:38.029431 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7kxsf\" (UniqueName: \"kubernetes.io/projected/b57cfde8-152f-43b7-a5bb-ec0eae3d1318-kube-api-access-7kxsf\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:48:38.860817 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:38.860790 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:38.863357 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:38.863328 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" is forbidden: User \"system:node:ip-10-0-141-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-181.ec2.internal' and this object" podUID="b57cfde8-152f-43b7-a5bb-ec0eae3d1318" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:38.868847 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:38.868817 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" is forbidden: User \"system:node:ip-10-0-141-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-181.ec2.internal' and this object" podUID="b57cfde8-152f-43b7-a5bb-ec0eae3d1318" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:39.635947 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:48:39.635908 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gh2tx\" is forbidden: User \"system:node:ip-10-0-141-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-181.ec2.internal' and this object" podUID="b57cfde8-152f-43b7-a5bb-ec0eae3d1318" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gh2tx" Jun 12 18:48:39.637843 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:39.637821 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b57cfde8-152f-43b7-a5bb-ec0eae3d1318" path="/var/lib/kubelet/pods/b57cfde8-152f-43b7-a5bb-ec0eae3d1318/volumes" Jun 12 18:48:48.863559 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:48.863529 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:48:49.189853 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.189819 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn"] Jun 12 18:48:49.190169 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.190156 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" containerName="manager" Jun 12 18:48:49.190215 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.190171 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" containerName="manager" Jun 12 18:48:49.190253 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.190227 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2bc724a-3d25-425b-8859-a9922ae7cf3d" containerName="manager" Jun 12 18:48:49.193038 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.193014 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.211322 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.211294 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn"] Jun 12 18:48:49.326266 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.326235 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-752vn\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.326465 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.326286 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7hkv\" (UniqueName: \"kubernetes.io/projected/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-kube-api-access-t7hkv\") pod \"kuadrant-operator-controller-manager-86878c769f-752vn\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.427418 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.427377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-752vn\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.427598 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.427445 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7hkv\" (UniqueName: \"kubernetes.io/projected/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-kube-api-access-t7hkv\") pod \"kuadrant-operator-controller-manager-86878c769f-752vn\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.427850 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.427829 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-752vn\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.436338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.436276 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7hkv\" (UniqueName: \"kubernetes.io/projected/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-kube-api-access-t7hkv\") pod \"kuadrant-operator-controller-manager-86878c769f-752vn\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.502924 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.502889 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.653335 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.653308 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn"] Jun 12 18:48:49.656351 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:48:49.656326 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ff1fb1_620d_47c7_9c3f_4cbefe497d5d.slice/crio-41b61d456726011c0a6403d6fb1ce5f0f7eec2d9dd9cfd62385e1ca8089867cf WatchSource:0}: Error finding container 41b61d456726011c0a6403d6fb1ce5f0f7eec2d9dd9cfd62385e1ca8089867cf: Status 404 returned error can't find the container with id 41b61d456726011c0a6403d6fb1ce5f0f7eec2d9dd9cfd62385e1ca8089867cf Jun 12 18:48:49.911836 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.911800 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" event={"ID":"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d","Type":"ContainerStarted","Data":"ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d"} Jun 12 18:48:49.912301 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.911865 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" event={"ID":"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d","Type":"ContainerStarted","Data":"41b61d456726011c0a6403d6fb1ce5f0f7eec2d9dd9cfd62385e1ca8089867cf"} Jun 12 18:48:49.912301 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.911922 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:48:49.935995 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:48:49.935938 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" podStartSLOduration=0.935921657 podStartE2EDuration="935.921657ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:48:49.933637677 +0000 UTC m=+630.750950905" watchObservedRunningTime="2026-06-12 18:48:49.935921657 +0000 UTC m=+630.753234886" Jun 12 18:49:00.918743 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:00.918711 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 18:49:00.975990 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:00.975954 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs"] Jun 12 18:49:00.976425 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:00.976319 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" podUID="616741dc-de1c-4de4-8e25-e57792293dee" containerName="manager" containerID="cri-o://a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a" gracePeriod=10 Jun 12 18:49:01.224573 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.224545 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:49:01.337274 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.337244 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fhmv\" (UniqueName: \"kubernetes.io/projected/616741dc-de1c-4de4-8e25-e57792293dee-kube-api-access-5fhmv\") pod \"616741dc-de1c-4de4-8e25-e57792293dee\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " Jun 12 18:49:01.337444 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.337296 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/616741dc-de1c-4de4-8e25-e57792293dee-extensions-socket-volume\") pod \"616741dc-de1c-4de4-8e25-e57792293dee\" (UID: \"616741dc-de1c-4de4-8e25-e57792293dee\") " Jun 12 18:49:01.337689 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.337660 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616741dc-de1c-4de4-8e25-e57792293dee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "616741dc-de1c-4de4-8e25-e57792293dee" (UID: "616741dc-de1c-4de4-8e25-e57792293dee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:49:01.339327 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.339304 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616741dc-de1c-4de4-8e25-e57792293dee-kube-api-access-5fhmv" (OuterVolumeSpecName: "kube-api-access-5fhmv") pod "616741dc-de1c-4de4-8e25-e57792293dee" (UID: "616741dc-de1c-4de4-8e25-e57792293dee"). InnerVolumeSpecName "kube-api-access-5fhmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:49:01.438640 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.438611 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fhmv\" (UniqueName: \"kubernetes.io/projected/616741dc-de1c-4de4-8e25-e57792293dee-kube-api-access-5fhmv\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:49:01.438640 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.438637 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/616741dc-de1c-4de4-8e25-e57792293dee-extensions-socket-volume\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:49:01.963521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.963434 2571 generic.go:356] "Generic (PLEG): container finished" podID="616741dc-de1c-4de4-8e25-e57792293dee" containerID="a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a" exitCode=0 Jun 12 18:49:01.963521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.963474 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" Jun 12 18:49:01.963521 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.963511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" event={"ID":"616741dc-de1c-4de4-8e25-e57792293dee","Type":"ContainerDied","Data":"a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a"} Jun 12 18:49:01.964069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.963561 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs" event={"ID":"616741dc-de1c-4de4-8e25-e57792293dee","Type":"ContainerDied","Data":"a873c03b1dfb61752ff6e44cde0f15083115442793a3beafe3e78dca4761209c"} Jun 12 18:49:01.964069 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.963582 2571 scope.go:117] "RemoveContainer" containerID="a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a" Jun 12 18:49:01.973588 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.973566 2571 scope.go:117] "RemoveContainer" containerID="a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a" Jun 12 18:49:01.973993 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:49:01.973972 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a\": container with ID starting with a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a not found: ID does not exist" containerID="a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a" Jun 12 18:49:01.974088 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.974008 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a"} err="failed to get container status \"a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a\": rpc error: code = NotFound desc = could not find container \"a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a\": container with ID starting with a087a36b5b8d9ae92c1259acb78334abd63dd3d6bf7865e444c6d9dfe987575a not found: ID does not exist" Jun 12 18:49:01.986649 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.986629 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs"] Jun 12 18:49:01.991920 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:01.991897 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-s22gs"] Jun 12 18:49:03.637040 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:03.637000 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616741dc-de1c-4de4-8e25-e57792293dee" path="/var/lib/kubelet/pods/616741dc-de1c-4de4-8e25-e57792293dee/volumes" Jun 12 18:49:17.910971 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.910935 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:17.911379 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.911269 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616741dc-de1c-4de4-8e25-e57792293dee" containerName="manager" Jun 12 18:49:17.911379 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.911281 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="616741dc-de1c-4de4-8e25-e57792293dee" containerName="manager" Jun 12 18:49:17.911379 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.911330 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="616741dc-de1c-4de4-8e25-e57792293dee" containerName="manager" Jun 12 18:49:17.914253 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.914237 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:17.918869 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.918846 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6qczc\"" Jun 12 18:49:17.919000 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.918848 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 18:49:17.931243 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:17.931215 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:18.009305 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.009268 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:18.083046 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.083001 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe10d4de-07b6-4188-8d00-15a9acf779ce-config-file\") pod \"limitador-limitador-64c94fd64f-f7mzb\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.083336 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.083079 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2sn\" (UniqueName: \"kubernetes.io/projected/fe10d4de-07b6-4188-8d00-15a9acf779ce-kube-api-access-bx2sn\") pod \"limitador-limitador-64c94fd64f-f7mzb\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.184269 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.184176 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2sn\" (UniqueName: \"kubernetes.io/projected/fe10d4de-07b6-4188-8d00-15a9acf779ce-kube-api-access-bx2sn\") pod \"limitador-limitador-64c94fd64f-f7mzb\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.184433 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.184299 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe10d4de-07b6-4188-8d00-15a9acf779ce-config-file\") pod \"limitador-limitador-64c94fd64f-f7mzb\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.185025 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.185003 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe10d4de-07b6-4188-8d00-15a9acf779ce-config-file\") pod \"limitador-limitador-64c94fd64f-f7mzb\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.193264 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.193241 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2sn\" (UniqueName: \"kubernetes.io/projected/fe10d4de-07b6-4188-8d00-15a9acf779ce-kube-api-access-bx2sn\") pod \"limitador-limitador-64c94fd64f-f7mzb\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.224684 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.224651 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:18.363926 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:18.363894 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:18.367136 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:49:18.367110 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe10d4de_07b6_4188_8d00_15a9acf779ce.slice/crio-17457bbc16f70e7ac4b1947f9002c9b13f97f73450cebad297e7bac634f671fb WatchSource:0}: Error finding container 17457bbc16f70e7ac4b1947f9002c9b13f97f73450cebad297e7bac634f671fb: Status 404 returned error can't find the container with id 17457bbc16f70e7ac4b1947f9002c9b13f97f73450cebad297e7bac634f671fb Jun 12 18:49:19.049774 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:19.049678 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" event={"ID":"fe10d4de-07b6-4188-8d00-15a9acf779ce","Type":"ContainerStarted","Data":"17457bbc16f70e7ac4b1947f9002c9b13f97f73450cebad297e7bac634f671fb"} Jun 12 18:49:22.064766 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:22.064714 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" event={"ID":"fe10d4de-07b6-4188-8d00-15a9acf779ce","Type":"ContainerStarted","Data":"2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c"} Jun 12 18:49:22.065133 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:22.064807 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:22.094667 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:22.094625 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" podStartSLOduration=2.276896823 podStartE2EDuration="5.094607724s" totalImagesPullingTime="2.817710901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:49:22.093502052 +0000 UTC m=+662.910815291" watchObservedRunningTime="2026-06-12 18:49:22.094607724 +0000 UTC m=+662.911920971" Jun 12 18:49:33.070393 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:33.070353 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:34.773617 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:34.773582 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:34.774006 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:34.773784 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" podUID="fe10d4de-07b6-4188-8d00-15a9acf779ce" containerName="limitador" containerID="cri-o://2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c" gracePeriod=30 Jun 12 18:49:35.325106 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.325085 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:35.416144 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.416046 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx2sn\" (UniqueName: \"kubernetes.io/projected/fe10d4de-07b6-4188-8d00-15a9acf779ce-kube-api-access-bx2sn\") pod \"fe10d4de-07b6-4188-8d00-15a9acf779ce\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " Jun 12 18:49:35.416298 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.416182 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe10d4de-07b6-4188-8d00-15a9acf779ce-config-file\") pod \"fe10d4de-07b6-4188-8d00-15a9acf779ce\" (UID: \"fe10d4de-07b6-4188-8d00-15a9acf779ce\") " Jun 12 18:49:35.416543 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.416514 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe10d4de-07b6-4188-8d00-15a9acf779ce-config-file" (OuterVolumeSpecName: "config-file") pod "fe10d4de-07b6-4188-8d00-15a9acf779ce" (UID: "fe10d4de-07b6-4188-8d00-15a9acf779ce"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:49:35.418239 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.418212 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe10d4de-07b6-4188-8d00-15a9acf779ce-kube-api-access-bx2sn" (OuterVolumeSpecName: "kube-api-access-bx2sn") pod "fe10d4de-07b6-4188-8d00-15a9acf779ce" (UID: "fe10d4de-07b6-4188-8d00-15a9acf779ce"). InnerVolumeSpecName "kube-api-access-bx2sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:49:35.517164 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.517124 2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fe10d4de-07b6-4188-8d00-15a9acf779ce-config-file\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:49:35.517164 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:35.517155 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx2sn\" (UniqueName: \"kubernetes.io/projected/fe10d4de-07b6-4188-8d00-15a9acf779ce-kube-api-access-bx2sn\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:49:36.127693 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.127659 2571 generic.go:356] "Generic (PLEG): container finished" podID="fe10d4de-07b6-4188-8d00-15a9acf779ce" containerID="2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c" exitCode=0 Jun 12 18:49:36.128138 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.127705 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" Jun 12 18:49:36.128138 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.127724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" event={"ID":"fe10d4de-07b6-4188-8d00-15a9acf779ce","Type":"ContainerDied","Data":"2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c"} Jun 12 18:49:36.128138 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.127781 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-f7mzb" event={"ID":"fe10d4de-07b6-4188-8d00-15a9acf779ce","Type":"ContainerDied","Data":"17457bbc16f70e7ac4b1947f9002c9b13f97f73450cebad297e7bac634f671fb"} Jun 12 18:49:36.128138 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.127804 2571 scope.go:117] "RemoveContainer" containerID="2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c" Jun 12 18:49:36.135876 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.135860 2571 scope.go:117] "RemoveContainer" containerID="2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c" Jun 12 18:49:36.136119 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:49:36.136100 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c\": container with ID starting with 2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c not found: ID does not exist" containerID="2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c" Jun 12 18:49:36.136208 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.136124 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c"} err="failed to get container status \"2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c\": rpc error: code = NotFound desc = could not find container \"2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c\": container with ID starting with 2c318d38891493508ce712cef8aa39fe172b8a1188b559af528b22fdc23fcb8c not found: ID does not exist" Jun 12 18:49:36.147473 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.147446 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:36.153724 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:36.153699 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-f7mzb"] Jun 12 18:49:37.637387 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:37.637354 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe10d4de-07b6-4188-8d00-15a9acf779ce" path="/var/lib/kubelet/pods/fe10d4de-07b6-4188-8d00-15a9acf779ce/volumes" Jun 12 18:49:39.057855 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.057820 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-shdl2"] Jun 12 18:49:39.058232 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.058139 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe10d4de-07b6-4188-8d00-15a9acf779ce" containerName="limitador" Jun 12 18:49:39.058232 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.058151 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe10d4de-07b6-4188-8d00-15a9acf779ce" containerName="limitador" Jun 12 18:49:39.058232 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.058197 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe10d4de-07b6-4188-8d00-15a9acf779ce" containerName="limitador" Jun 12 18:49:39.062536 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.062518 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.065308 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.065287 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 12 18:49:39.072924 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.072899 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-shdl2"] Jun 12 18:49:39.150308 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.150274 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f7a06280-ee36-4e94-8162-d87682dc16a3-data\") pod \"postgres-69fb4594cf-shdl2\" (UID: \"f7a06280-ee36-4e94-8162-d87682dc16a3\") " pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.150474 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.150333 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92fc9\" (UniqueName: \"kubernetes.io/projected/f7a06280-ee36-4e94-8162-d87682dc16a3-kube-api-access-92fc9\") pod \"postgres-69fb4594cf-shdl2\" (UID: \"f7a06280-ee36-4e94-8162-d87682dc16a3\") " pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.251659 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.251608 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f7a06280-ee36-4e94-8162-d87682dc16a3-data\") pod \"postgres-69fb4594cf-shdl2\" (UID: \"f7a06280-ee36-4e94-8162-d87682dc16a3\") " pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.251880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.251679 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92fc9\" (UniqueName: \"kubernetes.io/projected/f7a06280-ee36-4e94-8162-d87682dc16a3-kube-api-access-92fc9\") pod \"postgres-69fb4594cf-shdl2\" (UID: \"f7a06280-ee36-4e94-8162-d87682dc16a3\") " pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.252043 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.252023 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f7a06280-ee36-4e94-8162-d87682dc16a3-data\") pod \"postgres-69fb4594cf-shdl2\" (UID: \"f7a06280-ee36-4e94-8162-d87682dc16a3\") " pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.260207 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.260179 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92fc9\" (UniqueName: \"kubernetes.io/projected/f7a06280-ee36-4e94-8162-d87682dc16a3-kube-api-access-92fc9\") pod \"postgres-69fb4594cf-shdl2\" (UID: \"f7a06280-ee36-4e94-8162-d87682dc16a3\") " pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.372904 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.372800 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:39.503917 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.503726 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-shdl2"] Jun 12 18:49:39.506786 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:49:39.506738 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a06280_ee36_4e94_8162_d87682dc16a3.slice/crio-b9fef0d33460c20d9dcb76442d1e20cfde964fafabf10281d42da0a6c6602494 WatchSource:0}: Error finding container b9fef0d33460c20d9dcb76442d1e20cfde964fafabf10281d42da0a6c6602494: Status 404 returned error can't find the container with id b9fef0d33460c20d9dcb76442d1e20cfde964fafabf10281d42da0a6c6602494 Jun 12 18:49:39.508043 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:39.508027 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:49:40.146738 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:40.146706 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-shdl2" event={"ID":"f7a06280-ee36-4e94-8162-d87682dc16a3","Type":"ContainerStarted","Data":"b9fef0d33460c20d9dcb76442d1e20cfde964fafabf10281d42da0a6c6602494"} Jun 12 18:49:43.163845 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:43.163801 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-shdl2" event={"ID":"f7a06280-ee36-4e94-8162-d87682dc16a3","Type":"ContainerStarted","Data":"6168165e16c5c7fb9890e4c315eb71868b7a531c83dd9d432aa6eca1f14c061d"} Jun 12 18:49:43.164228 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:43.163935 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:49:43.181007 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:43.180959 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-shdl2" podStartSLOduration=1.053691509 podStartE2EDuration="4.180942889s" totalImagesPullingTime="3.12725138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:49:43.179797494 +0000 UTC m=+683.997110724" watchObservedRunningTime="2026-06-12 18:49:43.180942889 +0000 UTC m=+683.998256118" Jun 12 18:49:49.200033 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:49:49.200005 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-shdl2" Jun 12 18:50:14.014290 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.014210 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:50:14.017449 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.017433 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:14.020131 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.020102 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:50:14.020266 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.020112 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jpvfl\"" Jun 12 18:50:14.020266 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.020152 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 18:50:14.020266 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.020205 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:50:14.027787 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.027748 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:50:14.155869 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.155826 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbdg8\" (UniqueName: \"kubernetes.io/projected/cb45ec6d-3228-4ba6-8518-f75af7323cdc-kube-api-access-pbdg8\") pod \"maas-keycloak-0\" (UID: \"cb45ec6d-3228-4ba6-8518-f75af7323cdc\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:14.256421 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.256376 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbdg8\" (UniqueName: \"kubernetes.io/projected/cb45ec6d-3228-4ba6-8518-f75af7323cdc-kube-api-access-pbdg8\") pod \"maas-keycloak-0\" (UID: \"cb45ec6d-3228-4ba6-8518-f75af7323cdc\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:14.268829 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.268745 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbdg8\" (UniqueName: \"kubernetes.io/projected/cb45ec6d-3228-4ba6-8518-f75af7323cdc-kube-api-access-pbdg8\") pod \"maas-keycloak-0\" (UID: \"cb45ec6d-3228-4ba6-8518-f75af7323cdc\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:14.327815 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.327775 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:14.472698 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:14.472661 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:50:14.476278 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:50:14.476250 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb45ec6d_3228_4ba6_8518_f75af7323cdc.slice/crio-7a1df82673e62941600520f3c1b536bad212df2c944a4345f7e124a60ad97f5a WatchSource:0}: Error finding container 7a1df82673e62941600520f3c1b536bad212df2c944a4345f7e124a60ad97f5a: Status 404 returned error can't find the container with id 7a1df82673e62941600520f3c1b536bad212df2c944a4345f7e124a60ad97f5a Jun 12 18:50:15.308773 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:15.308715 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb45ec6d-3228-4ba6-8518-f75af7323cdc","Type":"ContainerStarted","Data":"7a1df82673e62941600520f3c1b536bad212df2c944a4345f7e124a60ad97f5a"} Jun 12 18:50:19.331445 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:19.331411 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb45ec6d-3228-4ba6-8518-f75af7323cdc","Type":"ContainerStarted","Data":"a34c278b02e8cd73e542a18504ba718198e480306b6d6fd27005a4a0d6d4e0df"} Jun 12 18:50:19.351500 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:19.351445 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.590029133 podStartE2EDuration="6.351426922s" totalImagesPullingTime="4.761397789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:50:19.348797587 +0000 UTC m=+720.166110815" watchObservedRunningTime="2026-06-12 18:50:19.351426922 +0000 UTC m=+720.168740209" Jun 12 18:50:20.328540 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:20.328492 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:20.330113 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:20.330078 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:21.328553 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:21.328500 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:22.328810 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:22.328767 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:23.329104 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:23.329057 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:24.328948 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:24.328256 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:24.328948 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:24.328534 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:25.329175 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:25.329132 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:26.329041 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:26.328992 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:27.328937 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:27.328877 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:28.328733 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:28.328688 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:29.328855 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:29.328801 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:30.329386 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:30.329333 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:31.328847 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:31.328793 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:32.328583 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:32.328549 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused" Jun 12 18:50:33.441522 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:33.441484 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:33.460944 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:33.460889 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:50:43.449356 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:43.449320 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:50:49.842524 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.842481 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b476dfc79-drhwk"] Jun 12 18:50:49.845573 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.845547 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:49.848960 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.848865 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 18:50:49.849298 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.849278 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fcrts\"" Jun 12 18:50:49.849788 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.849769 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 18:50:49.867061 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.867031 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b476dfc79-drhwk"] Jun 12 18:50:49.994547 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.994506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frld8\" (UniqueName: \"kubernetes.io/projected/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-kube-api-access-frld8\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:49.994740 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:49.994590 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.095999 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.095907 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frld8\" (UniqueName: \"kubernetes.io/projected/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-kube-api-access-frld8\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.095999 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.095975 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.096184 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:50:50.096091 2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 12 18:50:50.096184 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:50:50.096153 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert podName:4ef25f86-c00f-434e-8f59-7b6d2597fb0c nodeName:}" failed. No retries permitted until 2026-06-12 18:50:50.596137543 +0000 UTC m=+751.413450751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert") pod "maas-controller-5b476dfc79-drhwk" (UID: "4ef25f86-c00f-434e-8f59-7b6d2597fb0c") : secret "maas-controller-webhook-cert" not found Jun 12 18:50:50.107604 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.107577 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frld8\" (UniqueName: \"kubernetes.io/projected/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-kube-api-access-frld8\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.599630 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.599587 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.602113 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.602080 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert\") pod \"maas-controller-5b476dfc79-drhwk\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.757423 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.757381 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:50.893261 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:50.893177 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b476dfc79-drhwk"] Jun 12 18:50:50.899091 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:50:50.899039 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef25f86_c00f_434e_8f59_7b6d2597fb0c.slice/crio-2ab853c9b610926f60ff92beb5bb0e7d2f69cc6635d5b3f4b2e2842e3b26ff84 WatchSource:0}: Error finding container 2ab853c9b610926f60ff92beb5bb0e7d2f69cc6635d5b3f4b2e2842e3b26ff84: Status 404 returned error can't find the container with id 2ab853c9b610926f60ff92beb5bb0e7d2f69cc6635d5b3f4b2e2842e3b26ff84 Jun 12 18:50:51.513486 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:51.513448 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b476dfc79-drhwk" event={"ID":"4ef25f86-c00f-434e-8f59-7b6d2597fb0c","Type":"ContainerStarted","Data":"2ab853c9b610926f60ff92beb5bb0e7d2f69cc6635d5b3f4b2e2842e3b26ff84"} Jun 12 18:50:53.524328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:53.524296 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b476dfc79-drhwk" event={"ID":"4ef25f86-c00f-434e-8f59-7b6d2597fb0c","Type":"ContainerStarted","Data":"3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372"} Jun 12 18:50:53.524828 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:53.524399 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:50:53.547964 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:50:53.547913 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b476dfc79-drhwk" podStartSLOduration=2.713499431 podStartE2EDuration="4.547898344s" totalImagesPullingTime="1.834398913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:50:53.5474798 +0000 UTC m=+754.364793030" watchObservedRunningTime="2026-06-12 18:50:53.547898344 +0000 UTC m=+754.365211574" Jun 12 18:51:04.300229 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.300196 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b476dfc79-drhwk"] Jun 12 18:51:04.300704 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.300440 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5b476dfc79-drhwk" podUID="4ef25f86-c00f-434e-8f59-7b6d2597fb0c" containerName="manager" containerID="cri-o://3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372" gracePeriod=30 Jun 12 18:51:04.308073 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.308048 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:51:04.546560 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.546534 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:51:04.575079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.574987 2571 generic.go:356] "Generic (PLEG): container finished" podID="4ef25f86-c00f-434e-8f59-7b6d2597fb0c" containerID="3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372" exitCode=0 Jun 12 18:51:04.575079 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.575029 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b476dfc79-drhwk" Jun 12 18:51:04.575299 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.575077 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b476dfc79-drhwk" event={"ID":"4ef25f86-c00f-434e-8f59-7b6d2597fb0c","Type":"ContainerDied","Data":"3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372"} Jun 12 18:51:04.575299 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.575121 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b476dfc79-drhwk" event={"ID":"4ef25f86-c00f-434e-8f59-7b6d2597fb0c","Type":"ContainerDied","Data":"2ab853c9b610926f60ff92beb5bb0e7d2f69cc6635d5b3f4b2e2842e3b26ff84"} Jun 12 18:51:04.575299 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.575145 2571 scope.go:117] "RemoveContainer" containerID="3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372" Jun 12 18:51:04.583668 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.583649 2571 scope.go:117] "RemoveContainer" containerID="3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372" Jun 12 18:51:04.583977 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:51:04.583957 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372\": container with ID starting with 3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372 not found: ID does not exist" containerID="3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372" Jun 12 18:51:04.584041 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.583988 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372"} err="failed to get container status \"3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372\": rpc error: code = NotFound desc = could not find container \"3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372\": container with ID starting with 3dd8f407300c229f40f38055fe6b701225766772c0bf977049d69cf3d8f67372 not found: ID does not exist" Jun 12 18:51:04.605976 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.605943 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frld8\" (UniqueName: \"kubernetes.io/projected/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-kube-api-access-frld8\") pod \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " Jun 12 18:51:04.608104 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.608072 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-kube-api-access-frld8" (OuterVolumeSpecName: "kube-api-access-frld8") pod "4ef25f86-c00f-434e-8f59-7b6d2597fb0c" (UID: "4ef25f86-c00f-434e-8f59-7b6d2597fb0c"). InnerVolumeSpecName "kube-api-access-frld8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:51:04.706607 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.706568 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert\") pod \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\" (UID: \"4ef25f86-c00f-434e-8f59-7b6d2597fb0c\") " Jun 12 18:51:04.706813 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.706736 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frld8\" (UniqueName: \"kubernetes.io/projected/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-kube-api-access-frld8\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:51:04.708608 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.708585 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4ef25f86-c00f-434e-8f59-7b6d2597fb0c" (UID: "4ef25f86-c00f-434e-8f59-7b6d2597fb0c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:51:04.807361 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.807328 2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ef25f86-c00f-434e-8f59-7b6d2597fb0c-webhook-cert\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:51:04.897299 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.897270 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b476dfc79-drhwk"] Jun 12 18:51:04.901076 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:04.901052 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b476dfc79-drhwk"] Jun 12 18:51:05.637932 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:05.637899 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef25f86-c00f-434e-8f59-7b6d2597fb0c" path="/var/lib/kubelet/pods/4ef25f86-c00f-434e-8f59-7b6d2597fb0c/volumes" Jun 12 18:51:24.097018 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.096979 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5f54577c6b-kdvqz"] Jun 12 18:51:24.097486 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.097309 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef25f86-c00f-434e-8f59-7b6d2597fb0c" containerName="manager" Jun 12 18:51:24.097486 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.097322 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef25f86-c00f-434e-8f59-7b6d2597fb0c" containerName="manager" Jun 12 18:51:24.097486 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.097394 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef25f86-c00f-434e-8f59-7b6d2597fb0c" containerName="manager" Jun 12 18:51:24.101601 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.101583 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.104173 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.104150 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 12 18:51:24.104276 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.104201 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ph477\"" Jun 12 18:51:24.110186 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.110162 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f54577c6b-kdvqz"] Jun 12 18:51:24.151130 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.151089 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njshp\" (UniqueName: \"kubernetes.io/projected/8cca1675-c4a3-42f7-8679-454ac6495556-kube-api-access-njshp\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.151130 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.151128 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cca1675-c4a3-42f7-8679-454ac6495556-maas-api-tls\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.151345 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.151162 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cca1675-c4a3-42f7-8679-454ac6495556-openshift-service-ca\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.252471 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.252424 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cca1675-c4a3-42f7-8679-454ac6495556-openshift-service-ca\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.252650 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.252510 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njshp\" (UniqueName: \"kubernetes.io/projected/8cca1675-c4a3-42f7-8679-454ac6495556-kube-api-access-njshp\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.252650 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.252532 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cca1675-c4a3-42f7-8679-454ac6495556-maas-api-tls\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.252650 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:51:24.252635 2571 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 12 18:51:24.252814 ip-10-0-141-181 kubenswrapper[2571]: E0612 18:51:24.252691 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cca1675-c4a3-42f7-8679-454ac6495556-maas-api-tls podName:8cca1675-c4a3-42f7-8679-454ac6495556 nodeName:}" failed. No retries permitted until 2026-06-12 18:51:24.752675284 +0000 UTC m=+785.569988490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8cca1675-c4a3-42f7-8679-454ac6495556-maas-api-tls") pod "maas-api-5f54577c6b-kdvqz" (UID: "8cca1675-c4a3-42f7-8679-454ac6495556") : secret "maas-api-serving-cert" not found Jun 12 18:51:24.253129 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.253107 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cca1675-c4a3-42f7-8679-454ac6495556-openshift-service-ca\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.261081 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.261045 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njshp\" (UniqueName: \"kubernetes.io/projected/8cca1675-c4a3-42f7-8679-454ac6495556-kube-api-access-njshp\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.583305 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.583263 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s4rcc"] Jun 12 18:51:24.586719 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.586695 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:51:24.589241 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.589219 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k2c2n\"" Jun 12 18:51:24.589684 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.589666 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 18:51:24.598808 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.598778 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s4rcc"] Jun 12 18:51:24.614855 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.614826 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-cgmbt"] Jun 12 18:51:24.618437 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.618418 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:24.629775 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.629730 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-cgmbt"] Jun 12 18:51:24.655972 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.655926 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z52vf\" (UniqueName: \"kubernetes.io/projected/c53b6ddc-0dc8-4785-984f-ae385656b4be-kube-api-access-z52vf\") pod \"payload-pre-processing-579785bc64-s4rcc\" (UID: \"c53b6ddc-0dc8-4785-984f-ae385656b4be\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:51:24.656169 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.656029 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrxbn\" (UniqueName: \"kubernetes.io/projected/d6f8b575-5dbb-44bd-91a3-45508d13370a-kube-api-access-hrxbn\") pod \"payload-processing-699b6cd6c-cgmbt\" (UID: \"d6f8b575-5dbb-44bd-91a3-45508d13370a\") " pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:24.757589 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.757556 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cca1675-c4a3-42f7-8679-454ac6495556-maas-api-tls\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.757796 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.757630 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z52vf\" (UniqueName: \"kubernetes.io/projected/c53b6ddc-0dc8-4785-984f-ae385656b4be-kube-api-access-z52vf\") pod \"payload-pre-processing-579785bc64-s4rcc\" (UID: \"c53b6ddc-0dc8-4785-984f-ae385656b4be\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:51:24.757796 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.757657 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxbn\" (UniqueName: \"kubernetes.io/projected/d6f8b575-5dbb-44bd-91a3-45508d13370a-kube-api-access-hrxbn\") pod \"payload-processing-699b6cd6c-cgmbt\" (UID: \"d6f8b575-5dbb-44bd-91a3-45508d13370a\") " pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:24.760095 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.760070 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cca1675-c4a3-42f7-8679-454ac6495556-maas-api-tls\") pod \"maas-api-5f54577c6b-kdvqz\" (UID: \"8cca1675-c4a3-42f7-8679-454ac6495556\") " pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:24.766109 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.766085 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z52vf\" (UniqueName: \"kubernetes.io/projected/c53b6ddc-0dc8-4785-984f-ae385656b4be-kube-api-access-z52vf\") pod \"payload-pre-processing-579785bc64-s4rcc\" (UID: \"c53b6ddc-0dc8-4785-984f-ae385656b4be\") " pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:51:24.766228 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.766129 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrxbn\" (UniqueName: \"kubernetes.io/projected/d6f8b575-5dbb-44bd-91a3-45508d13370a-kube-api-access-hrxbn\") pod \"payload-processing-699b6cd6c-cgmbt\" (UID: \"d6f8b575-5dbb-44bd-91a3-45508d13370a\") " pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:24.898709 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.898616 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:51:24.930172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:24.930135 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:25.013128 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.013095 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:25.057839 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.057803 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-s4rcc"] Jun 12 18:51:25.063109 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:51:25.063051 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53b6ddc_0dc8_4785_984f_ae385656b4be.slice/crio-14293d6e877fd4adb92c8a48a5caa236fbac64f5babedf5be08af224605b9af7 WatchSource:0}: Error finding container 14293d6e877fd4adb92c8a48a5caa236fbac64f5babedf5be08af224605b9af7: Status 404 returned error can't find the container with id 14293d6e877fd4adb92c8a48a5caa236fbac64f5babedf5be08af224605b9af7 Jun 12 18:51:25.091513 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.091474 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-cgmbt"] Jun 12 18:51:25.094226 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:51:25.094199 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f8b575_5dbb_44bd_91a3_45508d13370a.slice/crio-0617afa28709bd521a00a985dc0c95c06ee0425b1903a677de77708e7ae50f80 WatchSource:0}: Error finding container 0617afa28709bd521a00a985dc0c95c06ee0425b1903a677de77708e7ae50f80: Status 404 returned error can't find the container with id 0617afa28709bd521a00a985dc0c95c06ee0425b1903a677de77708e7ae50f80 Jun 12 18:51:25.163078 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.163053 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5f54577c6b-kdvqz"] Jun 12 18:51:25.164935 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:51:25.164908 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cca1675_c4a3_42f7_8679_454ac6495556.slice/crio-5abd71759992d91c1fc18f9ee4fab8b45bb7e293caebc81cb8c23a5c7cb553dc WatchSource:0}: Error finding container 5abd71759992d91c1fc18f9ee4fab8b45bb7e293caebc81cb8c23a5c7cb553dc: Status 404 returned error can't find the container with id 5abd71759992d91c1fc18f9ee4fab8b45bb7e293caebc81cb8c23a5c7cb553dc Jun 12 18:51:25.669346 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.669306 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" event={"ID":"d6f8b575-5dbb-44bd-91a3-45508d13370a","Type":"ContainerStarted","Data":"0617afa28709bd521a00a985dc0c95c06ee0425b1903a677de77708e7ae50f80"} Jun 12 18:51:25.674908 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.674871 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f54577c6b-kdvqz" event={"ID":"8cca1675-c4a3-42f7-8679-454ac6495556","Type":"ContainerStarted","Data":"5abd71759992d91c1fc18f9ee4fab8b45bb7e293caebc81cb8c23a5c7cb553dc"} Jun 12 18:51:25.676460 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:25.676378 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" event={"ID":"c53b6ddc-0dc8-4785-984f-ae385656b4be","Type":"ContainerStarted","Data":"14293d6e877fd4adb92c8a48a5caa236fbac64f5babedf5be08af224605b9af7"} Jun 12 18:51:28.692051 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.692011 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" event={"ID":"d6f8b575-5dbb-44bd-91a3-45508d13370a","Type":"ContainerStarted","Data":"a39f143caf590046ee7803dae206235818a522a9b85097d15e8ee96a2eb50ee6"} Jun 12 18:51:28.692537 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.692106 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:28.693807 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.693773 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5f54577c6b-kdvqz" event={"ID":"8cca1675-c4a3-42f7-8679-454ac6495556","Type":"ContainerStarted","Data":"1ca5707a6c1722e0fe5bcf161c6a59377443cf743bbc9168cff1c1edee03a6b1"} Jun 12 18:51:28.693960 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.693835 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:28.695347 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.695311 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" event={"ID":"c53b6ddc-0dc8-4785-984f-ae385656b4be","Type":"ContainerStarted","Data":"25b8289c633b8c62a71fd59fd0e117f1278b4415e80895e58d8253154ffc75cd"} Jun 12 18:51:28.695467 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.695378 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:51:28.708545 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.708464 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" podStartSLOduration=2.01484575 podStartE2EDuration="4.708447985s" totalImagesPullingTime="2.693602235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:28.707650646 +0000 UTC m=+789.524963880" watchObservedRunningTime="2026-06-12 18:51:28.708447985 +0000 UTC m=+789.525761213" Jun 12 18:51:28.728532 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.728481 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5f54577c6b-kdvqz" podStartSLOduration=2.104084725 podStartE2EDuration="4.728464633s" totalImagesPullingTime="2.624379908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:28.726865161 +0000 UTC m=+789.544178401" watchObservedRunningTime="2026-06-12 18:51:28.728464633 +0000 UTC m=+789.545777895" Jun 12 18:51:28.742424 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:28.742375 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" podStartSLOduration=2.009505441 podStartE2EDuration="4.742360416s" totalImagesPullingTime="2.732854975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:51:28.741197602 +0000 UTC m=+789.558510855" watchObservedRunningTime="2026-06-12 18:51:28.742360416 +0000 UTC m=+789.559673673" Jun 12 18:51:34.705564 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:34.705527 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5f54577c6b-kdvqz" Jun 12 18:51:39.702015 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:39.701939 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-cgmbt" Jun 12 18:51:39.702457 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:51:39.702181 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-s4rcc" Jun 12 18:53:38.804611 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:38.804565 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:53:38.805316 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:38.804777 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" containerID="cri-o://a34c278b02e8cd73e542a18504ba718198e480306b6d6fd27005a4a0d6d4e0df" gracePeriod=30 Jun 12 18:53:40.298355 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:40.298317 2571 generic.go:356] "Generic (PLEG): container finished" podID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerID="a34c278b02e8cd73e542a18504ba718198e480306b6d6fd27005a4a0d6d4e0df" exitCode=143 Jun 12 18:53:40.298722 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:40.298398 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb45ec6d-3228-4ba6-8518-f75af7323cdc","Type":"ContainerDied","Data":"a34c278b02e8cd73e542a18504ba718198e480306b6d6fd27005a4a0d6d4e0df"} Jun 12 18:53:40.848690 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:40.848655 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:40.934723 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:40.934695 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbdg8\" (UniqueName: \"kubernetes.io/projected/cb45ec6d-3228-4ba6-8518-f75af7323cdc-kube-api-access-pbdg8\") pod \"cb45ec6d-3228-4ba6-8518-f75af7323cdc\" (UID: \"cb45ec6d-3228-4ba6-8518-f75af7323cdc\") " Jun 12 18:53:40.936858 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:40.936824 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb45ec6d-3228-4ba6-8518-f75af7323cdc-kube-api-access-pbdg8" (OuterVolumeSpecName: "kube-api-access-pbdg8") pod "cb45ec6d-3228-4ba6-8518-f75af7323cdc" (UID: "cb45ec6d-3228-4ba6-8518-f75af7323cdc"). InnerVolumeSpecName "kube-api-access-pbdg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:53:41.035448 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.035411 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbdg8\" (UniqueName: \"kubernetes.io/projected/cb45ec6d-3228-4ba6-8518-f75af7323cdc-kube-api-access-pbdg8\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 18:53:41.304709 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.304625 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cb45ec6d-3228-4ba6-8518-f75af7323cdc","Type":"ContainerDied","Data":"7a1df82673e62941600520f3c1b536bad212df2c944a4345f7e124a60ad97f5a"} Jun 12 18:53:41.304709 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.304663 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.304709 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.304688 2571 scope.go:117] "RemoveContainer" containerID="a34c278b02e8cd73e542a18504ba718198e480306b6d6fd27005a4a0d6d4e0df" Jun 12 18:53:41.326943 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.326909 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:53:41.331397 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.331372 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:53:41.359766 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.359730 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:53:41.360147 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.360132 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" Jun 12 18:53:41.360193 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.360148 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" Jun 12 18:53:41.360228 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.360206 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" containerName="keycloak" Jun 12 18:53:41.364819 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.364803 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.367546 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.367510 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:53:41.367679 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.367584 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:53:41.367679 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.367650 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 18:53:41.367679 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.367668 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jpvfl\"" Jun 12 18:53:41.367870 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.367860 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 18:53:41.378172 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.378145 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:53:41.539662 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.539617 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhpbm\" (UniqueName: \"kubernetes.io/projected/f693e413-6286-491c-9f1d-65bcbdf6df0b-kube-api-access-vhpbm\") pod \"maas-keycloak-0\" (UID: \"f693e413-6286-491c-9f1d-65bcbdf6df0b\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.539873 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.539692 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f693e413-6286-491c-9f1d-65bcbdf6df0b-test-realms\") pod \"maas-keycloak-0\" (UID: \"f693e413-6286-491c-9f1d-65bcbdf6df0b\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.637322 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.637239 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb45ec6d-3228-4ba6-8518-f75af7323cdc" path="/var/lib/kubelet/pods/cb45ec6d-3228-4ba6-8518-f75af7323cdc/volumes" Jun 12 18:53:41.640693 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.640672 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f693e413-6286-491c-9f1d-65bcbdf6df0b-test-realms\") pod \"maas-keycloak-0\" (UID: \"f693e413-6286-491c-9f1d-65bcbdf6df0b\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.640775 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.640731 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhpbm\" (UniqueName: \"kubernetes.io/projected/f693e413-6286-491c-9f1d-65bcbdf6df0b-kube-api-access-vhpbm\") pod \"maas-keycloak-0\" (UID: \"f693e413-6286-491c-9f1d-65bcbdf6df0b\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.641382 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.641362 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f693e413-6286-491c-9f1d-65bcbdf6df0b-test-realms\") pod \"maas-keycloak-0\" (UID: \"f693e413-6286-491c-9f1d-65bcbdf6df0b\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.649633 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.649603 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhpbm\" (UniqueName: \"kubernetes.io/projected/f693e413-6286-491c-9f1d-65bcbdf6df0b-kube-api-access-vhpbm\") pod \"maas-keycloak-0\" (UID: \"f693e413-6286-491c-9f1d-65bcbdf6df0b\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.674624 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.674587 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:41.817469 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:41.817434 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:53:41.821006 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:53:41.820980 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf693e413_6286_491c_9f1d_65bcbdf6df0b.slice/crio-71bf7bd92d7bf73a96c47b440fe2609ab186db16fac21bd648a8c04fd3b071e4 WatchSource:0}: Error finding container 71bf7bd92d7bf73a96c47b440fe2609ab186db16fac21bd648a8c04fd3b071e4: Status 404 returned error can't find the container with id 71bf7bd92d7bf73a96c47b440fe2609ab186db16fac21bd648a8c04fd3b071e4 Jun 12 18:53:42.310987 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:42.310941 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f693e413-6286-491c-9f1d-65bcbdf6df0b","Type":"ContainerStarted","Data":"50bd1bb4b88044b0e60774d66bffb228c226925cdd62f04c45c7fd9de5c711bd"} Jun 12 18:53:42.311426 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:42.311014 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f693e413-6286-491c-9f1d-65bcbdf6df0b","Type":"ContainerStarted","Data":"71bf7bd92d7bf73a96c47b440fe2609ab186db16fac21bd648a8c04fd3b071e4"} Jun 12 18:53:42.339560 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:42.339506 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.976508491 podStartE2EDuration="1.339488584s" totalImagesPullingTime="362.980093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:53:42.337140513 +0000 UTC m=+923.154453742" watchObservedRunningTime="2026-06-12 18:53:42.339488584 +0000 UTC m=+923.156801865" Jun 12 18:53:42.674929 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:42.674890 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:42.676936 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:42.676893 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:43.675266 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:43.675214 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:44.675880 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:44.675831 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:45.675317 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:45.675266 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:46.675338 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:46.675286 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:47.675792 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:47.675726 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:48.675177 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:48.675114 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:49.675446 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:49.675389 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:50.675475 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:50.675423 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:51.674781 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:51.674715 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:51.675082 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:51.675047 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:52.675908 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:52.675859 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:53.675933 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:53.675890 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:54.675090 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:54.675051 2571 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 12 18:53:55.801876 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:55.801818 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 18:53:55.820831 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:53:55.820776 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f693e413-6286-491c-9f1d-65bcbdf6df0b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:54:05.809047 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:05.808995 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:54:33.868977 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.868944 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957"] Jun 12 18:54:33.873735 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.873710 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:33.876308 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.876285 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 18:54:33.877249 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.877226 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 18:54:33.877360 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.877228 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vz5g4\"" Jun 12 18:54:33.877360 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.877258 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 18:54:33.884192 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:33.884172 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957"] Jun 12 18:54:34.008783 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.008712 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.008974 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.008828 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43f910c-39f6-4733-9587-9edeac10e91c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.008974 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.008875 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.008974 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.008905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.008974 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.008955 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.009148 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.009032 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4gmz\" (UniqueName: \"kubernetes.io/projected/e43f910c-39f6-4733-9587-9edeac10e91c-kube-api-access-f4gmz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110064 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110018 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110064 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110060 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110095 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110113 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4gmz\" (UniqueName: \"kubernetes.io/projected/e43f910c-39f6-4733-9587-9edeac10e91c-kube-api-access-f4gmz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110135 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110328 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110166 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43f910c-39f6-4733-9587-9edeac10e91c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110489 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110471 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110619 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110592 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.110684 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.110652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.112416 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.112393 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e43f910c-39f6-4733-9587-9edeac10e91c-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.112655 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.112638 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e43f910c-39f6-4733-9587-9edeac10e91c-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.118056 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.118033 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4gmz\" (UniqueName: \"kubernetes.io/projected/e43f910c-39f6-4733-9587-9edeac10e91c-kube-api-access-f4gmz\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-fk957\" (UID: \"e43f910c-39f6-4733-9587-9edeac10e91c\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.184003 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.183924 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:34.324395 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.324353 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957"] Jun 12 18:54:34.328346 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:54:34.328318 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43f910c_39f6_4733_9587_9edeac10e91c.slice/crio-d5e0f7b8bba2cd369e990c9d62d2029b982eed81490b923c57c627657ca7363e WatchSource:0}: Error finding container d5e0f7b8bba2cd369e990c9d62d2029b982eed81490b923c57c627657ca7363e: Status 404 returned error can't find the container with id d5e0f7b8bba2cd369e990c9d62d2029b982eed81490b923c57c627657ca7363e Jun 12 18:54:34.585706 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:34.585670 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" event={"ID":"e43f910c-39f6-4733-9587-9edeac10e91c","Type":"ContainerStarted","Data":"d5e0f7b8bba2cd369e990c9d62d2029b982eed81490b923c57c627657ca7363e"} Jun 12 18:54:37.604302 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:37.604217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" event={"ID":"e43f910c-39f6-4733-9587-9edeac10e91c","Type":"ContainerStarted","Data":"2ac2e538bd17f81f7a89c8ba60483dd55df0cbd901c458e2cfab7bb1a47d83be"} Jun 12 18:54:39.614810 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:39.614777 2571 generic.go:356] "Generic (PLEG): container finished" podID="e43f910c-39f6-4733-9587-9edeac10e91c" containerID="2ac2e538bd17f81f7a89c8ba60483dd55df0cbd901c458e2cfab7bb1a47d83be" exitCode=0 Jun 12 18:54:39.615194 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:39.614837 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" event={"ID":"e43f910c-39f6-4733-9587-9edeac10e91c","Type":"ContainerDied","Data":"2ac2e538bd17f81f7a89c8ba60483dd55df0cbd901c458e2cfab7bb1a47d83be"} Jun 12 18:54:39.615416 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:39.615402 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:54:41.625368 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:41.625337 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" event={"ID":"e43f910c-39f6-4733-9587-9edeac10e91c","Type":"ContainerStarted","Data":"238bd644f1755efb87ec01e91272e782a7cdae73d7e153e548f751d3460087f0"} Jun 12 18:54:41.645827 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:41.645773 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" podStartSLOduration=3.318323278 podStartE2EDuration="8.645742373s" totalImagesPullingTime="4.000047291s" totalInitContainerRuntime="1.327371804s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:54:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:41.644340979 +0000 UTC m=+982.461654211" watchObservedRunningTime="2026-06-12 18:54:41.645742373 +0000 UTC m=+982.463055602" Jun 12 18:54:44.184816 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:44.184778 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:44.185180 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:44.184841 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:44.197725 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:44.197700 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:54:44.650789 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:54:44.650745 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-fk957" Jun 12 18:55:04.263211 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.263172 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x"] Jun 12 18:55:04.265991 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.265968 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.269677 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.269653 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 12 18:55:04.277716 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.277691 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x"] Jun 12 18:55:04.386828 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.386788 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.387028 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.386862 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.387028 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.386890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6rdl\" (UniqueName: \"kubernetes.io/projected/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-kube-api-access-t6rdl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.387028 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.386921 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.387184 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.387036 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.387184 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.387093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488212 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488171 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488414 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488222 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488414 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488265 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488414 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488324 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488414 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488383 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488414 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488406 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6rdl\" (UniqueName: \"kubernetes.io/projected/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-kube-api-access-t6rdl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488683 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488656 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.488742 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.488670 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.489097 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.489067 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.490892 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.490857 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.491094 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.491071 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.496792 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.496769 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6rdl\" (UniqueName: \"kubernetes.io/projected/f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b-kube-api-access-t6rdl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x\" (UID: \"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.576867 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.576735 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:55:04.721330 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:04.721251 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x"] Jun 12 18:55:04.724118 ip-10-0-141-181 kubenswrapper[2571]: W0612 18:55:04.724089 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24c4580_e0bb_4ec6_a3d4_09a2a3bf762b.slice/crio-e2f9d7a9a7aff225d4a2117b48188b0a976d14a7fa8160631bf2107b504d1b01 WatchSource:0}: Error finding container e2f9d7a9a7aff225d4a2117b48188b0a976d14a7fa8160631bf2107b504d1b01: Status 404 returned error can't find the container with id e2f9d7a9a7aff225d4a2117b48188b0a976d14a7fa8160631bf2107b504d1b01 Jun 12 18:55:05.733148 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:05.733111 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" event={"ID":"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b","Type":"ContainerStarted","Data":"4e69d1b2760267c71b08f256adb1f131d8c1cff88bce686f281c7b4af8881731"} Jun 12 18:55:05.733692 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:05.733170 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" event={"ID":"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b","Type":"ContainerStarted","Data":"e2f9d7a9a7aff225d4a2117b48188b0a976d14a7fa8160631bf2107b504d1b01"} Jun 12 18:55:19.349454 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.349409 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr"] Jun 12 18:55:19.353189 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.353164 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.355686 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.355659 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 18:55:19.366460 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.366434 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr"] Jun 12 18:55:19.520186 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.520147 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.520430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.520196 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq2jg\" (UniqueName: \"kubernetes.io/projected/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-kube-api-access-pq2jg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.520430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.520226 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.520430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.520305 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.520430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.520374 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.520430 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.520395 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621076 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621115 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq2jg\" (UniqueName: \"kubernetes.io/projected/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-kube-api-access-pq2jg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621158 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621160 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621478 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621194 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621478 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621213 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621600 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621556 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621600 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621587 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.621703 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.621622 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.623545 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.623512 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.623848 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.623829 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 12 18:55:19.629609 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.629586 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq2jg\" (UniqueName: \"kubernetes.io/projected/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-kube-api-access-pq2jg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.633921 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.633900 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86e4ca9d-48c1-4d71-a88d-c9356896ec0d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr\" (UID: \"86e4ca9d-48c1-4d71-a88d-c9356896ec0d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.666256 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.666218 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:19.810852 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:19.810816 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr"] Jun 12 18:55:20.810651 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:20.810609 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" event={"ID":"86e4ca9d-48c1-4d71-a88d-c9356896ec0d","Type":"ContainerStarted","Data":"1c25de124ffe8b7c0e8b8f081adc545237d1efadced7c04ff2dbafcad0f43320"} Jun 12 18:55:20.811053 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:20.810673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" event={"ID":"86e4ca9d-48c1-4d71-a88d-c9356896ec0d","Type":"ContainerStarted","Data":"07087944678c1762e85f899d4d4a3b4be0365bcd7393cf5334f9c4d9c9fb607a"} Jun 12 18:55:21.816206 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:21.816169 2571 generic.go:356] "Generic (PLEG): container finished" podID="86e4ca9d-48c1-4d71-a88d-c9356896ec0d" containerID="1c25de124ffe8b7c0e8b8f081adc545237d1efadced7c04ff2dbafcad0f43320" exitCode=0 Jun 12 18:55:21.816591 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:21.816238 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" event={"ID":"86e4ca9d-48c1-4d71-a88d-c9356896ec0d","Type":"ContainerDied","Data":"1c25de124ffe8b7c0e8b8f081adc545237d1efadced7c04ff2dbafcad0f43320"} Jun 12 18:55:22.822984 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:22.822944 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" event={"ID":"86e4ca9d-48c1-4d71-a88d-c9356896ec0d","Type":"ContainerStarted","Data":"7eba7429c9202cd2db24814533edc2cdbe763b335906d1f7b91f7074d32a0ceb"} Jun 12 18:55:22.842108 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:22.842051 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" podStartSLOduration=2.35852638 podStartE2EDuration="3.8420323s" totalImagesPullingTime="231.942491ms" totalInitContainerRuntime="1.251563429s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:55:22.840743068 +0000 UTC m=+1023.658056296" watchObservedRunningTime="2026-06-12 18:55:22.8420323 +0000 UTC m=+1023.659345531" Jun 12 18:55:29.666542 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:29.666497 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:29.666990 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:29.666561 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:29.679381 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:29.679354 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:29.868746 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:29.868715 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr" Jun 12 18:55:58.995297 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:58.995260 2571 generic.go:356] "Generic (PLEG): container finished" podID="f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b" containerID="4e69d1b2760267c71b08f256adb1f131d8c1cff88bce686f281c7b4af8881731" exitCode=0 Jun 12 18:55:58.995711 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:55:58.995332 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" event={"ID":"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b","Type":"ContainerDied","Data":"4e69d1b2760267c71b08f256adb1f131d8c1cff88bce686f281c7b4af8881731"} Jun 12 18:56:00.002118 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:56:00.002083 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" event={"ID":"f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b","Type":"ContainerStarted","Data":"4087317d0a32ca7adff074479ca633a96380b6e0c9b55a81e43f640ed88e06d9"} Jun 12 18:56:00.023252 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:56:00.023200 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" podStartSLOduration=1.837440665 podStartE2EDuration="56.023183538s" totalImagesPullingTime="186.388851ms" totalInitContainerRuntime="53.999354022s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:56:00.021669124 +0000 UTC m=+1060.838982356" watchObservedRunningTime="2026-06-12 18:56:00.023183538 +0000 UTC m=+1060.840496767" Jun 12 18:56:04.577829 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:56:04.577783 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:56:04.578315 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:56:04.577854 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:56:04.590773 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:56:04.590730 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 18:56:05.037078 ip-10-0-141-181 kubenswrapper[2571]: I0612 18:56:05.037048 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x" Jun 12 19:00:21.278255 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.278222 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7556944b6b-jx54l"] Jun 12 19:00:21.281799 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.281777 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.284211 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.284191 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 12 19:00:21.285159 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.285142 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 12 19:00:21.285265 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.285198 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fcrts\"" Jun 12 19:00:21.290689 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.290665 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7556944b6b-jx54l"] Jun 12 19:00:21.365710 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.365674 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/633dac6c-88af-4ed0-ab2f-d321345e6092-webhook-cert\") pod \"maas-controller-7556944b6b-jx54l\" (UID: \"633dac6c-88af-4ed0-ab2f-d321345e6092\") " pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.365912 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.365743 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftbqr\" (UniqueName: \"kubernetes.io/projected/633dac6c-88af-4ed0-ab2f-d321345e6092-kube-api-access-ftbqr\") pod \"maas-controller-7556944b6b-jx54l\" (UID: \"633dac6c-88af-4ed0-ab2f-d321345e6092\") " pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.466320 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.466269 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftbqr\" (UniqueName: \"kubernetes.io/projected/633dac6c-88af-4ed0-ab2f-d321345e6092-kube-api-access-ftbqr\") pod \"maas-controller-7556944b6b-jx54l\" (UID: \"633dac6c-88af-4ed0-ab2f-d321345e6092\") " pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.466496 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.466359 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/633dac6c-88af-4ed0-ab2f-d321345e6092-webhook-cert\") pod \"maas-controller-7556944b6b-jx54l\" (UID: \"633dac6c-88af-4ed0-ab2f-d321345e6092\") " pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.468739 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.468720 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/633dac6c-88af-4ed0-ab2f-d321345e6092-webhook-cert\") pod \"maas-controller-7556944b6b-jx54l\" (UID: \"633dac6c-88af-4ed0-ab2f-d321345e6092\") " pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.475570 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.475546 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftbqr\" (UniqueName: \"kubernetes.io/projected/633dac6c-88af-4ed0-ab2f-d321345e6092-kube-api-access-ftbqr\") pod \"maas-controller-7556944b6b-jx54l\" (UID: \"633dac6c-88af-4ed0-ab2f-d321345e6092\") " pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.592995 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.592909 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:21.731923 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.731894 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7556944b6b-jx54l"] Jun 12 19:00:21.733923 ip-10-0-141-181 kubenswrapper[2571]: W0612 19:00:21.733886 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633dac6c_88af_4ed0_ab2f_d321345e6092.slice/crio-c57545215497b640c50d9becda6a785fe9eacc59f26aeec08240f6fddd725cac WatchSource:0}: Error finding container c57545215497b640c50d9becda6a785fe9eacc59f26aeec08240f6fddd725cac: Status 404 returned error can't find the container with id c57545215497b640c50d9becda6a785fe9eacc59f26aeec08240f6fddd725cac Jun 12 19:00:21.735341 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:21.735322 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 19:00:22.256671 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:22.256639 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7556944b6b-jx54l" event={"ID":"633dac6c-88af-4ed0-ab2f-d321345e6092","Type":"ContainerStarted","Data":"9b13e0507aef20f1976a597fc9912381473c9b97ca3385828c6a392822c06efb"} Jun 12 19:00:22.256811 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:22.256699 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7556944b6b-jx54l" event={"ID":"633dac6c-88af-4ed0-ab2f-d321345e6092","Type":"ContainerStarted","Data":"c57545215497b640c50d9becda6a785fe9eacc59f26aeec08240f6fddd725cac"} Jun 12 19:00:22.256878 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:22.256807 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:00:22.274399 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:22.274354 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7556944b6b-jx54l" podStartSLOduration=0.831453059 podStartE2EDuration="1.274338831s" totalImagesPullingTime="442.885772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:00:22.272702377 +0000 UTC m=+1323.090015607" watchObservedRunningTime="2026-06-12 19:00:22.274338831 +0000 UTC m=+1323.091652060" Jun 12 19:00:33.267653 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:00:33.267615 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7556944b6b-jx54l" Jun 12 19:10:25.335235 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.335197 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn"] Jun 12 19:10:25.335985 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.335451 2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" podUID="a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" containerName="manager" containerID="cri-o://ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d" gracePeriod=10 Jun 12 19:10:25.598354 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.598292 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 19:10:25.723935 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.723902 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-extensions-socket-volume\") pod \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " Jun 12 19:10:25.724113 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.723943 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7hkv\" (UniqueName: \"kubernetes.io/projected/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-kube-api-access-t7hkv\") pod \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\" (UID: \"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d\") " Jun 12 19:10:25.724252 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.724217 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" (UID: "a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 19:10:25.726118 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.726093 2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-kube-api-access-t7hkv" (OuterVolumeSpecName: "kube-api-access-t7hkv") pod "a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" (UID: "a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d"). InnerVolumeSpecName "kube-api-access-t7hkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 19:10:25.824549 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.824512 2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-extensions-socket-volume\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 19:10:25.824549 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:25.824543 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7hkv\" (UniqueName: \"kubernetes.io/projected/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d-kube-api-access-t7hkv\") on node \"ip-10-0-141-181.ec2.internal\" DevicePath \"\"" Jun 12 19:10:26.166610 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.166574 2571 generic.go:356] "Generic (PLEG): container finished" podID="a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" containerID="ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d" exitCode=0 Jun 12 19:10:26.166834 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.166619 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" Jun 12 19:10:26.166834 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.166668 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" event={"ID":"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d","Type":"ContainerDied","Data":"ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d"} Jun 12 19:10:26.166834 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.166724 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn" event={"ID":"a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d","Type":"ContainerDied","Data":"41b61d456726011c0a6403d6fb1ce5f0f7eec2d9dd9cfd62385e1ca8089867cf"} Jun 12 19:10:26.166834 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.166767 2571 scope.go:117] "RemoveContainer" containerID="ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d" Jun 12 19:10:26.176567 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.176548 2571 scope.go:117] "RemoveContainer" containerID="ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d" Jun 12 19:10:26.176836 ip-10-0-141-181 kubenswrapper[2571]: E0612 19:10:26.176818 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d\": container with ID starting with ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d not found: ID does not exist" containerID="ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d" Jun 12 19:10:26.176890 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.176844 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d"} err="failed to get container status \"ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d\": rpc error: code = NotFound desc = could not find container \"ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d\": container with ID starting with ef3d4550113b57da4eaa7ea4f235eeda7155b51fb7c7816f2867568f7e518d0d not found: ID does not exist" Jun 12 19:10:26.189315 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.189293 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn"] Jun 12 19:10:26.192718 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:26.192697 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-752vn"] Jun 12 19:10:27.637139 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:10:27.637107 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" path="/var/lib/kubelet/pods/a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d/volumes" Jun 12 19:11:26.482518 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.482480 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w"] Jun 12 19:11:26.482991 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.482857 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" containerName="manager" Jun 12 19:11:26.482991 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.482870 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" containerName="manager" Jun 12 19:11:26.482991 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.482936 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ff1fb1-620d-47c7-9c3f-4cbefe497d5d" containerName="manager" Jun 12 19:11:26.487059 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.487038 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.490933 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.490906 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8dlhh\"" Jun 12 19:11:26.491046 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.491018 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 19:11:26.491046 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.491028 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 19:11:26.499575 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.499553 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w"] Jun 12 19:11:26.562336 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.562306 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb597\" (UniqueName: \"kubernetes.io/projected/47d73773-ce1b-4ee9-9f36-4acf02b99e64-kube-api-access-vb597\") pod \"kuadrant-operator-controller-manager-86878c769f-4h47w\" (UID: \"47d73773-ce1b-4ee9-9f36-4acf02b99e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.562506 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.562372 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47d73773-ce1b-4ee9-9f36-4acf02b99e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4h47w\" (UID: \"47d73773-ce1b-4ee9-9f36-4acf02b99e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.663603 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.663567 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47d73773-ce1b-4ee9-9f36-4acf02b99e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4h47w\" (UID: \"47d73773-ce1b-4ee9-9f36-4acf02b99e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.663808 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.663627 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb597\" (UniqueName: \"kubernetes.io/projected/47d73773-ce1b-4ee9-9f36-4acf02b99e64-kube-api-access-vb597\") pod \"kuadrant-operator-controller-manager-86878c769f-4h47w\" (UID: \"47d73773-ce1b-4ee9-9f36-4acf02b99e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.664000 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.663982 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47d73773-ce1b-4ee9-9f36-4acf02b99e64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4h47w\" (UID: \"47d73773-ce1b-4ee9-9f36-4acf02b99e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.672133 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.672109 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb597\" (UniqueName: \"kubernetes.io/projected/47d73773-ce1b-4ee9-9f36-4acf02b99e64-kube-api-access-vb597\") pod \"kuadrant-operator-controller-manager-86878c769f-4h47w\" (UID: \"47d73773-ce1b-4ee9-9f36-4acf02b99e64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.797011 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.796933 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:26.934080 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:26.934057 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w"] Jun 12 19:11:26.936475 ip-10-0-141-181 kubenswrapper[2571]: W0612 19:11:26.936446 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d73773_ce1b_4ee9_9f36_4acf02b99e64.slice/crio-5edfab3c1f77061a76d11c1198c65f1b15cd309a0f7dc85f422d0e5e62bfd8d1 WatchSource:0}: Error finding container 5edfab3c1f77061a76d11c1198c65f1b15cd309a0f7dc85f422d0e5e62bfd8d1: Status 404 returned error can't find the container with id 5edfab3c1f77061a76d11c1198c65f1b15cd309a0f7dc85f422d0e5e62bfd8d1 Jun 12 19:11:27.452899 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:27.452849 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" event={"ID":"47d73773-ce1b-4ee9-9f36-4acf02b99e64","Type":"ContainerStarted","Data":"8b2bfb03602214b920e7791f83593455c615e5a3eddef2924fd11082e37e74ab"} Jun 12 19:11:27.453086 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:27.452924 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" event={"ID":"47d73773-ce1b-4ee9-9f36-4acf02b99e64","Type":"ContainerStarted","Data":"5edfab3c1f77061a76d11c1198c65f1b15cd309a0f7dc85f422d0e5e62bfd8d1"} Jun 12 19:11:27.453086 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:27.453066 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:11:27.479384 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:27.479334 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" podStartSLOduration=1.479316229 podStartE2EDuration="1.479316229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 19:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:11:27.4734176 +0000 UTC m=+1988.290730829" watchObservedRunningTime="2026-06-12 19:11:27.479316229 +0000 UTC m=+1988.296629458" Jun 12 19:11:38.460585 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:11:38.460552 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4h47w" Jun 12 19:21:22.188686 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:22.188658 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-55f6479cff-8jqd8_a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da/nginx/0.log" Jun 12 19:21:22.432847 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:22.432821 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-p4bhn_8a994e59-deb6-4090-9c07-85a2e5aef3a8/manager/0.log" Jun 12 19:21:22.549878 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:22.549851 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hc7q7_b6060f2c-bfd1-44b7-879e-2d8f4b06371b/manager/0.log" Jun 12 19:21:22.667523 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:22.667495 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f54577c6b-kdvqz_8cca1675-c4a3-42f7-8679-454ac6495556/maas-api/0.log" Jun 12 19:21:23.007562 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:23.007505 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7556944b6b-jx54l_633dac6c-88af-4ed0-ab2f-d321345e6092/manager/0.log" Jun 12 19:21:23.117858 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:23.117832 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sf5z2_63134e23-dc57-451b-81ca-aaf18690b99f/server/0.log" Jun 12 19:21:23.234433 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:23.234404 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-z7szr_7e0074ce-1953-4ecd-a645-eeb0e1132338/manager/0.log" Jun 12 19:21:23.579388 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:23.579356 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc6c5cc78-tb2k5_4afca98d-6d96-44eb-8d57-cf2c095a6bdf/copy-manifests/0.log" Jun 12 19:21:23.592193 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:23.592160 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc6c5cc78-tb2k5_4afca98d-6d96-44eb-8d57-cf2c095a6bdf/manager/0.log" Jun 12 19:21:23.707018 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:23.706987 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-shdl2_f7a06280-ee36-4e94-8162-d87682dc16a3/postgres/0.log" Jun 12 19:21:25.574639 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:25.574604 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4h47w_47d73773-ce1b-4ee9-9f36-4acf02b99e64/manager/0.log" Jun 12 19:21:26.269043 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:26.269018 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sz6w5_18b0b814-9873-49bd-a5ad-491120b746a7/discovery/0.log" Jun 12 19:21:26.373672 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:26.373641 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9466d55b-lgxnq_585d538a-59ac-47de-bda3-ad21954742fc/kube-auth-proxy/0.log" Jun 12 19:21:26.731150 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:26.731124 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s4rcc_c53b6ddc-0dc8-4785-984f-ae385656b4be/payload-pre-processing/0.log" Jun 12 19:21:26.851724 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:26.851695 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cgmbt_d6f8b575-5dbb-44bd-91a3-45508d13370a/payload-processing/0.log" Jun 12 19:21:27.413984 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:27.413956 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fk957_e43f910c-39f6-4733-9587-9edeac10e91c/storage-initializer/0.log" Jun 12 19:21:27.422602 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:27.422576 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-fk957_e43f910c-39f6-4733-9587-9edeac10e91c/main/0.log" Jun 12 19:21:27.650147 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:27.650116 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x_f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b/storage-initializer/0.log" Jun 12 19:21:27.657789 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:27.657765 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxn97x_f24c4580-e0bb-4ec6-a3d4-09a2a3bf762b/main/0.log" Jun 12 19:21:27.767957 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:27.767931 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr_86e4ca9d-48c1-4d71-a88d-c9356896ec0d/storage-initializer/0.log" Jun 12 19:21:27.775963 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:27.775940 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-ww5vr_86e4ca9d-48c1-4d71-a88d-c9356896ec0d/main/0.log" Jun 12 19:21:34.862552 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:34.862518 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w4d76_ba4a2530-a5e7-4530-b7e8-a07b6c401ba8/global-pull-secret-syncer/0.log" Jun 12 19:21:34.988307 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:34.988277 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rj6jz_5f091a1a-4b22-49b7-9406-8f75ca5d1c37/konnectivity-agent/0.log" Jun 12 19:21:35.061981 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:35.061948 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-181.ec2.internal_513823f35fc74f143c6d0ffe57151679/haproxy/0.log" Jun 12 19:21:38.952659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:38.952583 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-d6z5k_81f04e3d-1172-415f-8e45-e75f45a89bb9/sail-operator/0.log" Jun 12 19:21:40.218572 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:40.218542 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-4h47w_47d73773-ce1b-4ee9-9f36-4acf02b99e64/manager/0.log" Jun 12 19:21:42.396896 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:42.396861 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m27cv_acfce14f-5ef3-4645-871d-d951b2cd902c/node-exporter/0.log" Jun 12 19:21:42.423430 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:42.423397 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m27cv_acfce14f-5ef3-4645-871d-d951b2cd902c/kube-rbac-proxy/0.log" Jun 12 19:21:42.447841 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:42.447813 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m27cv_acfce14f-5ef3-4645-871d-d951b2cd902c/init-textfile/0.log" Jun 12 19:21:42.869628 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:42.869599 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-5q9n4_9c369fd2-8d43-4240-bcb6-68e9122c3be8/prometheus-operator/0.log" Jun 12 19:21:42.897404 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:42.897375 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-5q9n4_9c369fd2-8d43-4240-bcb6-68e9122c3be8/kube-rbac-proxy/0.log" Jun 12 19:21:44.565658 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:44.565617 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-7mf2j_98fc618d-6053-4279-8be3-0147d2495949/networking-console-plugin/0.log" Jun 12 19:21:46.269261 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.269227 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2"] Jun 12 19:21:46.272813 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.272788 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.275394 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.275352 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g556j\"/\"openshift-service-ca.crt\"" Jun 12 19:21:46.275394 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.275391 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g556j\"/\"kube-root-ca.crt\"" Jun 12 19:21:46.275538 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.275502 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g556j\"/\"default-dockercfg-ltdpj\"" Jun 12 19:21:46.287165 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.286951 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2"] Jun 12 19:21:46.420470 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.420434 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-lib-modules\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.420678 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.420494 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-proc\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.420678 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.420561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-podres\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.420678 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.420579 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-sys\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.420678 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.420648 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcdz9\" (UniqueName: \"kubernetes.io/projected/61466af3-6c80-4258-b9ef-1c88dea99ce9-kube-api-access-mcdz9\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522298 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522189 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-podres\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522298 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522248 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-sys\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522298 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcdz9\" (UniqueName: \"kubernetes.io/projected/61466af3-6c80-4258-b9ef-1c88dea99ce9-kube-api-access-mcdz9\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522336 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-lib-modules\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522399 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-podres\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522407 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-proc\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522456 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-proc\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522557 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-lib-modules\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.522659 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.522490 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61466af3-6c80-4258-b9ef-1c88dea99ce9-sys\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.530371 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.530339 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcdz9\" (UniqueName: \"kubernetes.io/projected/61466af3-6c80-4258-b9ef-1c88dea99ce9-kube-api-access-mcdz9\") pod \"perf-node-gather-daemonset-gmbx2\" (UID: \"61466af3-6c80-4258-b9ef-1c88dea99ce9\") " pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.585295 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.585265 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:46.720541 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:46.720514 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2"] Jun 12 19:21:46.722845 ip-10-0-141-181 kubenswrapper[2571]: W0612 19:21:46.722812 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61466af3_6c80_4258_b9ef_1c88dea99ce9.slice/crio-4261d687ede2b2f8dfc221580fbb60c8c9ded2d8b5a65cabc131d0274bc99a01 WatchSource:0}: Error finding container 4261d687ede2b2f8dfc221580fbb60c8c9ded2d8b5a65cabc131d0274bc99a01: Status 404 returned error can't find the container with id 4261d687ede2b2f8dfc221580fbb60c8c9ded2d8b5a65cabc131d0274bc99a01 Jun 12 19:21:47.452966 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:47.452929 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" event={"ID":"61466af3-6c80-4258-b9ef-1c88dea99ce9","Type":"ContainerStarted","Data":"047094cf68ffd601683cc1020431123014f4462e9d0025234ef850719d1d21c8"} Jun 12 19:21:47.453393 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:47.452984 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" event={"ID":"61466af3-6c80-4258-b9ef-1c88dea99ce9","Type":"ContainerStarted","Data":"4261d687ede2b2f8dfc221580fbb60c8c9ded2d8b5a65cabc131d0274bc99a01"} Jun 12 19:21:47.453393 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:47.453030 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:47.469462 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:47.469390 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" podStartSLOduration=1.469367119 podStartE2EDuration="1.469367119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 19:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 19:21:47.468805094 +0000 UTC m=+2608.286118327" watchObservedRunningTime="2026-06-12 19:21:47.469367119 +0000 UTC m=+2608.286680352" Jun 12 19:21:47.932465 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:47.932419 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8hr6_253a8844-6bd5-4235-ace2-438275e231ea/dns/0.log" Jun 12 19:21:47.956325 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:47.956298 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8hr6_253a8844-6bd5-4235-ace2-438275e231ea/kube-rbac-proxy/0.log" Jun 12 19:21:48.092607 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:48.092572 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xw5bq_0ea0e87f-8b1f-4a0b-b20f-796703eed425/dns-node-resolver/0.log" Jun 12 19:21:48.649308 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:48.649274 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b8b995864-rh57z_e084b1fc-66ce-4eaa-a732-32fc515cb70e/registry/0.log" Jun 12 19:21:48.670832 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:48.670806 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7j7x2_4b0b1c8c-5cd1-457b-8fa3-a85616991fbe/node-ca/0.log" Jun 12 19:21:49.775503 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:49.775473 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sz6w5_18b0b814-9873-49bd-a5ad-491120b746a7/discovery/0.log" Jun 12 19:21:49.795023 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:49.794997 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9466d55b-lgxnq_585d538a-59ac-47de-bda3-ad21954742fc/kube-auth-proxy/0.log" Jun 12 19:21:49.947086 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:49.947052 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s4rcc_c53b6ddc-0dc8-4785-984f-ae385656b4be/payload-pre-processing/0.log" Jun 12 19:21:50.007303 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:50.007273 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cgmbt_d6f8b575-5dbb-44bd-91a3-45508d13370a/payload-processing/0.log" Jun 12 19:21:50.702095 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:50.702069 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n862q_0a744247-be6a-4fb4-8fb1-243bc547f48b/serve-healthcheck-canary/0.log" Jun 12 19:21:51.339811 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:51.339776 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k42c_3183726e-5b75-4631-8696-c551bd525152/kube-rbac-proxy/0.log" Jun 12 19:21:51.362129 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:51.362100 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k42c_3183726e-5b75-4631-8696-c551bd525152/exporter/0.log" Jun 12 19:21:51.384676 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:51.384648 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k42c_3183726e-5b75-4631-8696-c551bd525152/extractor/0.log" Jun 12 19:21:53.468344 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:53.468318 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g556j/perf-node-gather-daemonset-gmbx2" Jun 12 19:21:53.894998 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:53.894945 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-55f6479cff-8jqd8_a3d0dd03-3f3d-4cb6-bb76-bb8f1b00f4da/nginx/0.log" Jun 12 19:21:53.945513 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:53.945485 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-p4bhn_8a994e59-deb6-4090-9c07-85a2e5aef3a8/manager/0.log" Jun 12 19:21:54.021013 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.020979 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hc7q7_b6060f2c-bfd1-44b7-879e-2d8f4b06371b/manager/0.log" Jun 12 19:21:54.057292 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.057261 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5f54577c6b-kdvqz_8cca1675-c4a3-42f7-8679-454ac6495556/maas-api/0.log" Jun 12 19:21:54.178587 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.178511 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7556944b6b-jx54l_633dac6c-88af-4ed0-ab2f-d321345e6092/manager/0.log" Jun 12 19:21:54.199655 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.199628 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sf5z2_63134e23-dc57-451b-81ca-aaf18690b99f/server/0.log" Jun 12 19:21:54.252687 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.252656 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-z7szr_7e0074ce-1953-4ecd-a645-eeb0e1132338/manager/0.log" Jun 12 19:21:54.438551 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.438462 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc6c5cc78-tb2k5_4afca98d-6d96-44eb-8d57-cf2c095a6bdf/manager/0.log" Jun 12 19:21:54.455568 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.455540 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc6c5cc78-tb2k5_4afca98d-6d96-44eb-8d57-cf2c095a6bdf/copy-manifests/0.log" Jun 12 19:21:54.480272 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:21:54.480244 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-shdl2_f7a06280-ee36-4e94-8162-d87682dc16a3/postgres/0.log" Jun 12 19:22:00.353201 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:00.353161 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sz6w5_18b0b814-9873-49bd-a5ad-491120b746a7/discovery/0.log" Jun 12 19:22:00.364357 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:00.364331 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9466d55b-lgxnq_585d538a-59ac-47de-bda3-ad21954742fc/kube-auth-proxy/0.log" Jun 12 19:22:00.489048 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:00.489018 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s4rcc_c53b6ddc-0dc8-4785-984f-ae385656b4be/payload-pre-processing/0.log" Jun 12 19:22:00.538466 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:00.538436 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cgmbt_d6f8b575-5dbb-44bd-91a3-45508d13370a/payload-processing/0.log" Jun 12 19:22:01.772893 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:01.772860 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sz6w5_18b0b814-9873-49bd-a5ad-491120b746a7/discovery/0.log" Jun 12 19:22:01.789981 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:01.789950 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9466d55b-lgxnq_585d538a-59ac-47de-bda3-ad21954742fc/kube-auth-proxy/0.log" Jun 12 19:22:01.827993 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:01.827963 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-pgjqh_d6c50cb1-ccd4-41e1-9be6-7205bb930206/migrator/0.log" Jun 12 19:22:01.894376 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:01.894351 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-pgjqh_d6c50cb1-ccd4-41e1-9be6-7205bb930206/graceful-termination/0.log" Jun 12 19:22:01.923150 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:01.923123 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s4rcc_c53b6ddc-0dc8-4785-984f-ae385656b4be/payload-pre-processing/0.log" Jun 12 19:22:01.974688 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:01.974660 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cgmbt_d6f8b575-5dbb-44bd-91a3-45508d13370a/payload-processing/0.log" Jun 12 19:22:03.636931 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.636857 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-42n7k_50b2aecc-cc91-4152-b9ae-372efaa2dfd8/kube-multus/0.log" Jun 12 19:22:03.668061 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.668039 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/kube-multus-additional-cni-plugins/0.log" Jun 12 19:22:03.691695 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.691668 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/egress-router-binary-copy/0.log" Jun 12 19:22:03.714624 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.714595 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/cni-plugins/0.log" Jun 12 19:22:03.736429 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.736402 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/bond-cni-plugin/0.log" Jun 12 19:22:03.759128 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.759100 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/routeoverride-cni/0.log" Jun 12 19:22:03.760036 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.760020 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-sz6w5_18b0b814-9873-49bd-a5ad-491120b746a7/discovery/0.log" Jun 12 19:22:03.770569 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.770550 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f9466d55b-lgxnq_585d538a-59ac-47de-bda3-ad21954742fc/kube-auth-proxy/0.log" Jun 12 19:22:03.781080 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.781054 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/whereabouts-cni-bincopy/0.log" Jun 12 19:22:03.805334 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.805306 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bkz5q_22a420ce-3b09-41eb-81b1-31ee62bb7c1d/whereabouts-cni/0.log" Jun 12 19:22:03.887395 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.887295 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-s4rcc_c53b6ddc-0dc8-4785-984f-ae385656b4be/payload-pre-processing/0.log" Jun 12 19:22:03.935420 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:03.935390 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-cgmbt_d6f8b575-5dbb-44bd-91a3-45508d13370a/payload-processing/0.log" Jun 12 19:22:04.259629 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:04.259604 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-28pfq_eee93665-037c-49c4-b1e3-b7d46a5a2df9/network-metrics-daemon/0.log" Jun 12 19:22:04.284227 ip-10-0-141-181 kubenswrapper[2571]: I0612 19:22:04.284199 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-28pfq_eee93665-037c-49c4-b1e3-b7d46a5a2df9/kube-rbac-proxy/0.log"