Jun 11 19:50:28.153818 ip-10-0-138-225 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:50:28.542856 ip-10-0-138-225 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:50:28.542856 ip-10-0-138-225 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:50:28.542856 ip-10-0-138-225 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:50:28.543629 ip-10-0-138-225 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:50:28.543629 ip-10-0-138-225 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:50:28.543629 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.543120 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:50:28.546985 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.546962 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:28.546985 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.546982 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:28.546985 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.546988 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:28.546985 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.546992 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.546997 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547001 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547007 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547011 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547014 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547018 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547022 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547026 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547029 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547033 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547037 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547040 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547044 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547048 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547052 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547055 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547059 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547063 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547067 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:28.547236 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547071 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547076 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547093 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547097 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547101 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547105 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547118 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547123 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547128 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547132 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547136 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547140 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547145 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547149 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547154 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547158 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547162 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547167 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547171 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547174 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:28.548165 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547179 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547183 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547188 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547192 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547198 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547202 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547207 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547211 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547216 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547222 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547226 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547230 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547235 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547239 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547246 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547252 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547256 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547262 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547267 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:28.548840 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547274 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547280 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547285 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547290 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547294 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547299 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547304 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547310 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547314 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547319 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547323 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547327 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547331 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547335 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547343 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547347 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547351 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547355 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547360 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547365 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:28.549423 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547370 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547374 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547378 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547382 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547386 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547389 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547393 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547396 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547401 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547404 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547409 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547413 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547417 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547422 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547428 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547432 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.547435 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549248 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549259 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549265 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:28.550271 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549270 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549275 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549279 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549284 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549288 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549292 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549296 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549300 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549305 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549309 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549313 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549319 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549323 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549327 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549331 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549335 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549339 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549343 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549347 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549353 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:28.551143 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549357 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549361 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549365 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549369 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549374 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549378 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549382 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549387 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549391 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549395 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549399 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549404 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549409 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549413 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549417 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549421 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549425 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549429 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549433 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549437 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:28.552031 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549441 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549445 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549451 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549457 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549464 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549468 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549474 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549479 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549483 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549489 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549495 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549499 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549503 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549507 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549511 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549534 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549539 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549543 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549547 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:28.552696 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549553 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549557 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549561 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549565 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549570 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549574 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549579 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549584 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549588 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549592 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549596 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549600 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549604 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549608 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549612 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549616 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549621 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549625 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549630 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549634 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:28.553230 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549638 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549642 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549646 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549650 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549654 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549658 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549662 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549667 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549671 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549678 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549690 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549695 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549701 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549706 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549710 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549714 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.549718 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550330 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550339 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550343 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:28.553887 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550348 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550352 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550356 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550360 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550365 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550369 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550373 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550377 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550381 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550386 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550391 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550395 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550402 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550408 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550413 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550417 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550421 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550426 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550430 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:28.554484 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550435 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550439 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550444 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550448 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550452 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550456 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550460 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550464 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550468 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550472 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550477 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550482 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550486 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550490 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550496 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550502 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550508 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550534 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550539 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:28.554975 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550543 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550546 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550550 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550554 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550557 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550566 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550572 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550576 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550581 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550586 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550592 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550597 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550602 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550607 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550612 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550617 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550621 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550625 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550630 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550633 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:28.555531 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550637 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550641 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550645 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550649 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550654 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550658 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550662 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550666 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550670 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550674 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550678 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550682 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550687 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550691 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550695 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550699 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550703 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550707 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550712 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550716 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:28.556064 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550720 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550724 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550728 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550732 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550737 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550741 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550745 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550749 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550752 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550757 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550761 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550765 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550768 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550772 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550776 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550780 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550784 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.550788 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550890 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550913 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550922 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:50:28.556572 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550928 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550935 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550939 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550945 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550952 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550957 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550962 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550970 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550975 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550980 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550985 2580 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550990 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550995 2580 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.550999 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551007 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551015 2580 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551019 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551024 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551029 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551035 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551041 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551046 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551051 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:50:28.557082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551056 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551061 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551065 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551069 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551075 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551079 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551086 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551090 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551095 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551099 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551104 2580 flags.go:64] FLAG: --enable-server="true" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551108 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551115 2580 flags.go:64] FLAG: --event-burst="100" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551120 2580 flags.go:64] FLAG: --event-qps="50" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551124 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551129 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551135 2580 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551141 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551145 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551150 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551155 2580 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551160 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551164 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551170 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551175 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:50:28.557697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551179 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551184 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551188 2580 flags.go:64] FLAG: --feature-gates="" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551194 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551199 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551204 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551208 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551213 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551218 2580 flags.go:64] FLAG: --help="false" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551223 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551227 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551232 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551237 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551242 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551248 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551252 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551257 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551261 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551265 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551270 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551275 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551280 2580 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551284 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551291 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:50:28.558350 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551296 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551300 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551305 2580 flags.go:64] FLAG: --lock-file="" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551309 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551318 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551323 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551333 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551337 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551342 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551346 2580 flags.go:64] FLAG: --logging-format="text" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551351 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551356 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551362 2580 flags.go:64] FLAG: --manifest-url="" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551366 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551373 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551377 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551384 2580 flags.go:64] FLAG: --max-pods="110" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551389 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551394 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551399 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551403 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551408 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551413 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551417 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551427 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:50:28.559033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551433 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551438 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551443 2580 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551448 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551457 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551461 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551468 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551472 2580 flags.go:64] FLAG: --port="10250" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551477 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551482 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04c15326a012a7ba1" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551487 2580 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551491 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551497 2580 flags.go:64] FLAG: --register-node="true" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551501 2580 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551509 2580 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551533 2580 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551539 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551543 2580 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551550 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551554 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551559 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551564 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551568 2580 flags.go:64] FLAG: --runonce="false" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551573 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551578 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:50:28.559799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551582 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551587 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551592 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551596 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551601 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551606 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551610 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551615 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551620 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551624 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551629 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551634 2580 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551638 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551649 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551653 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551658 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551665 2580 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551670 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551675 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551680 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551685 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551692 2580 flags.go:64] FLAG: --v="2" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551698 2580 flags.go:64] FLAG: --version="false" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551704 2580 flags.go:64] FLAG: --vmodule="" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551710 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:50:28.560480 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.551716 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551895 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551902 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551907 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551911 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551916 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551920 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551925 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551930 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551934 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551938 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551942 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551946 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551951 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551955 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551959 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551963 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551967 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551972 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551976 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:28.561175 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551983 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551987 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551991 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.551995 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552000 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552007 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552012 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552017 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552023 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552028 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552031 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552035 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552039 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552043 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552047 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552050 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552054 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552058 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552062 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:28.561784 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552067 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552071 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552075 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552080 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552084 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552089 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552093 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552097 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552101 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552105 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552109 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552113 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552118 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552122 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552126 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552130 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552135 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552140 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552144 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552148 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:28.562287 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552153 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552159 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552163 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552170 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552175 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552180 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552184 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552188 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552192 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552196 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552200 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552205 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552209 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552213 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552217 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552221 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552225 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552232 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552237 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:28.562884 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552241 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552246 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552250 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552255 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552259 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552264 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552268 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552272 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552276 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552280 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552285 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552289 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552293 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552297 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552303 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552307 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552313 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552317 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552321 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552325 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:28.563350 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552330 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.552334 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.552868 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.559897 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.559912 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.559924 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.559931 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.559997 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560002 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560006 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560009 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560012 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560015 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560017 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560020 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:28.563868 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560022 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560027 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560031 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560034 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560036 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560039 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560042 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560045 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560048 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560052 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560055 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560058 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560060 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560063 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560066 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560069 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560071 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560074 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560077 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:28.564243 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560080 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560083 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560087 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560090 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560092 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560095 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560098 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560100 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560103 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560106 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560108 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560110 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560114 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560117 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560120 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560122 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560125 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560127 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560130 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:28.564716 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560132 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560135 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560137 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560139 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560142 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560144 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560147 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560149 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560152 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560154 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560157 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560159 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560162 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560164 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560166 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560170 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560173 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560176 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560179 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560181 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:28.565177 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560184 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560186 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560189 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560191 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560194 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560196 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560199 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560201 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560204 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560206 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560208 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560211 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560213 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560216 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560218 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560220 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560223 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560226 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560228 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560230 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:28.565690 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560233 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560235 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560238 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560240 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560243 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560245 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560248 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560251 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560254 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560256 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560259 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560261 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560264 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.560269 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560380 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:50:28.566168 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560385 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560388 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560391 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560393 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560396 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560399 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560403 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560407 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560411 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560414 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560417 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560420 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560422 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560425 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560427 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560430 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560432 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560435 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560437 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:50:28.566551 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560440 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560442 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560445 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560447 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560449 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560452 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560455 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560458 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560461 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560463 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560466 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560468 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560471 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560473 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560475 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560478 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560480 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560484 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560488 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:50:28.567013 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560491 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560494 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560496 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560499 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560502 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560504 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560507 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560509 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560511 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560532 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560536 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560538 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560541 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560543 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560546 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560548 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560551 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560555 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560558 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560562 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:50:28.567465 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560565 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560568 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560572 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560575 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560577 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560580 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560582 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560585 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560588 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560590 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560592 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560595 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560598 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560601 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560603 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560605 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560608 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560610 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560613 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560615 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:50:28.568009 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560618 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560620 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560623 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560625 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560628 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560630 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560633 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560635 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560638 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560640 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560643 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560645 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560647 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560650 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560652 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560655 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560657 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560660 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560662 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:50:28.568489 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:28.560664 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.560669 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.560777 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.562877 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.564221 2580 server.go:1019] "Starting client certificate rotation" Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.564318 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.565209 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:50:28.568957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.566922 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:50:28.572419 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.572399 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:50:28.582096 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.582078 2580 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:50:28.585091 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.585077 2580 log.go:25] "Validated CRI v1 image API" Jun 11 19:50:28.585799 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.585780 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:50:28.589229 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.589207 2580 fs.go:135] Filesystem UUIDs: map[318c8f48-cb87-45d2-8b49-f9e5902feed2:/dev/nvme0n1p3 77954269-600a-4a40-acf5-4c6e31cc5628:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 19:50:28.589293 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.589227 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:50:28.594192 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.594086 2580 manager.go:216] Machine: {Timestamp:2026-06-11 19:50:28.592861715 +0000 UTC m=+0.325511034 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104291 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e2953dfb523ff7b883817ba66fe0 SystemUUID:ec26e295-3dfb-523f-f7b8-83817ba66fe0 BootID:988eb50d-26f9-4345-b733-bde5cde9e85d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a5:17:d7:92:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a5:17:d7:92:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:08:f5:cd:cc:84 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:50:28.594192 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.594185 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:50:28.594305 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.594260 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:50:28.597397 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.597374 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:50:28.597561 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.597401 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:50:28.598681 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.598670 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:50:28.598714 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.598684 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:50:28.598714 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.598691 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:50:28.599281 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.599272 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:50:28.600574 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.600564 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:50:28.603469 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603457 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:50:28.603589 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603580 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:50:28.603632 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603609 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:50:28.603632 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603619 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:50:28.603690 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603633 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:50:28.603690 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603645 2580 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:50:28.603690 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603653 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:50:28.603986 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603975 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:50:28.604022 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.603993 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:50:28.604858 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.604839 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:50:28.608042 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.608025 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:50:28.611871 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.611853 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:50:28.611953 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.611885 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:50:28.612046 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612036 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:50:28.612086 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612051 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:50:28.612086 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612058 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:50:28.612086 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612063 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:50:28.612086 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612071 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:50:28.612086 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612076 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:50:28.612769 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612759 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:50:28.612769 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612769 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:50:28.612836 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612777 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:50:28.612836 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612782 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:50:28.612836 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612790 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:50:28.612836 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.612798 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:50:28.613614 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.613604 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:50:28.613614 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.613613 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:50:28.619959 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.619944 2580 server.go:1268] "Started kubelet" Jun 11 19:50:28.620047 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.620006 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:50:28.620612 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.620581 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:50:28.620700 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.620589 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:50:28.620700 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.620692 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:50:28.620857 ip-10-0-138-225 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:50:28.621547 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.621413 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:50:28.621547 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.621411 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 19:50:28.622109 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.622097 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:50:28.623098 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.623077 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:50:28.625329 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.625311 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n96f6" Jun 11 19:50:28.626064 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.625155 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-225.ec2.internal.18b81eb8162d556f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-225.ec2.internal,UID:ip-10-0-138-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-225.ec2.internal,},FirstTimestamp:2026-06-11 19:50:28.619916655 +0000 UTC m=+0.352565965,LastTimestamp:2026-06-11 19:50:28.619916655 +0000 UTC m=+0.352565965,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-225.ec2.internal,}" Jun 11 19:50:28.626511 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.626486 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:50:28.628555 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.628538 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:50:28.628629 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.628554 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:50:28.628629 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.628617 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:28.629262 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629246 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:50:28.629381 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629351 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:50:28.629381 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629246 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:50:28.629538 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629440 2580 factory.go:55] Registering systemd factory Jun 11 19:50:28.629599 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629588 2580 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:50:28.629654 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629477 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:50:28.629654 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629618 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:50:28.629812 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629799 2580 factory.go:153] Registering CRI-O factory Jun 11 19:50:28.629890 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629816 2580 factory.go:223] Registration of the crio container factory successfully Jun 11 19:50:28.629890 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629864 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:50:28.629890 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629888 2580 factory.go:103] Registering Raw factory Jun 11 19:50:28.630022 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.629904 2580 manager.go:1196] Started watching for new ooms in manager Jun 11 19:50:28.630252 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.630240 2580 manager.go:349] Starting recovery of all containers Jun 11 19:50:28.633027 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.632992 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n96f6" Jun 11 19:50:28.637740 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.637702 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 19:50:28.637740 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.637718 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 19:50:28.641462 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.641447 2580 manager.go:354] Recovery completed Jun 11 19:50:28.642641 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.642623 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 19:50:28.645567 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.645555 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.647355 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647339 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.647410 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647371 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.647410 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647384 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.647869 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647846 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:50:28.647869 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647859 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.647963 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647861 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:50:28.647963 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.647915 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:50:28.648458 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.648443 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.648543 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.648469 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.648543 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.648483 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.649259 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.649246 2580 policy_none.go:49] "None policy: Start" Jun 11 19:50:28.649303 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.649263 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:50:28.649303 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.649273 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:50:28.650324 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.650313 2580 policy_none.go:47] "Start" Jun 11 19:50:28.684166 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684150 2580 manager.go:337] "Starting Device Plugin manager" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.684194 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684205 2580 server.go:87] "Starting device plugin registration server" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684433 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684445 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684554 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684623 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.684631 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.685323 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.685378 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.698629 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.700006 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.700042 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.700062 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:50:28.701221 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.700092 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:50:28.702553 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.702494 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:28.784894 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.784851 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.785979 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.785954 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.786103 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.785995 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.786103 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.786009 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.786103 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.786038 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.792476 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.792460 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.792558 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.792485 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-225.ec2.internal\": node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:28.801149 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.801088 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal"] Jun 11 19:50:28.801149 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.801145 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.802629 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.802612 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.802721 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.802646 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.802721 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.802659 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.803800 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.803785 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.803911 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.803886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.803955 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.803932 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.804433 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.804419 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.804508 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.804440 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.804508 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.804453 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.804508 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.804464 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.804508 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.804479 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.804662 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.804468 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.805714 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.805700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.805768 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.805733 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:50:28.806370 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.806355 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:50:28.806427 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.806381 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:50:28.806427 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.806395 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:50:28.814628 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.814611 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:28.830636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.830615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3786f2f4dbaca25666ad878803c0e66c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-225.ec2.internal\" (UID: \"3786f2f4dbaca25666ad878803c0e66c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.830709 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.830642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c459f35f897a51f47f43b4208ff83f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal\" (UID: \"6c459f35f897a51f47f43b4208ff83f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.830709 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.830666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c459f35f897a51f47f43b4208ff83f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal\" (UID: \"6c459f35f897a51f47f43b4208ff83f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.841260 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.841242 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-225.ec2.internal\" not found" node="ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.845824 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.845799 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-225.ec2.internal\" not found" node="ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.915248 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:28.915215 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:28.931616 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.931587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c459f35f897a51f47f43b4208ff83f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal\" (UID: \"6c459f35f897a51f47f43b4208ff83f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.931778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.931624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c459f35f897a51f47f43b4208ff83f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal\" (UID: \"6c459f35f897a51f47f43b4208ff83f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.931778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.931651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3786f2f4dbaca25666ad878803c0e66c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-225.ec2.internal\" (UID: \"3786f2f4dbaca25666ad878803c0e66c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.931778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.931672 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6c459f35f897a51f47f43b4208ff83f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal\" (UID: \"6c459f35f897a51f47f43b4208ff83f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.931778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.931682 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3786f2f4dbaca25666ad878803c0e66c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-225.ec2.internal\" (UID: \"3786f2f4dbaca25666ad878803c0e66c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" Jun 11 19:50:28.931778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:28.931693 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c459f35f897a51f47f43b4208ff83f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal\" (UID: \"6c459f35f897a51f47f43b4208ff83f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:29.015363 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.015321 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.116173 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.116090 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.143788 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.143752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" Jun 11 19:50:29.150408 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.150383 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:29.216445 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.216411 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.316884 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.316853 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.417546 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.417450 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.450818 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.450786 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:29.518478 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.518455 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.563883 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.563840 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:50:29.564569 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.564002 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:50:29.564569 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.564009 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:50:29.583701 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.583665 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:29.618878 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.618836 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.625391 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:29.625360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3786f2f4dbaca25666ad878803c0e66c.slice/crio-7733d6076fd9c9a239ff8dc952e17c56c32f7385c50e48c48ba4bcf93ebe0557 WatchSource:0}: Error finding container 7733d6076fd9c9a239ff8dc952e17c56c32f7385c50e48c48ba4bcf93ebe0557: Status 404 returned error can't find the container with id 7733d6076fd9c9a239ff8dc952e17c56c32f7385c50e48c48ba4bcf93ebe0557 Jun 11 19:50:29.625609 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:29.625586 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c459f35f897a51f47f43b4208ff83f4.slice/crio-2cf8ac92b438384a456f394994a6659e13c22d35e4c5cceb298b301612fc1e2b WatchSource:0}: Error finding container 2cf8ac92b438384a456f394994a6659e13c22d35e4c5cceb298b301612fc1e2b: Status 404 returned error can't find the container with id 2cf8ac92b438384a456f394994a6659e13c22d35e4c5cceb298b301612fc1e2b Jun 11 19:50:29.630076 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.630060 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:50:29.637393 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.637357 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:45:28 +0000 UTC" deadline="2027-12-29 15:10:06.477595237 +0000 UTC" Jun 11 19:50:29.637393 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.637391 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13579h19m36.840208261s" Jun 11 19:50:29.705065 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.704959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" event={"ID":"6c459f35f897a51f47f43b4208ff83f4","Type":"ContainerStarted","Data":"2cf8ac92b438384a456f394994a6659e13c22d35e4c5cceb298b301612fc1e2b"} Jun 11 19:50:29.706023 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.705999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" event={"ID":"3786f2f4dbaca25666ad878803c0e66c","Type":"ContainerStarted","Data":"7733d6076fd9c9a239ff8dc952e17c56c32f7385c50e48c48ba4bcf93ebe0557"} Jun 11 19:50:29.719167 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:29.719146 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-225.ec2.internal\" not found" Jun 11 19:50:29.805397 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.805368 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:29.829510 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.829482 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" Jun 11 19:50:29.842173 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.842149 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:50:29.843183 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.843170 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" Jun 11 19:50:29.854329 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:29.854304 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:50:30.509196 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.509165 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:30.604880 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.604850 2580 apiserver.go:52] "Watching apiserver" Jun 11 19:50:30.612905 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.612882 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:50:30.615122 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.615056 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zf86k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal","openshift-multus/multus-8wz6v","openshift-multus/multus-additional-cni-plugins-txlh8","openshift-multus/network-metrics-daemon-g2nlh","openshift-network-diagnostics/network-check-target-7twtv","openshift-ovn-kubernetes/ovnkube-node-mdzcf","kube-system/global-pull-secret-syncer-w7djb","kube-system/konnectivity-agent-v4qxh","kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb","openshift-dns/node-resolver-k5qcp","openshift-network-operator/iptables-alerter-xcz7l","openshift-cluster-node-tuning-operator/tuned-dbmq6"] Jun 11 19:50:30.616921 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.616672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.618322 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.618020 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.619389 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.619139 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.619586 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.619570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:50:30.619678 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.619598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gjqmw\"" Jun 11 19:50:30.621404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.620426 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.621404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.620838 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.621404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.621041 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:50:30.621404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.621083 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t47h4\"" Jun 11 19:50:30.621404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.621200 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:50:30.621404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.621272 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:50:30.621768 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.621451 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.621823 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.621795 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622019 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622043 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.622091 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622365 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622352 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:50:30.622563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622471 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w4dkx\"" Jun 11 19:50:30.623001 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.622985 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:50:30.623265 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.623234 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x9sdq\"" Jun 11 19:50:30.623861 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.623491 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:50:30.623861 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.623248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:50:30.624034 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.623891 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:30.624034 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.623948 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:30.625233 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.625213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.628990 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.628970 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:50:30.629073 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.629061 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nr5wz\"" Jun 11 19:50:30.629150 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.628973 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:50:30.629286 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.629271 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:50:30.629710 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.629692 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.631368 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.631350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.631859 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.631840 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.632119 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.632103 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kz8fb\"" Jun 11 19:50:30.632217 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.632181 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.633159 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.632991 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.633639 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.633614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.633999 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.633769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-687pg\"" Jun 11 19:50:30.633999 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.633850 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.635169 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.635150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.635263 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.635212 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:30.636599 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.636580 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.639214 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.639067 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:50:30.639318 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.639213 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.639318 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.639279 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.639613 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.639596 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-swjx7\"" Jun 11 19:50:30.639786 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.639765 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:50:30.639869 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.639683 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:50:30.640023 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.640002 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dm6ct\"" Jun 11 19:50:30.640423 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.640145 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:50:30.641990 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.641968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-device-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.642071 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-cni-bin\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.642071 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-daemon-config\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.642151 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-os-release\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.642151 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-registration-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.642151 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.642308 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642255 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebad63fa-c545-4d49-b8ee-7563e988ad66-tmp\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.642308 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lljp\" (UniqueName: \"kubernetes.io/projected/ebad63fa-c545-4d49-b8ee-7563e988ad66-kube-api-access-5lljp\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.642405 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642313 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-slash\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.642405 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-cni-netd\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.642405 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-system-cni-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.642405 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-etc-kubernetes\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642413 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-node-log\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovnkube-config\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-socket-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642479 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-cni-binary-copy\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d393574-9bf1-45d7-989b-f4d5a880feef-cni-binary-copy\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-systemd\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.642625 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfgnz\" (UniqueName: \"kubernetes.io/projected/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-kube-api-access-jfgnz\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa9d0da4-8840-4921-a546-9e6edbe6d09f-tmp-dir\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642668 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-cni-bin\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-env-overrides\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-var-lib-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2sxs\" (UniqueName: \"kubernetes.io/projected/85fd3d18-d52d-4864-88b9-f9eae074f810-kube-api-access-v2sxs\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-os-release\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-system-cni-dir\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-kubelet\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-systemd-units\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-etc-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-cnibin\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-systemd\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643009 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.642984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-log-socket\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-k8s-cni-cncf-io\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-kubelet\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysconfig\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysctl-d\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-tuned\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-run-netns\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-multus-certs\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-sys\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-host\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643334 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwxc7\" (UniqueName: \"kubernetes.io/projected/fa9d0da4-8840-4921-a546-9e6edbe6d09f-kube-api-access-gwxc7\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae588036-3ea1-473c-b4cf-ffcba9b86491-konnectivity-ca\") pod \"konnectivity-agent-v4qxh\" (UID: \"ae588036-3ea1-473c-b4cf-ffcba9b86491\") " pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-kubernetes\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysctl-conf\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.643651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-ovn\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7pmj\" (UniqueName: \"kubernetes.io/projected/cca8b044-6099-4fdc-9843-91a2b8daf43f-kube-api-access-c7pmj\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-etc-selinux\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-cni-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643583 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-socket-dir-parent\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-run\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa9d0da4-8840-4921-a546-9e6edbe6d09f-hosts-file\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643653 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovn-node-metrics-cert\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-sys-fs\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-conf-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2248z\" (UniqueName: \"kubernetes.io/projected/5d393574-9bf1-45d7-989b-f4d5a880feef-kube-api-access-2248z\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643790 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovnkube-script-lib\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-netns\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-cnibin\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.644314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-modprobe-d\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643907 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae588036-3ea1-473c-b4cf-ffcba9b86491-agent-certs\") pod \"konnectivity-agent-v4qxh\" (UID: \"ae588036-3ea1-473c-b4cf-ffcba9b86491\") " pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643937 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-cni-multus\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-hostroot\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.643983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjm9\" (UniqueName: \"kubernetes.io/projected/554b2a51-977a-4f82-a5de-44d1518daf17-kube-api-access-frjm9\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.644006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-lib-modules\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.644034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-var-lib-kubelet\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.644066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:30.644938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.644659 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:50:30.672174 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.672153 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlwnj" Jun 11 19:50:30.686335 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.686134 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vlwnj" Jun 11 19:50:30.730275 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.730243 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:50:30.744536 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa9d0da4-8840-4921-a546-9e6edbe6d09f-tmp-dir\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-cni-bin\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-env-overrides\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-var-lib-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2sxs\" (UniqueName: \"kubernetes.io/projected/85fd3d18-d52d-4864-88b9-f9eae074f810-kube-api-access-v2sxs\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-os-release\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744669 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-cni-bin\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744694 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-system-cni-dir\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-kubelet\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744764 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-systemd-units\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-etc-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-cnibin\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8aef78ca-fede-4bf7-983a-1ec91458d9d9-iptables-alerter-script\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744862 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-systemd\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.744954 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744915 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-var-lib-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745308 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745158 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-systemd-units\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745308 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744892 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa9d0da4-8840-4921-a546-9e6edbe6d09f-tmp-dir\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.745406 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745334 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-system-cni-dir\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.745406 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-cnibin\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.745406 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745395 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-etc-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745578 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.744908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-log-socket\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745578 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-k8s-cni-cncf-io\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.745698 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-env-overrides\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745869 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745848 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-systemd\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745941 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745908 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-openvswitch\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.745941 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.745923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-log-socket\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.746049 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746001 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-os-release\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.746104 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746050 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-kubelet\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.746104 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-kubelet\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.746206 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysconfig\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746206 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysctl-d\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746303 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-tuned\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746303 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-kubelet\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.746397 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746320 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-k8s-cni-cncf-io\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.746397 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746321 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysconfig\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746397 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-run-netns\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.746566 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746413 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.746566 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746441 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysctl-d\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746566 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-multus-certs\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.746566 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746491 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-multus-certs\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.746566 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746492 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.746566 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-sys\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746831 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-host\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.746831 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746592 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:50:30.746912 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746831 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-run-netns\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.746912 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746887 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.746980 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746941 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-sys\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.747018 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746985 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-host\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.747018 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746996 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.747091 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.746602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwxc7\" (UniqueName: \"kubernetes.io/projected/fa9d0da4-8840-4921-a546-9e6edbe6d09f-kube-api-access-gwxc7\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.747127 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747108 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020ce4c2-f485-434b-b713-a982de3f269a-host\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.747173 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae588036-3ea1-473c-b4cf-ffcba9b86491-konnectivity-ca\") pod \"konnectivity-agent-v4qxh\" (UID: \"ae588036-3ea1-473c-b4cf-ffcba9b86491\") " pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.747173 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747167 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-kubernetes\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.747268 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysctl-conf\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.747268 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747216 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.747268 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-ovn\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.747409 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.747409 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7pmj\" (UniqueName: \"kubernetes.io/projected/cca8b044-6099-4fdc-9843-91a2b8daf43f-kube-api-access-c7pmj\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.747409 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-etc-selinux\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.747409 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-cni-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.747409 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-socket-dir-parent\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-run\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa9d0da4-8840-4921-a546-9e6edbe6d09f-hosts-file\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovn-node-metrics-cert\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-sys-fs\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-conf-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2248z\" (UniqueName: \"kubernetes.io/projected/5d393574-9bf1-45d7-989b-f4d5a880feef-kube-api-access-2248z\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa993e36-9370-45f1-9bcd-d2fdc5543128-kubelet-config\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovnkube-script-lib\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-netns\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.747686 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-cnibin\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-modprobe-d\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747740 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae588036-3ea1-473c-b4cf-ffcba9b86491-konnectivity-ca\") pod \"konnectivity-agent-v4qxh\" (UID: \"ae588036-3ea1-473c-b4cf-ffcba9b86491\") " pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae588036-3ea1-473c-b4cf-ffcba9b86491-agent-certs\") pod \"konnectivity-agent-v4qxh\" (UID: \"ae588036-3ea1-473c-b4cf-ffcba9b86491\") " pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p267\" (UniqueName: \"kubernetes.io/projected/8aef78ca-fede-4bf7-983a-1ec91458d9d9-kube-api-access-2p267\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-cni-multus\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747885 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fa9d0da4-8840-4921-a546-9e6edbe6d09f-hosts-file\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-hostroot\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjm9\" (UniqueName: \"kubernetes.io/projected/554b2a51-977a-4f82-a5de-44d1518daf17-kube-api-access-frjm9\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-kubernetes\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-lib-modules\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.747990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-var-lib-kubelet\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-sysctl-conf\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aef78ca-fede-4bf7-983a-1ec91458d9d9-host-slash\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-device-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.748136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-cni-bin\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-daemon-config\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-os-release\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-registration-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebad63fa-c545-4d49-b8ee-7563e988ad66-tmp\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lljp\" (UniqueName: \"kubernetes.io/projected/ebad63fa-c545-4d49-b8ee-7563e988ad66-kube-api-access-5lljp\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/020ce4c2-f485-434b-b713-a982de3f269a-serviceca\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-slash\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-cni-netd\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-system-cni-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-etc-kubernetes\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-node-log\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovnkube-config\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-socket-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-cni-binary-copy\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9bz\" (UniqueName: \"kubernetes.io/projected/020ce4c2-f485-434b-b713-a982de3f269a-kube-api-access-vh9bz\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.748975 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa993e36-9370-45f1-9bcd-d2fdc5543128-dbus\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d393574-9bf1-45d7-989b-f4d5a880feef-cni-binary-copy\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-systemd\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.748805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfgnz\" (UniqueName: \"kubernetes.io/projected/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-kube-api-access-jfgnz\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749030 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-modprobe-d\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749116 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-slash\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749193 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-sys-fs\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749208 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-hostroot\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-run\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-conf-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749375 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-socket-dir-parent\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-run-ovn\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749467 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.749776 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-run-ovn-kubernetes\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749947 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovnkube-script-lib\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.749980 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-cni-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750007 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-run-netns\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-systemd\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750049 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-cnibin\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-cni-multus\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d393574-9bf1-45d7-989b-f4d5a880feef-cni-binary-copy\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-lib-modules\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-etc-selinux\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-host-cni-netd\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.750488 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-system-cni-dir\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750559 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-socket-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750574 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovnkube-config\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750718 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750791 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-cni-binary-copy\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cca8b044-6099-4fdc-9843-91a2b8daf43f-ovn-node-metrics-cert\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750898 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebad63fa-c545-4d49-b8ee-7563e988ad66-var-lib-kubelet\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.750953 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-etc-kubernetes\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.750964 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-registration-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.751041 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.751037 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:31.251002849 +0000 UTC m=+2.983652139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751093 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/554b2a51-977a-4f82-a5de-44d1518daf17-os-release\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751149 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85fd3d18-d52d-4864-88b9-f9eae074f810-device-dir\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751205 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebad63fa-c545-4d49-b8ee-7563e988ad66-tmp\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751253 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cca8b044-6099-4fdc-9843-91a2b8daf43f-node-log\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d393574-9bf1-45d7-989b-f4d5a880feef-host-var-lib-cni-bin\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751388 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ebad63fa-c545-4d49-b8ee-7563e988ad66-etc-tuned\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.751498 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d393574-9bf1-45d7-989b-f4d5a880feef-multus-daemon-config\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.751768 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.751697 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/554b2a51-977a-4f82-a5de-44d1518daf17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.753063 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.753023 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:30.753063 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.753050 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:30.753063 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.753064 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:30.753352 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.753155 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:31.253138812 +0000 UTC m=+2.985788122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:30.753352 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.753269 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae588036-3ea1-473c-b4cf-ffcba9b86491-agent-certs\") pod \"konnectivity-agent-v4qxh\" (UID: \"ae588036-3ea1-473c-b4cf-ffcba9b86491\") " pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.755300 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.755280 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2sxs\" (UniqueName: \"kubernetes.io/projected/85fd3d18-d52d-4864-88b9-f9eae074f810-kube-api-access-v2sxs\") pod \"aws-ebs-csi-driver-node-5h6jb\" (UID: \"85fd3d18-d52d-4864-88b9-f9eae074f810\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.755532 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.755491 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwxc7\" (UniqueName: \"kubernetes.io/projected/fa9d0da4-8840-4921-a546-9e6edbe6d09f-kube-api-access-gwxc7\") pod \"node-resolver-k5qcp\" (UID: \"fa9d0da4-8840-4921-a546-9e6edbe6d09f\") " pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.761301 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.761243 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfgnz\" (UniqueName: \"kubernetes.io/projected/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-kube-api-access-jfgnz\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:30.762537 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.762499 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7pmj\" (UniqueName: \"kubernetes.io/projected/cca8b044-6099-4fdc-9843-91a2b8daf43f-kube-api-access-c7pmj\") pod \"ovnkube-node-mdzcf\" (UID: \"cca8b044-6099-4fdc-9843-91a2b8daf43f\") " pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.763241 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.763217 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjm9\" (UniqueName: \"kubernetes.io/projected/554b2a51-977a-4f82-a5de-44d1518daf17-kube-api-access-frjm9\") pod \"multus-additional-cni-plugins-txlh8\" (UID: \"554b2a51-977a-4f82-a5de-44d1518daf17\") " pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.763446 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.763421 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2248z\" (UniqueName: \"kubernetes.io/projected/5d393574-9bf1-45d7-989b-f4d5a880feef-kube-api-access-2248z\") pod \"multus-8wz6v\" (UID: \"5d393574-9bf1-45d7-989b-f4d5a880feef\") " pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.763537 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.763427 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lljp\" (UniqueName: \"kubernetes.io/projected/ebad63fa-c545-4d49-b8ee-7563e988ad66-kube-api-access-5lljp\") pod \"tuned-dbmq6\" (UID: \"ebad63fa-c545-4d49-b8ee-7563e988ad66\") " pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.849211 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p267\" (UniqueName: \"kubernetes.io/projected/8aef78ca-fede-4bf7-983a-1ec91458d9d9-kube-api-access-2p267\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.849363 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aef78ca-fede-4bf7-983a-1ec91458d9d9-host-slash\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.849363 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/020ce4c2-f485-434b-b713-a982de3f269a-serviceca\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.849363 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9bz\" (UniqueName: \"kubernetes.io/projected/020ce4c2-f485-434b-b713-a982de3f269a-kube-api-access-vh9bz\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.849363 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa993e36-9370-45f1-9bcd-d2fdc5543128-dbus\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.849363 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8aef78ca-fede-4bf7-983a-1ec91458d9d9-iptables-alerter-script\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.849363 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aef78ca-fede-4bf7-983a-1ec91458d9d9-host-slash\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020ce4c2-f485-434b-b713-a982de3f269a-host\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa993e36-9370-45f1-9bcd-d2fdc5543128-kubelet-config\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849491 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fa993e36-9370-45f1-9bcd-d2fdc5543128-dbus\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849491 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fa993e36-9370-45f1-9bcd-d2fdc5543128-kubelet-config\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/020ce4c2-f485-434b-b713-a982de3f269a-host\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.849640 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.849627 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:30.849919 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:30.849695 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:31.349676288 +0000 UTC m=+3.082325574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:30.849919 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.849757 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/020ce4c2-f485-434b-b713-a982de3f269a-serviceca\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.850034 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.850013 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8aef78ca-fede-4bf7-983a-1ec91458d9d9-iptables-alerter-script\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.864195 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.864173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p267\" (UniqueName: \"kubernetes.io/projected/8aef78ca-fede-4bf7-983a-1ec91458d9d9-kube-api-access-2p267\") pod \"iptables-alerter-xcz7l\" (UID: \"8aef78ca-fede-4bf7-983a-1ec91458d9d9\") " pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:30.865729 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.865707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9bz\" (UniqueName: \"kubernetes.io/projected/020ce4c2-f485-434b-b713-a982de3f269a-kube-api-access-vh9bz\") pod \"node-ca-zf86k\" (UID: \"020ce4c2-f485-434b-b713-a982de3f269a\") " pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.931643 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.931613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:30.942364 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.942344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" Jun 11 19:50:30.951130 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.951112 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8wz6v" Jun 11 19:50:30.958678 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.958654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txlh8" Jun 11 19:50:30.967133 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.967114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:30.973666 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.973641 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" Jun 11 19:50:30.981050 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.981033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5qcp" Jun 11 19:50:30.988544 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.988513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zf86k" Jun 11 19:50:30.996078 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:30.996057 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcz7l" Jun 11 19:50:31.251611 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.251542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:31.251764 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.251705 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:31.251829 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.251781 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:32.251758966 +0000 UTC m=+3.984408267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:31.352865 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.352830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:31.353004 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.352889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:31.353004 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.352974 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:31.353004 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.352989 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:31.353145 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.353012 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:31.353145 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.353026 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:31.353145 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.353037 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:32.35301764 +0000 UTC m=+4.085666940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:31.353145 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:31.353072 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:32.353057601 +0000 UTC m=+4.085706887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:31.575776 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.575617 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554b2a51_977a_4f82_a5de_44d1518daf17.slice/crio-59f241c163e779e907d081299feb6bc36bb19b616f1f2fe673a8c829c3e25ecd WatchSource:0}: Error finding container 59f241c163e779e907d081299feb6bc36bb19b616f1f2fe673a8c829c3e25ecd: Status 404 returned error can't find the container with id 59f241c163e779e907d081299feb6bc36bb19b616f1f2fe673a8c829c3e25ecd Jun 11 19:50:31.579911 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.579573 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca8b044_6099_4fdc_9843_91a2b8daf43f.slice/crio-e234c31e04a9faed0c1b258acd213ce7b487362dacf83377a1701c8ec5845ca0 WatchSource:0}: Error finding container e234c31e04a9faed0c1b258acd213ce7b487362dacf83377a1701c8ec5845ca0: Status 404 returned error can't find the container with id e234c31e04a9faed0c1b258acd213ce7b487362dacf83377a1701c8ec5845ca0 Jun 11 19:50:31.581708 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.581677 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebad63fa_c545_4d49_b8ee_7563e988ad66.slice/crio-3088c95462ad8971b6b09f3d2f8aea521af789b1e93ca7d1e80468becdd75d1c WatchSource:0}: Error finding container 3088c95462ad8971b6b09f3d2f8aea521af789b1e93ca7d1e80468becdd75d1c: Status 404 returned error can't find the container with id 3088c95462ad8971b6b09f3d2f8aea521af789b1e93ca7d1e80468becdd75d1c Jun 11 19:50:31.582477 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.582455 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9d0da4_8840_4921_a546_9e6edbe6d09f.slice/crio-1b7d2c466ea74283e2666cfe017af212b01dc28c8c51cf8c639a4e433b55697f WatchSource:0}: Error finding container 1b7d2c466ea74283e2666cfe017af212b01dc28c8c51cf8c639a4e433b55697f: Status 404 returned error can't find the container with id 1b7d2c466ea74283e2666cfe017af212b01dc28c8c51cf8c639a4e433b55697f Jun 11 19:50:31.584219 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.583636 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d393574_9bf1_45d7_989b_f4d5a880feef.slice/crio-7c576d611300c5f3b2543b2d0e86046dc14626bc7c169cbe77e2cd23b7454f67 WatchSource:0}: Error finding container 7c576d611300c5f3b2543b2d0e86046dc14626bc7c169cbe77e2cd23b7454f67: Status 404 returned error can't find the container with id 7c576d611300c5f3b2543b2d0e86046dc14626bc7c169cbe77e2cd23b7454f67 Jun 11 19:50:31.585603 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.584774 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae588036_3ea1_473c_b4cf_ffcba9b86491.slice/crio-b40bba2b58fb1f0a303d5cf6a9858f686022de68b18f6cb8b29a929f96faf541 WatchSource:0}: Error finding container b40bba2b58fb1f0a303d5cf6a9858f686022de68b18f6cb8b29a929f96faf541: Status 404 returned error can't find the container with id b40bba2b58fb1f0a303d5cf6a9858f686022de68b18f6cb8b29a929f96faf541 Jun 11 19:50:31.585603 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.585168 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aef78ca_fede_4bf7_983a_1ec91458d9d9.slice/crio-af8698a7cb81aab4b7e31a8d7cc2e6237c734cc4401f1aaeb123d655f5a4ec39 WatchSource:0}: Error finding container af8698a7cb81aab4b7e31a8d7cc2e6237c734cc4401f1aaeb123d655f5a4ec39: Status 404 returned error can't find the container with id af8698a7cb81aab4b7e31a8d7cc2e6237c734cc4401f1aaeb123d655f5a4ec39 Jun 11 19:50:31.586851 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:50:31.586832 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fd3d18_d52d_4864_88b9_f9eae074f810.slice/crio-61bb9451597ed1e49c2df5e0b8edc245b8c829f67f180e8cd28d1d18416f88af WatchSource:0}: Error finding container 61bb9451597ed1e49c2df5e0b8edc245b8c829f67f180e8cd28d1d18416f88af: Status 404 returned error can't find the container with id 61bb9451597ed1e49c2df5e0b8edc245b8c829f67f180e8cd28d1d18416f88af Jun 11 19:50:31.688549 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.688390 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:45:30 +0000 UTC" deadline="2027-11-17 22:13:09.446619821 +0000 UTC" Jun 11 19:50:31.688873 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.688553 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12578h22m37.758073868s" Jun 11 19:50:31.710808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.710775 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" event={"ID":"3786f2f4dbaca25666ad878803c0e66c","Type":"ContainerStarted","Data":"73f6a8c4b6751f72fdd8e8bb4e24810f171902f89949b2578a18f87f0768fb85"} Jun 11 19:50:31.711957 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.711930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5qcp" event={"ID":"fa9d0da4-8840-4921-a546-9e6edbe6d09f","Type":"ContainerStarted","Data":"1b7d2c466ea74283e2666cfe017af212b01dc28c8c51cf8c639a4e433b55697f"} Jun 11 19:50:31.713011 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.712989 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" event={"ID":"85fd3d18-d52d-4864-88b9-f9eae074f810","Type":"ContainerStarted","Data":"61bb9451597ed1e49c2df5e0b8edc245b8c829f67f180e8cd28d1d18416f88af"} Jun 11 19:50:31.714066 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.714044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v4qxh" event={"ID":"ae588036-3ea1-473c-b4cf-ffcba9b86491","Type":"ContainerStarted","Data":"b40bba2b58fb1f0a303d5cf6a9858f686022de68b18f6cb8b29a929f96faf541"} Jun 11 19:50:31.718232 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.718177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" event={"ID":"ebad63fa-c545-4d49-b8ee-7563e988ad66","Type":"ContainerStarted","Data":"3088c95462ad8971b6b09f3d2f8aea521af789b1e93ca7d1e80468becdd75d1c"} Jun 11 19:50:31.719435 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.719415 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"e234c31e04a9faed0c1b258acd213ce7b487362dacf83377a1701c8ec5845ca0"} Jun 11 19:50:31.720606 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.720586 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerStarted","Data":"59f241c163e779e907d081299feb6bc36bb19b616f1f2fe673a8c829c3e25ecd"} Jun 11 19:50:31.721680 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.721643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcz7l" event={"ID":"8aef78ca-fede-4bf7-983a-1ec91458d9d9","Type":"ContainerStarted","Data":"af8698a7cb81aab4b7e31a8d7cc2e6237c734cc4401f1aaeb123d655f5a4ec39"} Jun 11 19:50:31.722741 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.722717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8wz6v" event={"ID":"5d393574-9bf1-45d7-989b-f4d5a880feef","Type":"ContainerStarted","Data":"7c576d611300c5f3b2543b2d0e86046dc14626bc7c169cbe77e2cd23b7454f67"} Jun 11 19:50:31.723714 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.723695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf86k" event={"ID":"020ce4c2-f485-434b-b713-a982de3f269a","Type":"ContainerStarted","Data":"0e99a09546e8d5f52c3ce626a6ffd8b0c882e86cd893c7bfed0c8c57fea8f6fc"} Jun 11 19:50:31.726629 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:31.726593 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-225.ec2.internal" podStartSLOduration=2.726581845 podStartE2EDuration="2.726581845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:31.72627931 +0000 UTC m=+3.458928618" watchObservedRunningTime="2026-06-11 19:50:31.726581845 +0000 UTC m=+3.459231155" Jun 11 19:50:32.260829 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.260026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:32.260829 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.260226 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:32.260829 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.260293 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:34.260272671 +0000 UTC m=+5.992921976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:32.361105 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.361067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:32.361288 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.361133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:32.361357 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.361290 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:32.361357 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.361353 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:34.361335019 +0000 UTC m=+6.093984313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:32.361821 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.361799 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:32.361925 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.361831 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:32.361925 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.361843 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:32.361925 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.361892 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:34.361876236 +0000 UTC m=+6.094525538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:32.447424 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.447393 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:50:32.689538 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.689409 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:45:30 +0000 UTC" deadline="2027-11-21 19:33:35.079837326 +0000 UTC" Jun 11 19:50:32.689538 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.689474 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12671h43m2.39036697s" Jun 11 19:50:32.703463 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.702976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:32.703463 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.703092 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:32.703463 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.703355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:32.703463 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.703355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:32.703765 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.703480 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:32.703765 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:32.703530 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:32.742199 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.742165 2580 generic.go:356] "Generic (PLEG): container finished" podID="6c459f35f897a51f47f43b4208ff83f4" containerID="3bfe81cdc91fffc1a8ff21f4036ce603236212245a474d908254f8c5b6ae603b" exitCode=0 Jun 11 19:50:32.743062 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:32.743034 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" event={"ID":"6c459f35f897a51f47f43b4208ff83f4","Type":"ContainerDied","Data":"3bfe81cdc91fffc1a8ff21f4036ce603236212245a474d908254f8c5b6ae603b"} Jun 11 19:50:33.750550 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:33.749992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" event={"ID":"6c459f35f897a51f47f43b4208ff83f4","Type":"ContainerStarted","Data":"df801df62ed5f1eb467260919f5c23fda5099122b5b1c850ef7a739ae486cc2a"} Jun 11 19:50:34.278310 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:34.278179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:34.278512 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.278367 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:34.278512 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.278437 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:38.278418397 +0000 UTC m=+10.011067688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:34.379146 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:34.379106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:34.379347 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:34.379173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:34.379347 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.379319 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:34.379453 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.379382 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:38.379364101 +0000 UTC m=+10.112013391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:34.379553 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.379464 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:34.379553 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.379478 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:34.379553 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.379489 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:34.380018 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.379995 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:38.379511704 +0000 UTC m=+10.112161004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:34.703177 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:34.703096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:34.703328 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.703224 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:34.703685 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:34.703665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:34.703780 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.703759 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:34.703843 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:34.703802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:34.703876 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:34.703859 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:36.700834 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:36.700330 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:36.700834 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:36.700475 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:36.700834 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:36.700498 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:36.700834 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:36.700593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:36.700834 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:36.700694 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:36.700834 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:36.700777 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:38.314413 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:38.314383 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:38.314980 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.314580 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:38.314980 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.314648 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:46.314627623 +0000 UTC m=+18.047276910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:38.414731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:38.414791 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.414929 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.414990 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:46.414971829 +0000 UTC m=+18.147621117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.415427 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.415450 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.415464 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:38.415565 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.415512 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:50:46.41549467 +0000 UTC m=+18.148143969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:38.701969 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:38.701750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:38.701969 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:38.701786 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:38.701969 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:38.701877 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:38.701969 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.701880 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:38.702966 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.702929 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:38.703086 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:38.703053 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:40.702032 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:40.701994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:40.702404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:40.702041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:40.702404 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:40.702133 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:40.702404 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:40.702187 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:40.702404 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:40.702260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:40.702404 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:40.702376 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:42.700571 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:42.700533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:42.700571 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:42.700577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:42.701026 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:42.700541 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:42.701026 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:42.700660 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:42.701026 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:42.700731 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:42.701026 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:42.700851 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:44.701428 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:44.701378 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:44.701967 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:44.701505 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:44.701967 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:44.701704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:44.701967 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:44.701809 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:44.701967 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:44.701886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:44.702160 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:44.702001 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:46.378123 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:46.378082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:46.378501 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.378193 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:46.378501 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.378249 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:02.378234027 +0000 UTC m=+34.110883312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:50:46.479202 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:46.479165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:46.479365 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:46.479217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:46.479365 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.479318 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:46.479365 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.479336 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:50:46.479365 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.479361 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:50:46.479488 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.479374 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:46.479488 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.479383 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:02.479369267 +0000 UTC m=+34.212018554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:50:46.479488 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.479415 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:02.479403239 +0000 UTC m=+34.212052525 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:50:46.701348 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:46.701317 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:46.701540 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:46.701317 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:46.701540 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.701431 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:46.701540 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:46.701440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:46.701669 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.701576 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:46.701735 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:46.701714 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:48.701531 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:48.701481 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:48.701531 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:48.701510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:48.701967 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:48.701672 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:48.701967 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:48.701778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:48.701967 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:48.701870 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:48.701967 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:48.701925 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:50.700814 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.700676 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:50.701151 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.700676 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:50.701151 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:50.700910 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:50.701151 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:50.700994 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:50.701151 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.700696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:50.701151 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:50.701101 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:50.787860 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.787835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zf86k" event={"ID":"020ce4c2-f485-434b-b713-a982de3f269a","Type":"ContainerStarted","Data":"abcb4032f7cfc4f43eac914486fb5f8741c6b552fbfcf2c1cf40006f95bd8c8c"} Jun 11 19:50:50.789131 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.789100 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5qcp" event={"ID":"fa9d0da4-8840-4921-a546-9e6edbe6d09f","Type":"ContainerStarted","Data":"7c46b1b1a86914d9633c665bddcb301a195150a25e77dcd429373695fbb21707"} Jun 11 19:50:50.791364 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.790974 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" event={"ID":"85fd3d18-d52d-4864-88b9-f9eae074f810","Type":"ContainerStarted","Data":"b4c5f1c403a2459eacf7307a4442aff45be1916f8a40e3658b9e04ffaa96f49e"} Jun 11 19:50:50.792806 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.792787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v4qxh" event={"ID":"ae588036-3ea1-473c-b4cf-ffcba9b86491","Type":"ContainerStarted","Data":"240243356d9bf2dd9565cfef9c4331f33d51dbb3d28d07fd9ca7e4ef501bdefa"} Jun 11 19:50:50.833994 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.833306 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-225.ec2.internal" podStartSLOduration=21.833292987 podStartE2EDuration="21.833292987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:33.767308035 +0000 UTC m=+5.499957346" watchObservedRunningTime="2026-06-11 19:50:50.833292987 +0000 UTC m=+22.565942294" Jun 11 19:50:50.862118 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.862076 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v4qxh" podStartSLOduration=7.7424756630000005 podStartE2EDuration="22.862059221s" totalImagesPullingTime="15.119583558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:50.834143511 +0000 UTC m=+22.566792819" watchObservedRunningTime="2026-06-11 19:50:50.862059221 +0000 UTC m=+22.594708584" Jun 11 19:50:50.862250 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.862226 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k5qcp" podStartSLOduration=3.960380732 podStartE2EDuration="22.86222129s" totalImagesPullingTime="18.901840558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:50.861408087 +0000 UTC m=+22.594057396" watchObservedRunningTime="2026-06-11 19:50:50.86222129 +0000 UTC m=+22.594870597" Jun 11 19:50:50.894554 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:50.894467 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zf86k" podStartSLOduration=7.765651281 podStartE2EDuration="22.894445937s" totalImagesPullingTime="15.128794656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:50.893532862 +0000 UTC m=+22.626182162" watchObservedRunningTime="2026-06-11 19:50:50.894445937 +0000 UTC m=+22.627095273" Jun 11 19:50:51.798201 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798179 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798478 2580 generic.go:356] "Generic (PLEG): container finished" podID="cca8b044-6099-4fdc-9843-91a2b8daf43f" containerID="5a503f1ae848e235373ed214264dcd0175577fd73b0136a57e19af3d13a62110" exitCode=1 Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"cff2d43a5071642b4ca6b6fdbb0ac055e53b66f0c4c33ffa9a13efee674717fa"} Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"f08691812763b0467583367e4cd36fbcfbcb9c416836ef8d07db82be16a9c53a"} Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798732 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"5254b06849a821b74c519db94cad9e928155fdc0f88a5af6b1b577e9642ef142"} Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798780 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"d3106b30a291e58e5bc4465351283578c054ca1c430715d35545b2af8a1df7ab"} Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798812 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerDied","Data":"5a503f1ae848e235373ed214264dcd0175577fd73b0136a57e19af3d13a62110"} Jun 11 19:50:51.798862 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.798849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"e8d61fceb6d8847fc5b9a7a4e0d32664cf3083ab05047de3fbcc08010f419896"} Jun 11 19:50:51.800152 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.800129 2580 generic.go:356] "Generic (PLEG): container finished" podID="554b2a51-977a-4f82-a5de-44d1518daf17" containerID="ee38664e53e5d916bff5502d077365a8b9ff93ac51fa84d8fdc4bf07754d5416" exitCode=0 Jun 11 19:50:51.800241 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.800205 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerDied","Data":"ee38664e53e5d916bff5502d077365a8b9ff93ac51fa84d8fdc4bf07754d5416"} Jun 11 19:50:51.801804 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.801770 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8wz6v" event={"ID":"5d393574-9bf1-45d7-989b-f4d5a880feef","Type":"ContainerStarted","Data":"227f1ce16ff0a5bea35ec065d02ec70059af4c2c6fa8b3233527d94f16be2f0d"} Jun 11 19:50:51.803256 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.803229 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" event={"ID":"ebad63fa-c545-4d49-b8ee-7563e988ad66","Type":"ContainerStarted","Data":"d5d4c2ab1e15cf3f52cc16df5a45e816b53d06e8f27a1b7e906d4e88b5ddc399"} Jun 11 19:50:51.894492 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.894447 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dbmq6" podStartSLOduration=4.988906851 podStartE2EDuration="23.894433173s" totalImagesPullingTime="18.905526322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:51.894319275 +0000 UTC m=+23.626968582" watchObservedRunningTime="2026-06-11 19:50:51.894433173 +0000 UTC m=+23.627082482" Jun 11 19:50:51.894656 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:51.894635 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8wz6v" podStartSLOduration=4.7078562 podStartE2EDuration="23.894627257s" totalImagesPullingTime="19.186771057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:51.866866131 +0000 UTC m=+23.599515450" watchObservedRunningTime="2026-06-11 19:50:51.894627257 +0000 UTC m=+23.627276574" Jun 11 19:50:52.305170 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.305149 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:50:52.362211 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.362179 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:52.362866 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.362841 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:50:52.700538 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.700429 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:50:52.305164804Z","UUID":"e264669c-c576-4cfb-bf8e-02dc481515c4","Handler":null,"Name":"","Endpoint":""} Jun 11 19:50:52.700688 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.700613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:52.700688 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.700661 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:52.700688 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.700671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:52.700844 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:52.700748 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:52.700890 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:52.700832 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:52.700890 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:52.700875 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:52.701936 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.701916 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:50:52.702045 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.701949 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:50:52.807245 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.807199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" event={"ID":"85fd3d18-d52d-4864-88b9-f9eae074f810","Type":"ContainerStarted","Data":"8709b5aa2c86229549a7152e7cda2ffd00feeee2ef6c8c124e2bc3973afb008c"} Jun 11 19:50:52.809050 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:52.809012 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcz7l" event={"ID":"8aef78ca-fede-4bf7-983a-1ec91458d9d9","Type":"ContainerStarted","Data":"9df9cfbccb11a53ba957a9a3d2630497de6a18a69bf6ccd141f9152d8222e18d"} Jun 11 19:50:53.813347 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:53.813155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" event={"ID":"85fd3d18-d52d-4864-88b9-f9eae074f810","Type":"ContainerStarted","Data":"2007e4942f7917c7d4f3129a52147478189406a4631787a640aa9c4ae4402699"} Jun 11 19:50:53.816013 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:53.815993 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 19:50:53.816334 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:53.816317 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 19:50:53.816433 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:53.816333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"9a532b4588c9a61cc32d457e7fd350cea61058ab6c2e6b3c3f6a25493bd1481b"} Jun 11 19:50:53.845030 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:53.844984 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5h6jb" podStartSLOduration=4.217172418 podStartE2EDuration="25.844969392s" totalImagesPullingTime="21.627796974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:53.8438816 +0000 UTC m=+25.576530908" watchObservedRunningTime="2026-06-11 19:50:53.844969392 +0000 UTC m=+25.577618701" Jun 11 19:50:53.845169 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:53.845101 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xcz7l" podStartSLOduration=5.946297054 podStartE2EDuration="24.845097382s" totalImagesPullingTime="18.898800328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:52.828979859 +0000 UTC m=+24.561629166" watchObservedRunningTime="2026-06-11 19:50:53.845097382 +0000 UTC m=+25.577746691" Jun 11 19:50:54.700314 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:54.700280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:54.700499 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:54.700322 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:54.700499 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:54.700280 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:54.700499 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:54.700423 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:54.700499 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:54.700492 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:54.700708 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:54.700597 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:56.700918 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.700714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:56.701596 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.700715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:56.701596 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:56.701022 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:56.701596 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.700724 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:56.701596 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:56.701094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:56.701596 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:56.701160 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:56.826457 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.826427 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 19:50:56.826864 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.826827 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"e3b8b46d1ff68dc8b6a1e535f95e56811ab1f6cdac58a54b0591f79ae880f704"} Jun 11 19:50:56.827265 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.827116 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:56.827359 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.827282 2580 scope.go:117] "RemoveContainer" containerID="5a503f1ae848e235373ed214264dcd0175577fd73b0136a57e19af3d13a62110" Jun 11 19:50:56.844754 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:56.844733 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:57.255710 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:57.255679 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:57.834767 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:57.834734 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 19:50:57.835353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:57.835176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" event={"ID":"cca8b044-6099-4fdc-9843-91a2b8daf43f","Type":"ContainerStarted","Data":"c96be4758c62474662427ba6a2b73a6a1c947c9711703e743206861b76663493"} Jun 11 19:50:57.835415 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:57.835374 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:57.853941 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:57.853909 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:50:57.873993 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:57.873927 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" podStartSLOduration=10.907802177 podStartE2EDuration="29.873904175s" totalImagesPullingTime="18.966101998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:50:57.872424606 +0000 UTC m=+29.605073940" watchObservedRunningTime="2026-06-11 19:50:57.873904175 +0000 UTC m=+29.606553516" Jun 11 19:50:58.364759 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:58.364714 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w7djb"] Jun 11 19:50:58.364929 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:58.364878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:50:58.365037 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:58.365011 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:50:58.370096 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:58.370066 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7twtv"] Jun 11 19:50:58.370237 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:58.370185 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:58.370298 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:58.370273 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:58.373147 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:58.373122 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g2nlh"] Jun 11 19:50:58.373252 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:58.373220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:50:58.373333 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:58.373314 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:50:59.701261 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:59.701100 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:50:59.701745 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:50:59.701338 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:50:59.841129 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:59.841100 2580 generic.go:356] "Generic (PLEG): container finished" podID="554b2a51-977a-4f82-a5de-44d1518daf17" containerID="81419c1eb3a4d5e8705295e6d83a906b215225646c415510df54ec94535e6e6e" exitCode=0 Jun 11 19:50:59.841129 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:50:59.841128 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerDied","Data":"81419c1eb3a4d5e8705295e6d83a906b215225646c415510df54ec94535e6e6e"} Jun 11 19:51:00.104743 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.104672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:51:00.104869 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.104802 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 19:51:00.105202 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.105179 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v4qxh" Jun 11 19:51:00.700475 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.700442 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:00.700748 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.700442 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:51:00.700748 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:00.700581 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:51:00.700748 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:00.700661 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:51:00.844871 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.844781 2580 generic.go:356] "Generic (PLEG): container finished" podID="554b2a51-977a-4f82-a5de-44d1518daf17" containerID="deea314ee3cd699ff16b4c457eaaf3ecce01710cb0e83d840cfde0a9c1e29614" exitCode=0 Jun 11 19:51:00.845370 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:00.844861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerDied","Data":"deea314ee3cd699ff16b4c457eaaf3ecce01710cb0e83d840cfde0a9c1e29614"} Jun 11 19:51:01.700948 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:01.700922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:01.701092 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:01.701023 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7twtv" podUID="e64263b1-f99d-4add-9fd0-4863b1d47a28" Jun 11 19:51:01.848933 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:01.848899 2580 generic.go:356] "Generic (PLEG): container finished" podID="554b2a51-977a-4f82-a5de-44d1518daf17" containerID="af708814295b5986dc8b322b10c88d798c5c933b0295b27e80ce820450756485" exitCode=0 Jun 11 19:51:01.849287 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:01.848965 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerDied","Data":"af708814295b5986dc8b322b10c88d798c5c933b0295b27e80ce820450756485"} Jun 11 19:51:02.402284 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:02.402248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:51:02.402488 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.402390 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:51:02.402488 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.402457 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:34.402438453 +0000 UTC m=+66.135087741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:51:02.503022 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:02.502990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:02.503022 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:02.503030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:02.503209 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.503129 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:51:02.503209 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.503147 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:51:02.503209 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.503165 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:51:02.503209 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.503176 2580 projected.go:196] Error preparing data for projected volume kube-api-access-zxnjl for pod openshift-network-diagnostics/network-check-target-7twtv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:51:02.503209 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.503178 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret podName:fa993e36-9370-45f1-9bcd-d2fdc5543128 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:34.503166243 +0000 UTC m=+66.235815529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret") pod "global-pull-secret-syncer-w7djb" (UID: "fa993e36-9370-45f1-9bcd-d2fdc5543128") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:51:02.503366 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.503212 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl podName:e64263b1-f99d-4add-9fd0-4863b1d47a28 nodeName:}" failed. No retries permitted until 2026-06-11 19:51:34.503200621 +0000 UTC m=+66.235849909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zxnjl" (UniqueName: "kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl") pod "network-check-target-7twtv" (UID: "e64263b1-f99d-4add-9fd0-4863b1d47a28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:51:02.701173 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:02.701142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:51:02.701331 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:02.701142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:02.701331 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.701256 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:51:02.701404 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:02.701326 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w7djb" podUID="fa993e36-9370-45f1-9bcd-d2fdc5543128" Jun 11 19:51:03.579674 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.579594 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-225.ec2.internal" event="NodeReady" Jun 11 19:51:03.580146 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.579730 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:51:03.664115 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.664085 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mxcpr"] Jun 11 19:51:03.671718 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.671700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.676926 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.676900 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:51:03.677090 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.676977 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:51:03.677090 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.677074 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:51:03.677250 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.677149 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fdr4v\"" Jun 11 19:51:03.678553 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.678505 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vv2n5"] Jun 11 19:51:03.685102 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.685082 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mxcpr"] Jun 11 19:51:03.685199 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.685168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.688077 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.688053 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:51:03.688180 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.688097 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:51:03.688240 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.688227 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rb2ld\"" Jun 11 19:51:03.696693 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.696671 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vv2n5"] Jun 11 19:51:03.700891 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.700868 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:03.703614 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.703597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rmmv\"" Jun 11 19:51:03.703701 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.703656 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:51:03.703987 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.703973 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:51:03.811634 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.811605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8v7\" (UniqueName: \"kubernetes.io/projected/5451f007-016f-4f65-91d8-1751073e2e0a-kube-api-access-lc8v7\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.811810 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.811650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.811810 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.811666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27c6e5c-87f9-4ac3-a787-077dad3b1638-cert\") pod \"ingress-canary-mxcpr\" (UID: \"d27c6e5c-87f9-4ac3-a787-077dad3b1638\") " pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.811810 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.811791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftkqz\" (UniqueName: \"kubernetes.io/projected/d27c6e5c-87f9-4ac3-a787-077dad3b1638-kube-api-access-ftkqz\") pod \"ingress-canary-mxcpr\" (UID: \"d27c6e5c-87f9-4ac3-a787-077dad3b1638\") " pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.811968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.811842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5451f007-016f-4f65-91d8-1751073e2e0a-config-volume\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.811968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.811892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5451f007-016f-4f65-91d8-1751073e2e0a-tmp-dir\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.912500 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftkqz\" (UniqueName: \"kubernetes.io/projected/d27c6e5c-87f9-4ac3-a787-077dad3b1638-kube-api-access-ftkqz\") pod \"ingress-canary-mxcpr\" (UID: \"d27c6e5c-87f9-4ac3-a787-077dad3b1638\") " pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.912500 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5451f007-016f-4f65-91d8-1751073e2e0a-config-volume\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.912500 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5451f007-016f-4f65-91d8-1751073e2e0a-tmp-dir\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.912763 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8v7\" (UniqueName: \"kubernetes.io/projected/5451f007-016f-4f65-91d8-1751073e2e0a-kube-api-access-lc8v7\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.912763 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.912763 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27c6e5c-87f9-4ac3-a787-077dad3b1638-cert\") pod \"ingress-canary-mxcpr\" (UID: \"d27c6e5c-87f9-4ac3-a787-077dad3b1638\") " pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.912883 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.912807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5451f007-016f-4f65-91d8-1751073e2e0a-tmp-dir\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.912883 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:03.912815 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:03.912883 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:03.912872 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:51:04.412854406 +0000 UTC m=+36.145503692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:03.913120 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.913102 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5451f007-016f-4f65-91d8-1751073e2e0a-config-volume\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.917283 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.917156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d27c6e5c-87f9-4ac3-a787-077dad3b1638-cert\") pod \"ingress-canary-mxcpr\" (UID: \"d27c6e5c-87f9-4ac3-a787-077dad3b1638\") " pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.923959 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.923936 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8v7\" (UniqueName: \"kubernetes.io/projected/5451f007-016f-4f65-91d8-1751073e2e0a-kube-api-access-lc8v7\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:03.924207 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.924188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftkqz\" (UniqueName: \"kubernetes.io/projected/d27c6e5c-87f9-4ac3-a787-077dad3b1638-kube-api-access-ftkqz\") pod \"ingress-canary-mxcpr\" (UID: \"d27c6e5c-87f9-4ac3-a787-077dad3b1638\") " pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:03.980996 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:03.980968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mxcpr" Jun 11 19:51:04.175456 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.175426 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mxcpr"] Jun 11 19:51:04.179152 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:51:04.179130 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27c6e5c_87f9_4ac3_a787_077dad3b1638.slice/crio-9e0f7e6da44fe1c1ff42042317cd4f16257ee863c4742efd0db1c0fe2e5be41a WatchSource:0}: Error finding container 9e0f7e6da44fe1c1ff42042317cd4f16257ee863c4742efd0db1c0fe2e5be41a: Status 404 returned error can't find the container with id 9e0f7e6da44fe1c1ff42042317cd4f16257ee863c4742efd0db1c0fe2e5be41a Jun 11 19:51:04.416431 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.416384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:04.416624 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:04.416534 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:04.416624 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:04.416588 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:51:05.416573929 +0000 UTC m=+37.149223215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:04.700340 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.700304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:51:04.700839 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.700319 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:04.704312 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.704292 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvws7\"" Jun 11 19:51:04.705013 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.704992 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:51:04.705645 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.705462 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:51:04.858389 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:04.858327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mxcpr" event={"ID":"d27c6e5c-87f9-4ac3-a787-077dad3b1638","Type":"ContainerStarted","Data":"9e0f7e6da44fe1c1ff42042317cd4f16257ee863c4742efd0db1c0fe2e5be41a"} Jun 11 19:51:05.426678 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:05.426642 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:05.426850 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:05.426788 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:05.426910 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:05.426860 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:51:07.426844337 +0000 UTC m=+39.159493627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:06.865741 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:06.865458 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mxcpr" event={"ID":"d27c6e5c-87f9-4ac3-a787-077dad3b1638","Type":"ContainerStarted","Data":"3d5ac9a85dee2fe6a8e3ec49beeb8bc4808778686adb321415b62a1b84e76aa8"} Jun 11 19:51:06.887706 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:06.887639 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mxcpr" podStartSLOduration=1.606257368 podStartE2EDuration="3.887619335s" totalImagesPullingTime="2.281361967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:06.885977913 +0000 UTC m=+38.618627222" watchObservedRunningTime="2026-06-11 19:51:06.887619335 +0000 UTC m=+38.620268644" Jun 11 19:51:07.442176 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:07.442141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:07.442372 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:07.442306 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:07.442441 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:07.442377 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:51:11.442359129 +0000 UTC m=+43.175008414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:08.872691 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:08.872657 2580 generic.go:356] "Generic (PLEG): container finished" podID="554b2a51-977a-4f82-a5de-44d1518daf17" containerID="72f5d844545eece1047ca73273678d34575c039cf3963adc51949e7b51b38f14" exitCode=0 Jun 11 19:51:08.873306 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:08.872699 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerDied","Data":"72f5d844545eece1047ca73273678d34575c039cf3963adc51949e7b51b38f14"} Jun 11 19:51:09.878225 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:09.878188 2580 generic.go:356] "Generic (PLEG): container finished" podID="554b2a51-977a-4f82-a5de-44d1518daf17" containerID="7efffaedd0ab8b3e8c805c5f4e889189a75db4711746f57ade0f52c38023de4b" exitCode=0 Jun 11 19:51:09.878701 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:09.878251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerDied","Data":"7efffaedd0ab8b3e8c805c5f4e889189a75db4711746f57ade0f52c38023de4b"} Jun 11 19:51:10.883126 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:10.883088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txlh8" event={"ID":"554b2a51-977a-4f82-a5de-44d1518daf17","Type":"ContainerStarted","Data":"52b2cad4709e75f07bcf7ccab011fbc489250947a56844de04e7fcbb0f4c64ac"} Jun 11 19:51:10.907906 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:10.907856 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-txlh8" podStartSLOduration=8.948160655 podStartE2EDuration="42.907842542s" totalImagesPullingTime="33.959681887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:10.906244903 +0000 UTC m=+42.638894222" watchObservedRunningTime="2026-06-11 19:51:10.907842542 +0000 UTC m=+42.640491859" Jun 11 19:51:11.469529 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:11.469473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:11.469703 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:11.469617 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:11.469703 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:11.469688 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:51:19.469668859 +0000 UTC m=+51.202318150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:19.526210 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:19.526177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:19.526672 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:19.526299 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:19.526672 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:19.526351 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:51:35.526338328 +0000 UTC m=+67.258987614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:29.852653 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:29.852619 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mdzcf" Jun 11 19:51:32.241878 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.241846 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw"] Jun 11 19:51:32.244595 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.244566 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.248766 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.248739 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 19:51:32.248891 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.248779 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 19:51:32.248891 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.248741 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 19:51:32.249982 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.249945 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 19:51:32.250085 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.249981 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 19:51:32.250085 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.250020 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 19:51:32.250085 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.249990 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 19:51:32.268466 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.268445 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw"] Jun 11 19:51:32.313714 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.313689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.313830 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.313720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-ca\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.313830 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.313736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-hub\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.313830 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.313798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4bx\" (UniqueName: \"kubernetes.io/projected/cb2d2b04-d3b0-46af-945e-7916b04370ef-kube-api-access-rk4bx\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.313931 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.313844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.313931 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.313875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2d2b04-d3b0-46af-945e-7916b04370ef-additional-service-ca\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414224 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414333 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2d2b04-d3b0-46af-945e-7916b04370ef-additional-service-ca\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414333 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414454 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414434 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-ca\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414491 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-hub\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414577 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414545 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4bx\" (UniqueName: \"kubernetes.io/projected/cb2d2b04-d3b0-46af-945e-7916b04370ef-kube-api-access-rk4bx\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.414938 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.414920 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb2d2b04-d3b0-46af-945e-7916b04370ef-additional-service-ca\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.417829 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.417800 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-hub\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.418007 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.417845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.418007 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.417891 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-ca\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.418007 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.417946 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cb2d2b04-d3b0-46af-945e-7916b04370ef-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.432714 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.432681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4bx\" (UniqueName: \"kubernetes.io/projected/cb2d2b04-d3b0-46af-945e-7916b04370ef-kube-api-access-rk4bx\") pod \"cluster-proxy-proxy-agent-579d49d487-m74mw\" (UID: \"cb2d2b04-d3b0-46af-945e-7916b04370ef\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.564122 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.564066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:51:32.693416 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.693386 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw"] Jun 11 19:51:32.696274 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:51:32.696251 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb2d2b04_d3b0_46af_945e_7916b04370ef.slice/crio-b4e09e6776932d49447d675cc10a695ea99a0c54964c3e0fa40521b9dda33081 WatchSource:0}: Error finding container b4e09e6776932d49447d675cc10a695ea99a0c54964c3e0fa40521b9dda33081: Status 404 returned error can't find the container with id b4e09e6776932d49447d675cc10a695ea99a0c54964c3e0fa40521b9dda33081 Jun 11 19:51:32.935397 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:32.935360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" event={"ID":"cb2d2b04-d3b0-46af-945e-7916b04370ef","Type":"ContainerStarted","Data":"b4e09e6776932d49447d675cc10a695ea99a0c54964c3e0fa40521b9dda33081"} Jun 11 19:51:34.430890 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.430850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:51:34.433504 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.433477 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:51:34.441541 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:34.441490 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:51:34.441684 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:34.441582 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:52:38.441565701 +0000 UTC m=+130.174214987 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : secret "metrics-daemon-secret" not found Jun 11 19:51:34.531619 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.531585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:34.531769 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.531637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:34.534546 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.534509 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:51:34.534669 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.534565 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:51:34.544615 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.544592 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:51:34.544873 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.544857 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fa993e36-9370-45f1-9bcd-d2fdc5543128-original-pull-secret\") pod \"global-pull-secret-syncer-w7djb\" (UID: \"fa993e36-9370-45f1-9bcd-d2fdc5543128\") " pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:34.555658 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.555638 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxnjl\" (UniqueName: \"kubernetes.io/projected/e64263b1-f99d-4add-9fd0-4863b1d47a28-kube-api-access-zxnjl\") pod \"network-check-target-7twtv\" (UID: \"e64263b1-f99d-4add-9fd0-4863b1d47a28\") " pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:34.611229 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.611204 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rmmv\"" Jun 11 19:51:34.619213 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.619198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:34.719218 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.718944 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w7djb" Jun 11 19:51:34.755946 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.755910 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7twtv"] Jun 11 19:51:34.759497 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:51:34.759465 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64263b1_f99d_4add_9fd0_4863b1d47a28.slice/crio-ba2654309be9cddf6f79750264dfac5add6d9df643d1f13bf8f268c5bce0a752 WatchSource:0}: Error finding container ba2654309be9cddf6f79750264dfac5add6d9df643d1f13bf8f268c5bce0a752: Status 404 returned error can't find the container with id ba2654309be9cddf6f79750264dfac5add6d9df643d1f13bf8f268c5bce0a752 Jun 11 19:51:34.855054 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.855019 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w7djb"] Jun 11 19:51:34.857912 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:51:34.857891 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa993e36_9370_45f1_9bcd_d2fdc5543128.slice/crio-4b23bdd4ff201bdcd411b49a4972ed249e97060bdc7c378f6813b927c64fbfa1 WatchSource:0}: Error finding container 4b23bdd4ff201bdcd411b49a4972ed249e97060bdc7c378f6813b927c64fbfa1: Status 404 returned error can't find the container with id 4b23bdd4ff201bdcd411b49a4972ed249e97060bdc7c378f6813b927c64fbfa1 Jun 11 19:51:34.942348 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.942310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7twtv" event={"ID":"e64263b1-f99d-4add-9fd0-4863b1d47a28","Type":"ContainerStarted","Data":"ba2654309be9cddf6f79750264dfac5add6d9df643d1f13bf8f268c5bce0a752"} Jun 11 19:51:34.943569 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:34.943541 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w7djb" event={"ID":"fa993e36-9370-45f1-9bcd-d2fdc5543128","Type":"ContainerStarted","Data":"4b23bdd4ff201bdcd411b49a4972ed249e97060bdc7c378f6813b927c64fbfa1"} Jun 11 19:51:35.542777 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:35.542740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:51:35.543238 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:35.542921 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:51:35.543238 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:51:35.543006 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:52:07.54298474 +0000 UTC m=+99.275634049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:51:39.958115 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.958065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7twtv" event={"ID":"e64263b1-f99d-4add-9fd0-4863b1d47a28","Type":"ContainerStarted","Data":"7aaf06185a802d5fa4222683e883da2df53058819ef7da2f823b80b61a35ba50"} Jun 11 19:51:39.958554 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.958167 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:51:39.959980 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.959957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" event={"ID":"cb2d2b04-d3b0-46af-945e-7916b04370ef","Type":"ContainerStarted","Data":"f600e4e70f65542e75b438c8939d0275d19faabe6fb24bceb145c848a91b545a"} Jun 11 19:51:39.960082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.959991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" event={"ID":"cb2d2b04-d3b0-46af-945e-7916b04370ef","Type":"ContainerStarted","Data":"5bbe8414542679fc351ca44e48d5333be872649eda82e66eaacaa681a4005eeb"} Jun 11 19:51:39.960082 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.960009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" event={"ID":"cb2d2b04-d3b0-46af-945e-7916b04370ef","Type":"ContainerStarted","Data":"9d2ab8afd02cd3a6aa553f746b709696d62d3b5d235dacf89a4840052f3c59c0"} Jun 11 19:51:39.972804 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.972763 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7twtv" podStartSLOduration=67.787196026 podStartE2EDuration="1m11.972751026s" totalImagesPullingTime="4.185555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:39.972030212 +0000 UTC m=+71.704679519" watchObservedRunningTime="2026-06-11 19:51:39.972751026 +0000 UTC m=+71.705400324" Jun 11 19:51:39.989252 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:39.989098 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" podStartSLOduration=1.735318946 podStartE2EDuration="7.989088018s" totalImagesPullingTime="6.253769072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:39.988762237 +0000 UTC m=+71.721411544" watchObservedRunningTime="2026-06-11 19:51:39.989088018 +0000 UTC m=+71.721737328" Jun 11 19:51:42.970184 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:42.970131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w7djb" event={"ID":"fa993e36-9370-45f1-9bcd-d2fdc5543128","Type":"ContainerStarted","Data":"73cc13fbf12aca339f0a6fe2e7b4bebddab4c043b50cd3487ccb4bba27e3f6b7"} Jun 11 19:51:42.985333 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:51:42.985285 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w7djb" podStartSLOduration=66.912453901 podStartE2EDuration="1m13.9852693s" totalImagesPullingTime="7.072815399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:51:42.984415643 +0000 UTC m=+74.717064950" watchObservedRunningTime="2026-06-11 19:51:42.9852693 +0000 UTC m=+74.717918608" Jun 11 19:52:07.545236 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:52:07.545186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:52:07.545656 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:52:07.545320 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:52:07.545656 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:52:07.545387 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:53:11.545369947 +0000 UTC m=+163.278019236 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:52:10.964929 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:52:10.964901 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7twtv" Jun 11 19:52:38.444622 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:52:38.444561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:52:38.445084 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:52:38.444732 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:52:38.445084 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:52:38.444823 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs podName:d4f6fc2a-3608-4f30-8125-6e39c83d1b36 nodeName:}" failed. No retries permitted until 2026-06-11 19:54:40.444806577 +0000 UTC m=+252.177455863 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs") pod "network-metrics-daemon-g2nlh" (UID: "d4f6fc2a-3608-4f30-8125-6e39c83d1b36") : secret "metrics-daemon-secret" not found Jun 11 19:53:06.693742 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:06.693650 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vv2n5" podUID="5451f007-016f-4f65-91d8-1751073e2e0a" Jun 11 19:53:07.197875 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:07.197848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv2n5" Jun 11 19:53:07.713975 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:07.713947 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g2nlh" podUID="d4f6fc2a-3608-4f30-8125-6e39c83d1b36" Jun 11 19:53:11.569278 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:11.569245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:53:11.569676 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:11.569352 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:53:11.569676 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:11.569404 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls podName:5451f007-016f-4f65-91d8-1751073e2e0a nodeName:}" failed. No retries permitted until 2026-06-11 19:55:13.569391398 +0000 UTC m=+285.302040683 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls") pod "dns-default-vv2n5" (UID: "5451f007-016f-4f65-91d8-1751073e2e0a") : secret "dns-default-metrics-tls" not found Jun 11 19:53:18.702252 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:18.702217 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:53:46.899638 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.899608 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr"] Jun 11 19:53:46.901369 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.901354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" Jun 11 19:53:46.903866 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.903847 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 19:53:46.903960 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.903874 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:53:46.903960 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.903878 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ctk76\"" Jun 11 19:53:46.912247 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.912223 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr"] Jun 11 19:53:46.997291 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:46.997263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9sts\" (UniqueName: \"kubernetes.io/projected/d34d3717-b8e5-432e-9525-87428036c6d9-kube-api-access-j9sts\") pod \"volume-data-source-validator-bd4ccd799-5c2gr\" (UID: \"d34d3717-b8e5-432e-9525-87428036c6d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" Jun 11 19:53:47.098088 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:47.098061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9sts\" (UniqueName: \"kubernetes.io/projected/d34d3717-b8e5-432e-9525-87428036c6d9-kube-api-access-j9sts\") pod \"volume-data-source-validator-bd4ccd799-5c2gr\" (UID: \"d34d3717-b8e5-432e-9525-87428036c6d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" Jun 11 19:53:47.106163 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:47.106127 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9sts\" (UniqueName: \"kubernetes.io/projected/d34d3717-b8e5-432e-9525-87428036c6d9-kube-api-access-j9sts\") pod \"volume-data-source-validator-bd4ccd799-5c2gr\" (UID: \"d34d3717-b8e5-432e-9525-87428036c6d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" Jun 11 19:53:47.210100 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:47.210079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" Jun 11 19:53:47.328481 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:47.328448 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr"] Jun 11 19:53:47.332134 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:53:47.332107 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34d3717_b8e5_432e_9525_87428036c6d9.slice/crio-94270e71f37d4ee5ca79deba5b93eda715a4db245d752ca2908a952a06bbf9bc WatchSource:0}: Error finding container 94270e71f37d4ee5ca79deba5b93eda715a4db245d752ca2908a952a06bbf9bc: Status 404 returned error can't find the container with id 94270e71f37d4ee5ca79deba5b93eda715a4db245d752ca2908a952a06bbf9bc Jun 11 19:53:48.312272 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:48.312235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" event={"ID":"d34d3717-b8e5-432e-9525-87428036c6d9","Type":"ContainerStarted","Data":"c22d1d568404c7ec324020920f3d828d59387e212a958fbc621d22b742fe40ef"} Jun 11 19:53:48.312637 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:48.312291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" event={"ID":"d34d3717-b8e5-432e-9525-87428036c6d9","Type":"ContainerStarted","Data":"94270e71f37d4ee5ca79deba5b93eda715a4db245d752ca2908a952a06bbf9bc"} Jun 11 19:53:51.721205 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.721143 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-5c2gr" podStartSLOduration=4.949032224 podStartE2EDuration="5.721127963s" totalImagesPullingTime="772.095739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:53:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:53:48.326257034 +0000 UTC m=+200.058906342" watchObservedRunningTime="2026-06-11 19:53:51.721127963 +0000 UTC m=+203.453777271" Jun 11 19:53:51.721979 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.721957 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m5jdd"] Jun 11 19:53:51.723785 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.723766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.726411 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.726376 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:53:51.726499 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.726412 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kckmb\"" Jun 11 19:53:51.726499 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.726431 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:53:51.726499 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.726388 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 19:53:51.727537 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.727500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/198dcfd0-4e75-4406-82c8-0de70c25945e-crio-socket\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.727589 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.727507 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 19:53:51.727589 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.727575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/198dcfd0-4e75-4406-82c8-0de70c25945e-data-volume\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.727667 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.727598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.727667 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.727617 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.727757 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.727670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrh4\" (UniqueName: \"kubernetes.io/projected/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-api-access-lvrh4\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.740479 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.740460 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5jdd"] Jun 11 19:53:51.827990 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.827961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/198dcfd0-4e75-4406-82c8-0de70c25945e-data-volume\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.828107 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.827996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.828107 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.828014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.828107 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.828046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrh4\" (UniqueName: \"kubernetes.io/projected/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-api-access-lvrh4\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.828107 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.828102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/198dcfd0-4e75-4406-82c8-0de70c25945e-crio-socket\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.828291 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:51.828108 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:51.828291 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:51.828146 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:51.828291 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.828181 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/198dcfd0-4e75-4406-82c8-0de70c25945e-crio-socket\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.828291 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:51.828194 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:52.328172798 +0000 UTC m=+204.060822089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : configmap "kube-rbac-proxy" not found Jun 11 19:53:51.828291 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:51.828215 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:52.32820479 +0000 UTC m=+204.060854078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:51.828446 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.828299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/198dcfd0-4e75-4406-82c8-0de70c25945e-data-volume\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:51.838454 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:51.838423 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrh4\" (UniqueName: \"kubernetes.io/projected/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-api-access-lvrh4\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:52.332039 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:52.332007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:52.332039 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:52.332038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:52.332249 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:52.332129 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:52.332249 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:52.332155 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:52.332249 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:52.332184 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:53.332169921 +0000 UTC m=+205.064819206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : configmap "kube-rbac-proxy" not found Jun 11 19:53:52.332249 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:52.332207 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:53.332195092 +0000 UTC m=+205.064844380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:53.339308 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:53.339281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:53.339308 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:53.339311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:53.339815 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:53.339402 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:53.339815 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:53.339414 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:53.339815 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:53.339469 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:55.339456038 +0000 UTC m=+207.072105325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:53.339815 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:53.339481 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:55.339474591 +0000 UTC m=+207.072123877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : configmap "kube-rbac-proxy" not found Jun 11 19:53:53.695459 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:53.695430 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5qcp_fa9d0da4-8840-4921-a546-9e6edbe6d09f/dns-node-resolver/0.log" Jun 11 19:53:54.896804 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:54.896778 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf86k_020ce4c2-f485-434b-b713-a982de3f269a/node-ca/0.log" Jun 11 19:53:55.352557 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:55.352510 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:55.352744 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:55.352560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:55.352744 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:55.352626 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:55.352744 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:55.352692 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.352675155 +0000 UTC m=+211.085324449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : configmap "kube-rbac-proxy" not found Jun 11 19:53:55.352744 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:55.352700 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:55.352906 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:55.352756 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:53:59.352732505 +0000 UTC m=+211.085381792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:55.697849 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:55.697822 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mxcpr_d27c6e5c-87f9-4ac3-a787-077dad3b1638/serve-healthcheck-canary/0.log" Jun 11 19:53:59.381611 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:59.381579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:59.381611 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:53:59.381614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:53:59.382077 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:59.381699 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:53:59.382077 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:59.381723 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:53:59.382077 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:59.381771 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:54:07.381757416 +0000 UTC m=+219.114406702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : secret "insights-runtime-extractor-tls" not found Jun 11 19:53:59.382077 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:53:59.381788 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm podName:198dcfd0-4e75-4406-82c8-0de70c25945e nodeName:}" failed. No retries permitted until 2026-06-11 19:54:07.381778371 +0000 UTC m=+219.114427657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m5jdd" (UID: "198dcfd0-4e75-4406-82c8-0de70c25945e") : configmap "kube-rbac-proxy" not found Jun 11 19:54:07.439885 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:07.439838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:54:07.439885 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:07.439887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:54:07.440473 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:07.440447 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/198dcfd0-4e75-4406-82c8-0de70c25945e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:54:07.442268 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:07.442240 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/198dcfd0-4e75-4406-82c8-0de70c25945e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m5jdd\" (UID: \"198dcfd0-4e75-4406-82c8-0de70c25945e\") " pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:54:07.632384 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:07.632346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m5jdd" Jun 11 19:54:07.753751 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:07.753723 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m5jdd"] Jun 11 19:54:07.756472 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:07.756444 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198dcfd0_4e75_4406_82c8_0de70c25945e.slice/crio-e9e34b9dbb8bae5b1bbdef75e585f8f4c9df1dd3ca306e63fd3cf600fa12503a WatchSource:0}: Error finding container e9e34b9dbb8bae5b1bbdef75e585f8f4c9df1dd3ca306e63fd3cf600fa12503a: Status 404 returned error can't find the container with id e9e34b9dbb8bae5b1bbdef75e585f8f4c9df1dd3ca306e63fd3cf600fa12503a Jun 11 19:54:08.370755 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:08.370704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5jdd" event={"ID":"198dcfd0-4e75-4406-82c8-0de70c25945e","Type":"ContainerStarted","Data":"e9e34b9dbb8bae5b1bbdef75e585f8f4c9df1dd3ca306e63fd3cf600fa12503a"} Jun 11 19:54:11.380513 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:11.380483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5jdd" event={"ID":"198dcfd0-4e75-4406-82c8-0de70c25945e","Type":"ContainerStarted","Data":"b132da20937960a7eeaf8502f3e601cb5c07a15e638a95e7a229bcfdc3ef465b"} Jun 11 19:54:12.385373 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:12.385331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5jdd" event={"ID":"198dcfd0-4e75-4406-82c8-0de70c25945e","Type":"ContainerStarted","Data":"9ab0935a287dc59be63abfc2381fa24dc235c0648f0612814336bc67317331cd"} Jun 11 19:54:14.393787 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:14.393751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m5jdd" event={"ID":"198dcfd0-4e75-4406-82c8-0de70c25945e","Type":"ContainerStarted","Data":"297dcc2c55f972c7af07311b725ce9f96aec832927c72997314e801c4f844327"} Jun 11 19:54:14.409747 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:14.409691 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m5jdd" podStartSLOduration=17.650874918 podStartE2EDuration="23.409676726s" totalImagesPullingTime="5.758801808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:53:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:14.409274 +0000 UTC m=+226.141923352" watchObservedRunningTime="2026-06-11 19:54:14.409676726 +0000 UTC m=+226.142326033" Jun 11 19:54:16.108550 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.108502 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-56dqc"] Jun 11 19:54:16.111302 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.111286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:16.113647 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.113616 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 19:54:16.113778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.113660 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 19:54:16.114163 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.114144 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j7pnl\"" Jun 11 19:54:16.121341 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.121320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-56dqc"] Jun 11 19:54:16.139531 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.139492 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59855895df-7jfvv"] Jun 11 19:54:16.142265 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.142249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.144724 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.144702 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 19:54:16.144823 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.144762 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 19:54:16.145370 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.145344 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 19:54:16.146069 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.146048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zmxhm\"" Jun 11 19:54:16.152263 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.152237 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 19:54:16.160967 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.160936 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59855895df-7jfvv"] Jun 11 19:54:16.200398 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-registry-tls\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200503 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-trusted-ca\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200503 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-bound-sa-token\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200503 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-ca-trust-extracted\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200692 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4hb\" (UniqueName: \"kubernetes.io/projected/5ce33af0-ea35-43c6-a8b9-33e44b9f8251-kube-api-access-ch4hb\") pod \"downloads-694c955b9-56dqc\" (UID: \"5ce33af0-ea35-43c6-a8b9-33e44b9f8251\") " pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:16.200692 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmt6b\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-kube-api-access-tmt6b\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200692 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-image-registry-private-configuration\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200692 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-installation-pull-secrets\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.200692 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.200660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-registry-certificates\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.301778 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-trusted-ca\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.301886 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-bound-sa-token\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.301886 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-ca-trust-extracted\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.301886 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4hb\" (UniqueName: \"kubernetes.io/projected/5ce33af0-ea35-43c6-a8b9-33e44b9f8251-kube-api-access-ch4hb\") pod \"downloads-694c955b9-56dqc\" (UID: \"5ce33af0-ea35-43c6-a8b9-33e44b9f8251\") " pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:16.301886 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmt6b\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-kube-api-access-tmt6b\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.302087 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-image-registry-private-configuration\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.302087 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.301935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-installation-pull-secrets\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.302172 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.302099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-registry-certificates\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.302247 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.302220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-registry-tls\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.302306 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.302255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-ca-trust-extracted\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.302807 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.302774 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-registry-certificates\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.303041 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.303019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-trusted-ca\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.304593 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.304568 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-installation-pull-secrets\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.304593 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.304586 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-image-registry-private-configuration\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.304697 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.304619 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-registry-tls\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.311826 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.311801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmt6b\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-kube-api-access-tmt6b\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.312185 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.312161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d5f09fe-1c4e-4a42-b479-ccdc33840f29-bound-sa-token\") pod \"image-registry-59855895df-7jfvv\" (UID: \"5d5f09fe-1c4e-4a42-b479-ccdc33840f29\") " pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.313951 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.313934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4hb\" (UniqueName: \"kubernetes.io/projected/5ce33af0-ea35-43c6-a8b9-33e44b9f8251-kube-api-access-ch4hb\") pod \"downloads-694c955b9-56dqc\" (UID: \"5ce33af0-ea35-43c6-a8b9-33e44b9f8251\") " pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:16.420184 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.420165 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:16.453131 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.453105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:16.562429 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.562390 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-56dqc"] Jun 11 19:54:16.566238 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:16.566204 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce33af0_ea35_43c6_a8b9_33e44b9f8251.slice/crio-c9700579d7a7022e323ffc129745bac9ee53e519bf6c3655e03d4912a951e696 WatchSource:0}: Error finding container c9700579d7a7022e323ffc129745bac9ee53e519bf6c3655e03d4912a951e696: Status 404 returned error can't find the container with id c9700579d7a7022e323ffc129745bac9ee53e519bf6c3655e03d4912a951e696 Jun 11 19:54:16.582623 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:16.582601 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59855895df-7jfvv"] Jun 11 19:54:16.585301 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:16.585276 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5f09fe_1c4e_4a42_b479_ccdc33840f29.slice/crio-1b50ecab18c6367cf37a6e8aeef5aafc9afed3342a113784b7aed53c7e308a34 WatchSource:0}: Error finding container 1b50ecab18c6367cf37a6e8aeef5aafc9afed3342a113784b7aed53c7e308a34: Status 404 returned error can't find the container with id 1b50ecab18c6367cf37a6e8aeef5aafc9afed3342a113784b7aed53c7e308a34 Jun 11 19:54:17.407045 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:17.407001 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59855895df-7jfvv" event={"ID":"5d5f09fe-1c4e-4a42-b479-ccdc33840f29","Type":"ContainerStarted","Data":"a8480c918f78cb08f1afb14291de67820bbcd09bda9d1a82bcc6cebd29e4886d"} Jun 11 19:54:17.407542 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:17.407070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59855895df-7jfvv" event={"ID":"5d5f09fe-1c4e-4a42-b479-ccdc33840f29","Type":"ContainerStarted","Data":"1b50ecab18c6367cf37a6e8aeef5aafc9afed3342a113784b7aed53c7e308a34"} Jun 11 19:54:17.407542 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:17.407135 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:17.408311 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:17.408289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-56dqc" event={"ID":"5ce33af0-ea35-43c6-a8b9-33e44b9f8251","Type":"ContainerStarted","Data":"c9700579d7a7022e323ffc129745bac9ee53e519bf6c3655e03d4912a951e696"} Jun 11 19:54:17.425958 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:17.425907 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podStartSLOduration=1.425894988 podStartE2EDuration="1.425894988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:17.424694414 +0000 UTC m=+229.157343723" watchObservedRunningTime="2026-06-11 19:54:17.425894988 +0000 UTC m=+229.158544295" Jun 11 19:54:21.401122 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.401087 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw"] Jun 11 19:54:21.405283 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.405257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:21.407762 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.407707 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 19:54:21.407762 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.407751 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mkzgh\"" Jun 11 19:54:21.412095 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.412073 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw"] Jun 11 19:54:21.444815 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.444782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/697c1e0f-e454-4530-8f56-9f91be6a1ba7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pv7sw\" (UID: \"697c1e0f-e454-4530-8f56-9f91be6a1ba7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:21.545227 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.545204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/697c1e0f-e454-4530-8f56-9f91be6a1ba7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pv7sw\" (UID: \"697c1e0f-e454-4530-8f56-9f91be6a1ba7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:21.548017 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.547991 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/697c1e0f-e454-4530-8f56-9f91be6a1ba7-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-pv7sw\" (UID: \"697c1e0f-e454-4530-8f56-9f91be6a1ba7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:21.716212 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.716176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:21.846608 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:21.846577 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw"] Jun 11 19:54:21.850314 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:21.850283 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697c1e0f_e454_4530_8f56_9f91be6a1ba7.slice/crio-64c4aef3f3ead7cf67b828cf3479ed1ddb8b137be6405126ed4648c909349141 WatchSource:0}: Error finding container 64c4aef3f3ead7cf67b828cf3479ed1ddb8b137be6405126ed4648c909349141: Status 404 returned error can't find the container with id 64c4aef3f3ead7cf67b828cf3479ed1ddb8b137be6405126ed4648c909349141 Jun 11 19:54:22.426221 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:22.426180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" event={"ID":"697c1e0f-e454-4530-8f56-9f91be6a1ba7","Type":"ContainerStarted","Data":"64c4aef3f3ead7cf67b828cf3479ed1ddb8b137be6405126ed4648c909349141"} Jun 11 19:54:23.430119 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:23.430085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" event={"ID":"697c1e0f-e454-4530-8f56-9f91be6a1ba7","Type":"ContainerStarted","Data":"0bcaafe1710f48ce418ab2a7cd137a7a801452132791421cf03fb400449bd708"} Jun 11 19:54:23.430543 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:23.430294 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:23.434892 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:23.434872 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" Jun 11 19:54:23.447184 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:23.447143 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-pv7sw" podStartSLOduration=1.207791968 podStartE2EDuration="2.447130648s" totalImagesPullingTime="1.23933868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:23.445771249 +0000 UTC m=+235.178420557" watchObservedRunningTime="2026-06-11 19:54:23.447130648 +0000 UTC m=+235.179779958" Jun 11 19:54:29.781241 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.781208 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2"] Jun 11 19:54:29.785808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.785785 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:29.789563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.789353 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 19:54:29.789563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.789387 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 19:54:29.789563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.789399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ks458\"" Jun 11 19:54:29.789563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.789408 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 19:54:29.789563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.789560 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 19:54:29.789898 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.789677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 19:54:29.795289 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.795256 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2"] Jun 11 19:54:29.824511 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.824482 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sq27b"] Jun 11 19:54:29.827842 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.827818 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.830053 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.830031 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 19:54:29.830178 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.830101 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 19:54:29.830178 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.830136 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nrhtz\"" Jun 11 19:54:29.830384 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.830360 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 19:54:29.913841 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.913808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54cv5\" (UniqueName: \"kubernetes.io/projected/9e87c087-46b0-424f-956f-92cf9912bac9-kube-api-access-54cv5\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.913991 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.913841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2nq6\" (UniqueName: \"kubernetes.io/projected/c6d77985-212b-4bb8-a073-523e7e9d5c41-kube-api-access-k2nq6\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:29.913991 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.913875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-root\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.913991 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.913890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-tls\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.913991 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.913957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-textfile\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.914185 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.913996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-wtmp\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.914185 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-sys\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.914185 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e87c087-46b0-424f-956f-92cf9912bac9-metrics-client-ca\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.914185 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.914185 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6d77985-212b-4bb8-a073-523e7e9d5c41-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:29.914353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914186 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6d77985-212b-4bb8-a073-523e7e9d5c41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:29.914353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:29.914353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:29.914232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6d77985-212b-4bb8-a073-523e7e9d5c41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.014753 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-wtmp\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014753 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-sys\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e87c087-46b0-424f-956f-92cf9912bac9-metrics-client-ca\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014793 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6d77985-212b-4bb8-a073-523e7e9d5c41-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-wtmp\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6d77985-212b-4bb8-a073-523e7e9d5c41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014877 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-sys\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.014968 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6d77985-212b-4bb8-a073-523e7e9d5c41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.015353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.014974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54cv5\" (UniqueName: \"kubernetes.io/projected/9e87c087-46b0-424f-956f-92cf9912bac9-kube-api-access-54cv5\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2nq6\" (UniqueName: \"kubernetes.io/projected/c6d77985-212b-4bb8-a073-523e7e9d5c41-kube-api-access-k2nq6\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.015353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-root\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-tls\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-textfile\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015357 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-textfile\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e87c087-46b0-424f-956f-92cf9912bac9-root\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015559 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e87c087-46b0-424f-956f-92cf9912bac9-metrics-client-ca\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015557 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.015636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.015620 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6d77985-212b-4bb8-a073-523e7e9d5c41-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.018000 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.017970 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.018103 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.018090 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e87c087-46b0-424f-956f-92cf9912bac9-node-exporter-tls\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.018372 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.018351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6d77985-212b-4bb8-a073-523e7e9d5c41-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.018447 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.018393 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c6d77985-212b-4bb8-a073-523e7e9d5c41-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.025029 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.025002 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2nq6\" (UniqueName: \"kubernetes.io/projected/c6d77985-212b-4bb8-a073-523e7e9d5c41-kube-api-access-k2nq6\") pod \"openshift-state-metrics-6b8d965dd5-c22w2\" (UID: \"c6d77985-212b-4bb8-a073-523e7e9d5c41\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.025475 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.025439 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54cv5\" (UniqueName: \"kubernetes.io/projected/9e87c087-46b0-424f-956f-92cf9912bac9-kube-api-access-54cv5\") pod \"node-exporter-sq27b\" (UID: \"9e87c087-46b0-424f-956f-92cf9912bac9\") " pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.096727 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.096653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" Jun 11 19:54:30.138048 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.138021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sq27b" Jun 11 19:54:30.152172 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:30.151505 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e87c087_46b0_424f_956f_92cf9912bac9.slice/crio-e9c34e4ba67f3298d69e5b0d7d363f6e0f9f0d3d97ca50f541b53ba0a5217ad4 WatchSource:0}: Error finding container e9c34e4ba67f3298d69e5b0d7d363f6e0f9f0d3d97ca50f541b53ba0a5217ad4: Status 404 returned error can't find the container with id e9c34e4ba67f3298d69e5b0d7d363f6e0f9f0d3d97ca50f541b53ba0a5217ad4 Jun 11 19:54:30.231071 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.231044 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2"] Jun 11 19:54:30.233794 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:30.233767 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d77985_212b_4bb8_a073_523e7e9d5c41.slice/crio-05fefbc32e6ce9a8d8addd9acf875cb802fc3cb7f64255a53471dcf8ba95050b WatchSource:0}: Error finding container 05fefbc32e6ce9a8d8addd9acf875cb802fc3cb7f64255a53471dcf8ba95050b: Status 404 returned error can't find the container with id 05fefbc32e6ce9a8d8addd9acf875cb802fc3cb7f64255a53471dcf8ba95050b Jun 11 19:54:30.454398 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.454363 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" event={"ID":"c6d77985-212b-4bb8-a073-523e7e9d5c41","Type":"ContainerStarted","Data":"f8c6115b199fcf2d31fc6dcac3f840b31942c5a5570bb660885195ec8639b9a4"} Jun 11 19:54:30.454559 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.454434 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" event={"ID":"c6d77985-212b-4bb8-a073-523e7e9d5c41","Type":"ContainerStarted","Data":"d359f317c718cd447524ecf28ddc1e0c27e66cf3b73cfd2a3e37c3aff172d598"} Jun 11 19:54:30.454559 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.454456 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" event={"ID":"c6d77985-212b-4bb8-a073-523e7e9d5c41","Type":"ContainerStarted","Data":"05fefbc32e6ce9a8d8addd9acf875cb802fc3cb7f64255a53471dcf8ba95050b"} Jun 11 19:54:30.455298 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:30.455279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sq27b" event={"ID":"9e87c087-46b0-424f-956f-92cf9912bac9","Type":"ContainerStarted","Data":"e9c34e4ba67f3298d69e5b0d7d363f6e0f9f0d3d97ca50f541b53ba0a5217ad4"} Jun 11 19:54:31.776657 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.776623 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6775c7ff48-vb9p8"] Jun 11 19:54:31.782061 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.781103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.784434 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784393 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1qds0ad1sto0t\"" Jun 11 19:54:31.784434 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 19:54:31.784648 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784430 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 19:54:31.784648 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784461 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 19:54:31.784648 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784409 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 19:54:31.784864 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784845 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nbr5j\"" Jun 11 19:54:31.784912 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.784902 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 19:54:31.790392 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.790349 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6775c7ff48-vb9p8"] Jun 11 19:54:31.932641 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-tls\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e446ec60-cade-4e52-80bf-187c3709e951-metrics-client-ca\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-grpc-tls\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932986 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932986 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:31.932986 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:31.932893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brpw4\" (UniqueName: \"kubernetes.io/projected/e446ec60-cade-4e52-80bf-187c3709e951-kube-api-access-brpw4\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033504 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033504 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-grpc-tls\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033732 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033732 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033732 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033732 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brpw4\" (UniqueName: \"kubernetes.io/projected/e446ec60-cade-4e52-80bf-187c3709e951-kube-api-access-brpw4\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.033960 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-tls\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.034066 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.033998 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e446ec60-cade-4e52-80bf-187c3709e951-metrics-client-ca\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.034861 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.034796 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e446ec60-cade-4e52-80bf-187c3709e951-metrics-client-ca\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.036922 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.036876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.037025 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.036981 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.037125 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.037095 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.037241 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.037223 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-grpc-tls\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.037336 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.037314 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.037474 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.037449 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e446ec60-cade-4e52-80bf-187c3709e951-secret-thanos-querier-tls\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.041422 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.041399 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brpw4\" (UniqueName: \"kubernetes.io/projected/e446ec60-cade-4e52-80bf-187c3709e951-kube-api-access-brpw4\") pod \"thanos-querier-6775c7ff48-vb9p8\" (UID: \"e446ec60-cade-4e52-80bf-187c3709e951\") " pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.093385 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.093356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:32.565451 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:32.565407 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" podUID="cb2d2b04-d3b0-46af-945e-7916b04370ef" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 19:54:34.630149 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.630119 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-675769bf84-8x2h6"] Jun 11 19:54:34.633299 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.633279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.635809 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.635791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 19:54:34.636065 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.636045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bqkw8\"" Jun 11 19:54:34.636153 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.636060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 19:54:34.636153 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.636095 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 19:54:34.636242 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.636052 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 19:54:34.636492 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.636471 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 19:54:34.640872 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.640847 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 19:54:34.643372 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.643349 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675769bf84-8x2h6"] Jun 11 19:54:34.755509 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-trusted-ca-bundle\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.755709 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-oauth-config\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.755709 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-oauth-serving-cert\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.755819 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755713 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-service-ca\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.755819 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5pf\" (UniqueName: \"kubernetes.io/projected/3e62d038-b362-4c5a-b4c6-df2ffba540d9-kube-api-access-rb5pf\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.755926 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-serving-cert\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.755926 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.755873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-config\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857296 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-serving-cert\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857296 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-config\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-trusted-ca-bundle\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-oauth-config\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-oauth-serving-cert\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-service-ca\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.857573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.857507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5pf\" (UniqueName: \"kubernetes.io/projected/3e62d038-b362-4c5a-b4c6-df2ffba540d9-kube-api-access-rb5pf\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.858251 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.858219 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-oauth-serving-cert\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.858385 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.858342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-config\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.858453 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.858401 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-service-ca\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.858650 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.858625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-trusted-ca-bundle\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.860305 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.860275 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-oauth-config\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.860415 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.860398 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-serving-cert\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.866434 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.866410 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5pf\" (UniqueName: \"kubernetes.io/projected/3e62d038-b362-4c5a-b4c6-df2ffba540d9-kube-api-access-rb5pf\") pod \"console-675769bf84-8x2h6\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:34.945008 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:34.944976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:36.458344 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:36.458252 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:54:36.458344 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:36.458305 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:54:38.035767 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.035508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675769bf84-8x2h6"] Jun 11 19:54:38.038604 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:38.038574 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e62d038_b362_4c5a_b4c6_df2ffba540d9.slice/crio-fde4ec25c6f0b3f0ec0966a3ee8a5bfb057d87e79874e71a0d8bae38099e681e WatchSource:0}: Error finding container fde4ec25c6f0b3f0ec0966a3ee8a5bfb057d87e79874e71a0d8bae38099e681e: Status 404 returned error can't find the container with id fde4ec25c6f0b3f0ec0966a3ee8a5bfb057d87e79874e71a0d8bae38099e681e Jun 11 19:54:38.058280 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.058228 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6775c7ff48-vb9p8"] Jun 11 19:54:38.061430 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:38.061394 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode446ec60_cade_4e52_80bf_187c3709e951.slice/crio-d9552834824dc17426ef2c1df7038a1bf05ad14cf5c74bf6096fff4e54f557ab WatchSource:0}: Error finding container d9552834824dc17426ef2c1df7038a1bf05ad14cf5c74bf6096fff4e54f557ab: Status 404 returned error can't find the container with id d9552834824dc17426ef2c1df7038a1bf05ad14cf5c74bf6096fff4e54f557ab Jun 11 19:54:38.417745 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.417704 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:54:38.417859 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.417772 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:54:38.493844 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.493279 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-56dqc" event={"ID":"5ce33af0-ea35-43c6-a8b9-33e44b9f8251","Type":"ContainerStarted","Data":"ff5ed4e023906355e36140397ec97b373888ae020e52fbd811201cecdc524fdf"} Jun 11 19:54:38.493844 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.493801 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:38.498415 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.498361 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-56dqc" Jun 11 19:54:38.500618 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.499988 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" event={"ID":"c6d77985-212b-4bb8-a073-523e7e9d5c41","Type":"ContainerStarted","Data":"33a0f025ae3a15df8560df853b2750de21e4a2daa2fac4e96b5f00567cff143f"} Jun 11 19:54:38.502262 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.502237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675769bf84-8x2h6" event={"ID":"3e62d038-b362-4c5a-b4c6-df2ffba540d9","Type":"ContainerStarted","Data":"fde4ec25c6f0b3f0ec0966a3ee8a5bfb057d87e79874e71a0d8bae38099e681e"} Jun 11 19:54:38.509034 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.508738 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-56dqc" podStartSLOduration=1.154089588 podStartE2EDuration="22.508720695s" totalImagesPullingTime="21.354631107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:38.508200544 +0000 UTC m=+250.240849854" watchObservedRunningTime="2026-06-11 19:54:38.508720695 +0000 UTC m=+250.241370007" Jun 11 19:54:38.512011 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.510689 2580 generic.go:356] "Generic (PLEG): container finished" podID="9e87c087-46b0-424f-956f-92cf9912bac9" containerID="7cd4e7e52d007ed0d5b2fb46ba15d8276997319f12615dfbe539f30d715d1469" exitCode=0 Jun 11 19:54:38.512011 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.510762 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sq27b" event={"ID":"9e87c087-46b0-424f-956f-92cf9912bac9","Type":"ContainerDied","Data":"7cd4e7e52d007ed0d5b2fb46ba15d8276997319f12615dfbe539f30d715d1469"} Jun 11 19:54:38.514186 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.514103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"d9552834824dc17426ef2c1df7038a1bf05ad14cf5c74bf6096fff4e54f557ab"} Jun 11 19:54:38.551596 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:38.550320 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-c22w2" podStartSLOduration=1.529653813 podStartE2EDuration="9.550300412s" totalImagesPullingTime="8.020646599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:38.54854099 +0000 UTC m=+250.281190292" watchObservedRunningTime="2026-06-11 19:54:38.550300412 +0000 UTC m=+250.282949720" Jun 11 19:54:39.523631 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:39.523316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sq27b" event={"ID":"9e87c087-46b0-424f-956f-92cf9912bac9","Type":"ContainerStarted","Data":"80a4192cb8dd711777e3e4334aec353801f8ca9729ab78bbdf9dac7f934a8f23"} Jun 11 19:54:39.523631 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:39.523386 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sq27b" event={"ID":"9e87c087-46b0-424f-956f-92cf9912bac9","Type":"ContainerStarted","Data":"02b4a2049877bf67a4e8607839d0654aea3bfb6e843eae4364cfdc649bc78e9b"} Jun 11 19:54:39.545807 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:39.544501 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sq27b" podStartSLOduration=2.739521221 podStartE2EDuration="10.544480317s" totalImagesPullingTime="7.709194958s" totalInitContainerRuntime="95.764138ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:39.542767049 +0000 UTC m=+251.275416370" watchObservedRunningTime="2026-06-11 19:54:39.544480317 +0000 UTC m=+251.277129625" Jun 11 19:54:40.513423 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:40.513384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:54:40.516089 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:40.516058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d4f6fc2a-3608-4f30-8125-6e39c83d1b36-metrics-certs\") pod \"network-metrics-daemon-g2nlh\" (UID: \"d4f6fc2a-3608-4f30-8125-6e39c83d1b36\") " pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:54:40.606208 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:40.606178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mvws7\"" Jun 11 19:54:40.614446 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:40.614408 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g2nlh" Jun 11 19:54:42.450643 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:42.450614 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g2nlh"] Jun 11 19:54:42.454777 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:54:42.454747 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f6fc2a_3608_4f30_8125_6e39c83d1b36.slice/crio-a9e7353ba01e6ca36380738f56d4269cddeb6ea0de86d5e0d2fd56268f923062 WatchSource:0}: Error finding container a9e7353ba01e6ca36380738f56d4269cddeb6ea0de86d5e0d2fd56268f923062: Status 404 returned error can't find the container with id a9e7353ba01e6ca36380738f56d4269cddeb6ea0de86d5e0d2fd56268f923062 Jun 11 19:54:42.537574 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:42.537539 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675769bf84-8x2h6" event={"ID":"3e62d038-b362-4c5a-b4c6-df2ffba540d9","Type":"ContainerStarted","Data":"68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8"} Jun 11 19:54:42.539784 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:42.539753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"e7f95ee64b18838556a1c44d4a646b1ecd58801d3bed5cc9d08b8bf34f59d252"} Jun 11 19:54:42.539886 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:42.539838 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"c546e7fda470ad2f771f14cc47c6d7cd7629898088d26f285477b3223943a72d"} Jun 11 19:54:42.540998 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:42.540950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2nlh" event={"ID":"d4f6fc2a-3608-4f30-8125-6e39c83d1b36","Type":"ContainerStarted","Data":"a9e7353ba01e6ca36380738f56d4269cddeb6ea0de86d5e0d2fd56268f923062"} Jun 11 19:54:42.565853 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:42.565817 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" podUID="cb2d2b04-d3b0-46af-945e-7916b04370ef" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 19:54:43.547146 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:43.547015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"fe0668476ca2357580bb9c7d90d0e4cddcf507894b19daf3209dbc106e064856"} Jun 11 19:54:44.554176 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:44.554144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"7b295da53e916bfa4f2af21dff97f1d4d24ea18d02f28c8371860f4fec907354"} Jun 11 19:54:44.556092 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:44.556066 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2nlh" event={"ID":"d4f6fc2a-3608-4f30-8125-6e39c83d1b36","Type":"ContainerStarted","Data":"26ab5ba5181ed836dd0e13dced2f08a87f45f1814dfa984838c3356b380dbd2f"} Jun 11 19:54:44.945846 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:44.945810 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:44.946043 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:44.945874 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:54:44.947381 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:44.947355 2580 patch_prober.go:28] interesting pod/console-675769bf84-8x2h6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 11 19:54:44.947505 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:44.947398 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-675769bf84-8x2h6" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 11 19:54:45.567040 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.567005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"dbdb6a31c0e3cd4f08036f7a79f49d73e5fd3c5eab6c701d4d5001ecc839f165"} Jun 11 19:54:45.567501 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.567083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" event={"ID":"e446ec60-cade-4e52-80bf-187c3709e951","Type":"ContainerStarted","Data":"cbe4f1dfea388291ed4867f3c2fc9d8285e3718fac2babed0cb81b7f9e9fac9b"} Jun 11 19:54:45.567501 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.567160 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:45.569434 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.569408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g2nlh" event={"ID":"d4f6fc2a-3608-4f30-8125-6e39c83d1b36","Type":"ContainerStarted","Data":"eed4cf26571c02af3ef2bef4177d4361aa493f5d03c8b0e7e44cb3e249dbbf48"} Jun 11 19:54:45.588977 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.588924 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-675769bf84-8x2h6" podStartSLOduration=7.322757651 podStartE2EDuration="11.588907503s" totalImagesPullingTime="4.266149852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:42.562884732 +0000 UTC m=+254.295534112" watchObservedRunningTime="2026-06-11 19:54:45.588907503 +0000 UTC m=+257.321556815" Jun 11 19:54:45.590033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.589538 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" podStartSLOduration=8.722503814 podStartE2EDuration="14.58950626s" totalImagesPullingTime="5.867002446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:54:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:45.587532272 +0000 UTC m=+257.320181572" watchObservedRunningTime="2026-06-11 19:54:45.58950626 +0000 UTC m=+257.322155569" Jun 11 19:54:45.604107 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:45.604068 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g2nlh" podStartSLOduration=255.786682515 podStartE2EDuration="4m17.604055871s" totalImagesPullingTime="1.817373356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:54:45.603083488 +0000 UTC m=+257.335732800" watchObservedRunningTime="2026-06-11 19:54:45.604055871 +0000 UTC m=+257.336705377" Jun 11 19:54:46.457834 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:46.457802 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:54:46.458023 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:46.457856 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:54:48.416069 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:48.416038 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:54:48.416464 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:48.416086 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:54:51.579887 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:51.579860 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6775c7ff48-vb9p8" Jun 11 19:54:52.565933 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:52.565900 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" podUID="cb2d2b04-d3b0-46af-945e-7916b04370ef" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 19:54:52.566110 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:52.565969 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" Jun 11 19:54:52.566453 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:52.566421 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f600e4e70f65542e75b438c8939d0275d19faabe6fb24bceb145c848a91b545a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 19:54:52.566492 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:52.566474 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" podUID="cb2d2b04-d3b0-46af-945e-7916b04370ef" containerName="service-proxy" containerID="cri-o://f600e4e70f65542e75b438c8939d0275d19faabe6fb24bceb145c848a91b545a" gracePeriod=30 Jun 11 19:54:53.599678 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:53.599647 2580 generic.go:356] "Generic (PLEG): container finished" podID="cb2d2b04-d3b0-46af-945e-7916b04370ef" containerID="f600e4e70f65542e75b438c8939d0275d19faabe6fb24bceb145c848a91b545a" exitCode=2 Jun 11 19:54:53.600042 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:53.599724 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" event={"ID":"cb2d2b04-d3b0-46af-945e-7916b04370ef","Type":"ContainerDied","Data":"f600e4e70f65542e75b438c8939d0275d19faabe6fb24bceb145c848a91b545a"} Jun 11 19:54:53.600042 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:53.599765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-579d49d487-m74mw" event={"ID":"cb2d2b04-d3b0-46af-945e-7916b04370ef","Type":"ContainerStarted","Data":"eef0b5eb007db2eb51a9803b7e47be36390373db3b281a756fe9cd792d5fd279"} Jun 11 19:54:54.945618 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:54.945586 2580 patch_prober.go:28] interesting pod/console-675769bf84-8x2h6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 11 19:54:54.946083 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:54.945650 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-675769bf84-8x2h6" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 11 19:54:56.457440 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:56.457409 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:54:56.457922 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:56.457472 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:54:56.457922 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:56.457541 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:54:56.458087 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:56.458060 2580 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"a8480c918f78cb08f1afb14291de67820bbcd09bda9d1a82bcc6cebd29e4886d"} pod="openshift-image-registry/image-registry-59855895df-7jfvv" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 19:54:56.461693 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:56.461663 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:54:56.461847 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:54:56.461698 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:55:04.949821 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:04.949793 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:55:04.953353 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:04.953332 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:55:06.461978 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:06.461944 2580 patch_prober.go:28] interesting pod/image-registry-59855895df-7jfvv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:55:06.462331 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:06.461989 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:55:08.809321 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:08.809292 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5qcp_fa9d0da4-8840-4921-a546-9e6edbe6d09f/dns-node-resolver/0.log" Jun 11 19:55:09.215414 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:09.215387 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59855895df-7jfvv_5d5f09fe-1c4e-4a42-b479-ccdc33840f29/registry/0.log" Jun 11 19:55:10.010043 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:10.010015 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf86k_020ce4c2-f485-434b-b713-a982de3f269a/node-ca/0.log" Jun 11 19:55:10.199336 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:55:10.199295 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vv2n5" podUID="5451f007-016f-4f65-91d8-1751073e2e0a" Jun 11 19:55:10.656056 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:10.656027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv2n5" Jun 11 19:55:10.809736 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:10.809710 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mxcpr_d27c6e5c-87f9-4ac3-a787-077dad3b1638/serve-healthcheck-canary/0.log" Jun 11 19:55:13.665635 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:13.665602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:55:13.668048 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:13.668019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5451f007-016f-4f65-91d8-1751073e2e0a-metrics-tls\") pod \"dns-default-vv2n5\" (UID: \"5451f007-016f-4f65-91d8-1751073e2e0a\") " pod="openshift-dns/dns-default-vv2n5" Jun 11 19:55:13.959313 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:13.959284 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rb2ld\"" Jun 11 19:55:13.967288 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:13.967264 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv2n5" Jun 11 19:55:14.139293 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:14.139270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vv2n5"] Jun 11 19:55:14.141778 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:55:14.141747 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5451f007_016f_4f65_91d8_1751073e2e0a.slice/crio-2453006e9f8c870f7e12a8130d12e6b159bdf0a5e88c696482b77680a1a3eab1 WatchSource:0}: Error finding container 2453006e9f8c870f7e12a8130d12e6b159bdf0a5e88c696482b77680a1a3eab1: Status 404 returned error can't find the container with id 2453006e9f8c870f7e12a8130d12e6b159bdf0a5e88c696482b77680a1a3eab1 Jun 11 19:55:14.673394 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:14.673362 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv2n5" event={"ID":"5451f007-016f-4f65-91d8-1751073e2e0a","Type":"ContainerStarted","Data":"2453006e9f8c870f7e12a8130d12e6b159bdf0a5e88c696482b77680a1a3eab1"} Jun 11 19:55:16.462568 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:16.462541 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:55:16.682615 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:16.682580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv2n5" event={"ID":"5451f007-016f-4f65-91d8-1751073e2e0a","Type":"ContainerStarted","Data":"8a06aa15eaf10709af63ee117b395eef4b5cc5371840e6c1583e346a0e3fdae2"} Jun 11 19:55:16.682615 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:16.682636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv2n5" event={"ID":"5451f007-016f-4f65-91d8-1751073e2e0a","Type":"ContainerStarted","Data":"1de3b116fd5a8b7c54b60805eba8e58796316410c5c7a482f143b61718575942"} Jun 11 19:55:16.682868 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:16.682675 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vv2n5" Jun 11 19:55:16.703531 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:16.703466 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vv2n5" podStartSLOduration=251.834582558 podStartE2EDuration="4m13.703447885s" totalImagesPullingTime="1.868865327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:55:16.702772597 +0000 UTC m=+288.435421909" watchObservedRunningTime="2026-06-11 19:55:16.703447885 +0000 UTC m=+288.436097193" Jun 11 19:55:21.477503 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:21.477466 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59855895df-7jfvv" podUID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerName="registry" containerID="cri-o://a8480c918f78cb08f1afb14291de67820bbcd09bda9d1a82bcc6cebd29e4886d" gracePeriod=30 Jun 11 19:55:22.708161 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:22.708139 2580 generic.go:356] "Generic (PLEG): container finished" podID="5d5f09fe-1c4e-4a42-b479-ccdc33840f29" containerID="a8480c918f78cb08f1afb14291de67820bbcd09bda9d1a82bcc6cebd29e4886d" exitCode=0 Jun 11 19:55:22.708463 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:22.708168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59855895df-7jfvv" event={"ID":"5d5f09fe-1c4e-4a42-b479-ccdc33840f29","Type":"ContainerDied","Data":"a8480c918f78cb08f1afb14291de67820bbcd09bda9d1a82bcc6cebd29e4886d"} Jun 11 19:55:22.708463 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:22.708200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59855895df-7jfvv" event={"ID":"5d5f09fe-1c4e-4a42-b479-ccdc33840f29","Type":"ContainerStarted","Data":"15f72e67fbafcb2cb786b032a1e7f84cd33d09393b9d3a325d188d6bf128d46d"} Jun 11 19:55:23.712898 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:23.712863 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:55:26.688709 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:26.688679 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vv2n5" Jun 11 19:55:28.646918 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:28.646891 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 19:55:28.648502 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:28.648479 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 19:55:28.652066 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:28.652047 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 19:55:44.720332 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:55:44.720306 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59855895df-7jfvv" Jun 11 19:56:10.328580 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:10.328545 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675769bf84-8x2h6"] Jun 11 19:56:35.348457 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.348394 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-675769bf84-8x2h6" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerName="console" containerID="cri-o://68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8" gracePeriod=15 Jun 11 19:56:35.591398 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.591374 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:56:35.651977 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.651908 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-oauth-serving-cert\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.651977 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.651958 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-oauth-config\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.651977 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.651976 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-config\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.652225 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.651995 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-service-ca\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.652225 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652013 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-serving-cert\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.652225 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652167 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-trusted-ca-bundle\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.652387 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652244 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb5pf\" (UniqueName: \"kubernetes.io/projected/3e62d038-b362-4c5a-b4c6-df2ffba540d9-kube-api-access-rb5pf\") pod \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\" (UID: \"3e62d038-b362-4c5a-b4c6-df2ffba540d9\") " Jun 11 19:56:35.652387 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652324 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:56:35.652487 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652451 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-config" (OuterVolumeSpecName: "console-config") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:56:35.652487 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652457 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:56:35.653018 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652606 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-config\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.653018 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652612 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:56:35.653018 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652623 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-service-ca\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.653018 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.652660 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-oauth-serving-cert\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.654354 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.654330 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:56:35.654354 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.654335 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e62d038-b362-4c5a-b4c6-df2ffba540d9-kube-api-access-rb5pf" (OuterVolumeSpecName: "kube-api-access-rb5pf") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "kube-api-access-rb5pf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:56:35.654472 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.654404 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e62d038-b362-4c5a-b4c6-df2ffba540d9" (UID: "3e62d038-b362-4c5a-b4c6-df2ffba540d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:56:35.753674 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.753630 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-serving-cert\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.753674 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.753669 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e62d038-b362-4c5a-b4c6-df2ffba540d9-trusted-ca-bundle\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.753674 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.753678 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb5pf\" (UniqueName: \"kubernetes.io/projected/3e62d038-b362-4c5a-b4c6-df2ffba540d9-kube-api-access-rb5pf\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.753674 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.753688 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e62d038-b362-4c5a-b4c6-df2ffba540d9-console-oauth-config\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 19:56:35.961573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.961514 2580 generic.go:356] "Generic (PLEG): container finished" podID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerID="68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8" exitCode=0 Jun 11 19:56:35.961573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.961552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675769bf84-8x2h6" event={"ID":"3e62d038-b362-4c5a-b4c6-df2ffba540d9","Type":"ContainerDied","Data":"68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8"} Jun 11 19:56:35.961573 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.961575 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675769bf84-8x2h6" Jun 11 19:56:35.961819 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.961603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675769bf84-8x2h6" event={"ID":"3e62d038-b362-4c5a-b4c6-df2ffba540d9","Type":"ContainerDied","Data":"fde4ec25c6f0b3f0ec0966a3ee8a5bfb057d87e79874e71a0d8bae38099e681e"} Jun 11 19:56:35.961819 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.961633 2580 scope.go:117] "RemoveContainer" containerID="68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8" Jun 11 19:56:35.970399 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.970382 2580 scope.go:117] "RemoveContainer" containerID="68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8" Jun 11 19:56:35.970673 ip-10-0-138-225 kubenswrapper[2580]: E0611 19:56:35.970651 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8\": container with ID starting with 68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8 not found: ID does not exist" containerID="68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8" Jun 11 19:56:35.970759 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.970684 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8"} err="failed to get container status \"68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8\": rpc error: code = NotFound desc = could not find container \"68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8\": container with ID starting with 68dbe6b5dbee12b4bb1b4efd7a5581cfac9e67c52a73399522021f93f02a92a8 not found: ID does not exist" Jun 11 19:56:35.981261 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.981236 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675769bf84-8x2h6"] Jun 11 19:56:35.984528 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:35.984496 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-675769bf84-8x2h6"] Jun 11 19:56:36.705550 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:56:36.705506 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" path="/var/lib/kubelet/pods/3e62d038-b362-4c5a-b4c6-df2ffba540d9/volumes" Jun 11 19:58:52.530553 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.530504 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4"] Jun 11 19:58:52.531008 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.530774 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerName="console" Jun 11 19:58:52.531008 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.530784 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerName="console" Jun 11 19:58:52.531008 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.530840 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e62d038-b362-4c5a-b4c6-df2ffba540d9" containerName="console" Jun 11 19:58:52.533412 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.533396 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.537236 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.537212 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:58:52.537355 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.537264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 19:58:52.538297 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.538282 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bz7pt\"" Jun 11 19:58:52.542770 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.542748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4"] Jun 11 19:58:52.598262 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.598241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c8e891-17f0-4d35-aabe-198b37f1dbe8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z86z4\" (UID: \"20c8e891-17f0-4d35-aabe-198b37f1dbe8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.598362 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.598275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nfk\" (UniqueName: \"kubernetes.io/projected/20c8e891-17f0-4d35-aabe-198b37f1dbe8-kube-api-access-k6nfk\") pod \"openshift-lws-operator-fd8ccff4c-z86z4\" (UID: \"20c8e891-17f0-4d35-aabe-198b37f1dbe8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.698720 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.698695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c8e891-17f0-4d35-aabe-198b37f1dbe8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z86z4\" (UID: \"20c8e891-17f0-4d35-aabe-198b37f1dbe8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.698816 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.698730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nfk\" (UniqueName: \"kubernetes.io/projected/20c8e891-17f0-4d35-aabe-198b37f1dbe8-kube-api-access-k6nfk\") pod \"openshift-lws-operator-fd8ccff4c-z86z4\" (UID: \"20c8e891-17f0-4d35-aabe-198b37f1dbe8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.699081 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.699060 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20c8e891-17f0-4d35-aabe-198b37f1dbe8-tmp\") pod \"openshift-lws-operator-fd8ccff4c-z86z4\" (UID: \"20c8e891-17f0-4d35-aabe-198b37f1dbe8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.706506 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.706487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nfk\" (UniqueName: \"kubernetes.io/projected/20c8e891-17f0-4d35-aabe-198b37f1dbe8-kube-api-access-k6nfk\") pod \"openshift-lws-operator-fd8ccff4c-z86z4\" (UID: \"20c8e891-17f0-4d35-aabe-198b37f1dbe8\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.842806 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.842748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" Jun 11 19:58:52.963651 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.963618 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4"] Jun 11 19:58:52.969320 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:58:52.969068 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20c8e891_17f0_4d35_aabe_198b37f1dbe8.slice/crio-f708ddd9af5015cd00c573c39461521b84dc8c5874a8b084b62d480ee018296b WatchSource:0}: Error finding container f708ddd9af5015cd00c573c39461521b84dc8c5874a8b084b62d480ee018296b: Status 404 returned error can't find the container with id f708ddd9af5015cd00c573c39461521b84dc8c5874a8b084b62d480ee018296b Jun 11 19:58:52.970225 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:52.970194 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:58:53.443605 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:53.443569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" event={"ID":"20c8e891-17f0-4d35-aabe-198b37f1dbe8","Type":"ContainerStarted","Data":"f708ddd9af5015cd00c573c39461521b84dc8c5874a8b084b62d480ee018296b"} Jun 11 19:58:56.456294 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:56.456258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" event={"ID":"20c8e891-17f0-4d35-aabe-198b37f1dbe8","Type":"ContainerStarted","Data":"711c407afa5588a34d363ce85f1c846c18fa1a351d2ac055abbe17627f66ee62"} Jun 11 19:58:56.476569 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:58:56.476512 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-z86z4" podStartSLOduration=2.003129156 podStartE2EDuration="4.476498042s" totalImagesPullingTime="2.473368886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:58:56.476247654 +0000 UTC m=+508.208896963" watchObservedRunningTime="2026-06-11 19:58:56.476498042 +0000 UTC m=+508.209147350" Jun 11 19:59:12.705636 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.705605 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp"] Jun 11 19:59:12.711669 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.711649 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.714656 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.714639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2hqdj\"" Jun 11 19:59:12.715240 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.715222 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 19:59:12.715240 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.715233 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 19:59:12.715392 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.715320 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 19:59:12.715626 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.715610 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 19:59:12.731536 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.731498 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp"] Jun 11 19:59:12.849606 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.849578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c6be22f-e03c-4a8b-898c-8de4e3f57230-manifests\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.849750 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.849624 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c6be22f-e03c-4a8b-898c-8de4e3f57230-tmp\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.849750 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.849743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c6be22f-e03c-4a8b-898c-8de4e3f57230-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.849847 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.849763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c6be22f-e03c-4a8b-898c-8de4e3f57230-webhook-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.849893 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.849872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cqsw\" (UniqueName: \"kubernetes.io/projected/8c6be22f-e03c-4a8b-898c-8de4e3f57230-kube-api-access-2cqsw\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.950813 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.950788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c6be22f-e03c-4a8b-898c-8de4e3f57230-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.950939 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.950818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c6be22f-e03c-4a8b-898c-8de4e3f57230-webhook-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.950939 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.950842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cqsw\" (UniqueName: \"kubernetes.io/projected/8c6be22f-e03c-4a8b-898c-8de4e3f57230-kube-api-access-2cqsw\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.950939 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.950873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c6be22f-e03c-4a8b-898c-8de4e3f57230-manifests\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.950939 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.950906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c6be22f-e03c-4a8b-898c-8de4e3f57230-tmp\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.951344 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.951324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8c6be22f-e03c-4a8b-898c-8de4e3f57230-manifests\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.953118 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.953098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c6be22f-e03c-4a8b-898c-8de4e3f57230-tmp\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.953323 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.953305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8c6be22f-e03c-4a8b-898c-8de4e3f57230-apiservice-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.953440 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.953422 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8c6be22f-e03c-4a8b-898c-8de4e3f57230-webhook-cert\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:12.962067 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:12.962013 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cqsw\" (UniqueName: \"kubernetes.io/projected/8c6be22f-e03c-4a8b-898c-8de4e3f57230-kube-api-access-2cqsw\") pod \"opendatahub-operator-controller-manager-558786d47d-mgmzp\" (UID: \"8c6be22f-e03c-4a8b-898c-8de4e3f57230\") " pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:13.022028 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:13.022006 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:13.162494 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:13.162463 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp"] Jun 11 19:59:13.165549 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:59:13.165499 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6be22f_e03c_4a8b_898c_8de4e3f57230.slice/crio-ddba10b023b0c8be83aa8a1fd05521678d710aa7622e984a58635f8ddd60a213 WatchSource:0}: Error finding container ddba10b023b0c8be83aa8a1fd05521678d710aa7622e984a58635f8ddd60a213: Status 404 returned error can't find the container with id ddba10b023b0c8be83aa8a1fd05521678d710aa7622e984a58635f8ddd60a213 Jun 11 19:59:13.522339 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:13.522307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" event={"ID":"8c6be22f-e03c-4a8b-898c-8de4e3f57230","Type":"ContainerStarted","Data":"ddba10b023b0c8be83aa8a1fd05521678d710aa7622e984a58635f8ddd60a213"} Jun 11 19:59:16.537808 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:16.537775 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" event={"ID":"8c6be22f-e03c-4a8b-898c-8de4e3f57230","Type":"ContainerStarted","Data":"1101e22a433eb0e76293d2b2cfebf1727b7bd1e99559585b1edc86d5f8f0ba43"} Jun 11 19:59:17.542692 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:17.542653 2580 generic.go:356] "Generic (PLEG): container finished" podID="8c6be22f-e03c-4a8b-898c-8de4e3f57230" containerID="1101e22a433eb0e76293d2b2cfebf1727b7bd1e99559585b1edc86d5f8f0ba43" exitCode=0 Jun 11 19:59:17.543136 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:17.542742 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" event={"ID":"8c6be22f-e03c-4a8b-898c-8de4e3f57230","Type":"ContainerDied","Data":"1101e22a433eb0e76293d2b2cfebf1727b7bd1e99559585b1edc86d5f8f0ba43"} Jun 11 19:59:18.548388 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:18.548352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" event={"ID":"8c6be22f-e03c-4a8b-898c-8de4e3f57230","Type":"ContainerStarted","Data":"9c5377c69198dcd5d9fd6e2d4f3d05692b32e88375efe4aa4526d3b2b946a824"} Jun 11 19:59:18.548819 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:18.548422 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:18.606346 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:18.606302 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" podStartSLOduration=2.623104887 podStartE2EDuration="6.606287553s" totalImagesPullingTime="3.051994097s" totalInitContainerRuntime="931.188569ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:18.605877503 +0000 UTC m=+530.338526824" watchObservedRunningTime="2026-06-11 19:59:18.606287553 +0000 UTC m=+530.338936861" Jun 11 19:59:29.556413 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:29.556384 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-558786d47d-mgmzp" Jun 11 19:59:32.068435 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.068392 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n"] Jun 11 19:59:32.077079 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.077056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.085097 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.085075 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 19:59:32.085451 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.085433 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 19:59:32.086079 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.086060 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 19:59:32.086145 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.086079 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c6ltx\"" Jun 11 19:59:32.086189 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.086060 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 19:59:32.120164 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.120138 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n"] Jun 11 19:59:32.191789 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.191758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-tmp\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.191900 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.191790 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5m4s\" (UniqueName: \"kubernetes.io/projected/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-kube-api-access-n5m4s\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.191900 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.191871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-tls-certs\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.293008 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.292969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-tmp\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.293008 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.293010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5m4s\" (UniqueName: \"kubernetes.io/projected/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-kube-api-access-n5m4s\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.293248 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.293064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-tls-certs\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.295328 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.295302 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-tmp\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.295578 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.295560 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-tls-certs\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.321089 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.321031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5m4s\" (UniqueName: \"kubernetes.io/projected/5543f55a-5caf-47bc-b549-1aa04c1bc4e6-kube-api-access-n5m4s\") pod \"kube-auth-proxy-6fd95844fb-gf67n\" (UID: \"5543f55a-5caf-47bc-b549-1aa04c1bc4e6\") " pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.334402 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.334377 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zdjnz"] Jun 11 19:59:32.337596 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.337582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.340563 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.340543 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zb2ps\"" Jun 11 19:59:32.341122 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.341109 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 19:59:32.369744 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.369720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zdjnz"] Jun 11 19:59:32.386100 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.386079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" Jun 11 19:59:32.495033 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.495002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwp58\" (UniqueName: \"kubernetes.io/projected/cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9-kube-api-access-zwp58\") pod \"odh-model-controller-6dc94f689f-zdjnz\" (UID: \"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.495173 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.495068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9-cert\") pod \"odh-model-controller-6dc94f689f-zdjnz\" (UID: \"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.548506 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.548478 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n"] Jun 11 19:59:32.551454 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:59:32.551427 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5543f55a_5caf_47bc_b549_1aa04c1bc4e6.slice/crio-79925aea09d8b718ae1d937314e3fb81b5727c5ee498e3d1481aeda62b2a9c54 WatchSource:0}: Error finding container 79925aea09d8b718ae1d937314e3fb81b5727c5ee498e3d1481aeda62b2a9c54: Status 404 returned error can't find the container with id 79925aea09d8b718ae1d937314e3fb81b5727c5ee498e3d1481aeda62b2a9c54 Jun 11 19:59:32.596037 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.595973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9-cert\") pod \"odh-model-controller-6dc94f689f-zdjnz\" (UID: \"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.596135 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.596033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwp58\" (UniqueName: \"kubernetes.io/projected/cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9-kube-api-access-zwp58\") pod \"odh-model-controller-6dc94f689f-zdjnz\" (UID: \"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.598348 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.598323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9-cert\") pod \"odh-model-controller-6dc94f689f-zdjnz\" (UID: \"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.603402 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.603377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" event={"ID":"5543f55a-5caf-47bc-b549-1aa04c1bc4e6","Type":"ContainerStarted","Data":"79925aea09d8b718ae1d937314e3fb81b5727c5ee498e3d1481aeda62b2a9c54"} Jun 11 19:59:32.610615 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.610598 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwp58\" (UniqueName: \"kubernetes.io/projected/cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9-kube-api-access-zwp58\") pod \"odh-model-controller-6dc94f689f-zdjnz\" (UID: \"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9\") " pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.647204 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.647170 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:32.786753 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:32.786720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-zdjnz"] Jun 11 19:59:32.790096 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:59:32.790068 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4cd0e9_73f9_478f_a8fa_55e4667f6ec9.slice/crio-09c01b2b2103e6dfe518810e8dd30e0b61f0a381e177430dd760f26a5ce8681c WatchSource:0}: Error finding container 09c01b2b2103e6dfe518810e8dd30e0b61f0a381e177430dd760f26a5ce8681c: Status 404 returned error can't find the container with id 09c01b2b2103e6dfe518810e8dd30e0b61f0a381e177430dd760f26a5ce8681c Jun 11 19:59:33.613682 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:33.613621 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" event={"ID":"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9","Type":"ContainerStarted","Data":"09c01b2b2103e6dfe518810e8dd30e0b61f0a381e177430dd760f26a5ce8681c"} Jun 11 19:59:37.636106 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:37.636065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" event={"ID":"cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9","Type":"ContainerStarted","Data":"9d49d1c9209f61d4c3a669307b1c1f0d61d0277f8ee086c25792167b8e828fdd"} Jun 11 19:59:37.636560 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:37.636141 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:37.637554 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:37.637533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" event={"ID":"5543f55a-5caf-47bc-b549-1aa04c1bc4e6","Type":"ContainerStarted","Data":"50585230a29e560badc35bca1e7593bb0831969406f4613429ba79f75765dc48"} Jun 11 19:59:37.670416 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:37.670372 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" podStartSLOduration=1.7618274299999999 podStartE2EDuration="5.670356572s" totalImagesPullingTime="3.908529142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:37.669834112 +0000 UTC m=+549.402483419" watchObservedRunningTime="2026-06-11 19:59:37.670356572 +0000 UTC m=+549.403005881" Jun 11 19:59:37.706341 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:37.706298 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd95844fb-gf67n" podStartSLOduration=2.5555523879999997 podStartE2EDuration="6.706285185s" totalImagesPullingTime="4.150732797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:37.704417524 +0000 UTC m=+549.437066831" watchObservedRunningTime="2026-06-11 19:59:37.706285185 +0000 UTC m=+549.438934493" Jun 11 19:59:40.383880 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.383845 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2"] Jun 11 19:59:40.386984 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.386968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.392620 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.392597 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 19:59:40.392620 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.392612 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 19:59:40.392800 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.392599 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 19:59:40.392800 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.392599 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cftmc\"" Jun 11 19:59:40.405837 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.405814 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2"] Jun 11 19:59:40.457751 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.457727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf09a106-b701-47bb-970f-9c9230171a72-metrics-cert\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.457852 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.457762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htqcb\" (UniqueName: \"kubernetes.io/projected/bf09a106-b701-47bb-970f-9c9230171a72-kube-api-access-htqcb\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.457852 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.457797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf09a106-b701-47bb-970f-9c9230171a72-cert\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.457937 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.457859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bf09a106-b701-47bb-970f-9c9230171a72-manager-config\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.558655 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.558630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bf09a106-b701-47bb-970f-9c9230171a72-manager-config\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.558770 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.558670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf09a106-b701-47bb-970f-9c9230171a72-metrics-cert\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.558770 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.558702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htqcb\" (UniqueName: \"kubernetes.io/projected/bf09a106-b701-47bb-970f-9c9230171a72-kube-api-access-htqcb\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.558770 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.558754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf09a106-b701-47bb-970f-9c9230171a72-cert\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.559352 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.559320 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bf09a106-b701-47bb-970f-9c9230171a72-manager-config\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.561268 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.561246 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf09a106-b701-47bb-970f-9c9230171a72-cert\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.561345 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.561313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf09a106-b701-47bb-970f-9c9230171a72-metrics-cert\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.568864 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.568839 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htqcb\" (UniqueName: \"kubernetes.io/projected/bf09a106-b701-47bb-970f-9c9230171a72-kube-api-access-htqcb\") pod \"lws-controller-manager-d5f49777d-2zrh2\" (UID: \"bf09a106-b701-47bb-970f-9c9230171a72\") " pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.695952 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.695930 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:40.839047 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:40.839018 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2"] Jun 11 19:59:40.841779 ip-10-0-138-225 kubenswrapper[2580]: W0611 19:59:40.841736 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf09a106_b701_47bb_970f_9c9230171a72.slice/crio-2a163bf2c5182f6bf78323db025f62533575c0692f270b6b70bfc13d3209a7d0 WatchSource:0}: Error finding container 2a163bf2c5182f6bf78323db025f62533575c0692f270b6b70bfc13d3209a7d0: Status 404 returned error can't find the container with id 2a163bf2c5182f6bf78323db025f62533575c0692f270b6b70bfc13d3209a7d0 Jun 11 19:59:41.660180 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:41.660131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" event={"ID":"bf09a106-b701-47bb-970f-9c9230171a72","Type":"ContainerStarted","Data":"2a163bf2c5182f6bf78323db025f62533575c0692f270b6b70bfc13d3209a7d0"} Jun 11 19:59:42.666141 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:42.666057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" event={"ID":"bf09a106-b701-47bb-970f-9c9230171a72","Type":"ContainerStarted","Data":"f33bd6a015b771932eb5e6027f272206adbb44b230e55ac0ecd39f1034155e30"} Jun 11 19:59:42.666141 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:42.666125 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 19:59:42.707579 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:42.707511 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" podStartSLOduration=1.2017138219999999 podStartE2EDuration="2.707496166s" totalImagesPullingTime="1.505782344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:59:42.705371193 +0000 UTC m=+554.438020500" watchObservedRunningTime="2026-06-11 19:59:42.707496166 +0000 UTC m=+554.440145474" Jun 11 19:59:48.648712 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:48.648680 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-zdjnz" Jun 11 19:59:53.672671 ip-10-0-138-225 kubenswrapper[2580]: I0611 19:59:53.672635 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d5f49777d-2zrh2" Jun 11 20:00:28.673005 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:00:28.672977 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:00:28.673457 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:00:28.673419 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:01:22.584579 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.584548 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx"] Jun 11 20:01:22.587796 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.587781 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.596420 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.596401 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 20:01:22.596795 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.596778 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 20:01:22.597580 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.597561 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vk62p\"" Jun 11 20:01:22.597641 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.597563 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 20:01:22.597641 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.597605 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 20:01:22.605141 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.605120 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx"] Jun 11 20:01:22.715819 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.715793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/414770f5-3598-4fd8-96a0-a126cc1c49aa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.715994 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.715834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/414770f5-3598-4fd8-96a0-a126cc1c49aa-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.715994 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.715859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5fcj\" (UniqueName: \"kubernetes.io/projected/414770f5-3598-4fd8-96a0-a126cc1c49aa-kube-api-access-w5fcj\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.816618 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.816593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/414770f5-3598-4fd8-96a0-a126cc1c49aa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.816766 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.816640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/414770f5-3598-4fd8-96a0-a126cc1c49aa-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.816766 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.816678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5fcj\" (UniqueName: \"kubernetes.io/projected/414770f5-3598-4fd8-96a0-a126cc1c49aa-kube-api-access-w5fcj\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.817337 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.817316 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/414770f5-3598-4fd8-96a0-a126cc1c49aa-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.819310 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.819287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/414770f5-3598-4fd8-96a0-a126cc1c49aa-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.850901 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.850841 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5fcj\" (UniqueName: \"kubernetes.io/projected/414770f5-3598-4fd8-96a0-a126cc1c49aa-kube-api-access-w5fcj\") pod \"kuadrant-console-plugin-66b5774985-pbqpx\" (UID: \"414770f5-3598-4fd8-96a0-a126cc1c49aa\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:22.896244 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:22.896225 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" Jun 11 20:01:23.038051 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:23.038020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx"] Jun 11 20:01:23.041151 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:01:23.041123 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod414770f5_3598_4fd8_96a0_a126cc1c49aa.slice/crio-4ebe140820dbbbc16df24ef46880421c4e88092d54ae77d16336b2187251d70b WatchSource:0}: Error finding container 4ebe140820dbbbc16df24ef46880421c4e88092d54ae77d16336b2187251d70b: Status 404 returned error can't find the container with id 4ebe140820dbbbc16df24ef46880421c4e88092d54ae77d16336b2187251d70b Jun 11 20:01:23.074109 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:23.074077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" event={"ID":"414770f5-3598-4fd8-96a0-a126cc1c49aa","Type":"ContainerStarted","Data":"4ebe140820dbbbc16df24ef46880421c4e88092d54ae77d16336b2187251d70b"} Jun 11 20:01:46.191130 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:46.191093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" event={"ID":"414770f5-3598-4fd8-96a0-a126cc1c49aa","Type":"ContainerStarted","Data":"57df53027a0e298d66ea13be2837c09b0ff2955022d33103898b2fad58bf4841"} Jun 11 20:01:46.212079 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:01:46.212032 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-pbqpx" podStartSLOduration=1.93204777 podStartE2EDuration="24.212019143s" totalImagesPullingTime="22.279971373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:01:46.210334014 +0000 UTC m=+677.942983322" watchObservedRunningTime="2026-06-11 20:01:46.212019143 +0000 UTC m=+677.944668451" Jun 11 20:02:15.747390 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:15.747355 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5vgtn"] Jun 11 20:02:16.046549 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.046451 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5vgtn"] Jun 11 20:02:16.046549 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.046488 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-55nbn"] Jun 11 20:02:16.046765 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.046593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:16.049435 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.049413 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-w9vtb\"" Jun 11 20:02:16.051421 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.051398 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55nbn"] Jun 11 20:02:16.051546 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.051469 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:02:16.143873 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.143849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg86k\" (UniqueName: \"kubernetes.io/projected/c861c7db-2674-4530-808d-d841954e0956-kube-api-access-kg86k\") pod \"authorino-75d556bd77-55nbn\" (UID: \"c861c7db-2674-4530-808d-d841954e0956\") " pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:02:16.143983 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.143885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5kj\" (UniqueName: \"kubernetes.io/projected/715833a8-5195-4966-a6be-1df1a32d39eb-kube-api-access-8q5kj\") pod \"authorino-58cd955675-5vgtn\" (UID: \"715833a8-5195-4966-a6be-1df1a32d39eb\") " pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:16.244754 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.244729 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg86k\" (UniqueName: \"kubernetes.io/projected/c861c7db-2674-4530-808d-d841954e0956-kube-api-access-kg86k\") pod \"authorino-75d556bd77-55nbn\" (UID: \"c861c7db-2674-4530-808d-d841954e0956\") " pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:02:16.244841 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.244768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5kj\" (UniqueName: \"kubernetes.io/projected/715833a8-5195-4966-a6be-1df1a32d39eb-kube-api-access-8q5kj\") pod \"authorino-58cd955675-5vgtn\" (UID: \"715833a8-5195-4966-a6be-1df1a32d39eb\") " pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:16.253308 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.253282 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5kj\" (UniqueName: \"kubernetes.io/projected/715833a8-5195-4966-a6be-1df1a32d39eb-kube-api-access-8q5kj\") pod \"authorino-58cd955675-5vgtn\" (UID: \"715833a8-5195-4966-a6be-1df1a32d39eb\") " pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:16.253402 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.253336 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg86k\" (UniqueName: \"kubernetes.io/projected/c861c7db-2674-4530-808d-d841954e0956-kube-api-access-kg86k\") pod \"authorino-75d556bd77-55nbn\" (UID: \"c861c7db-2674-4530-808d-d841954e0956\") " pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:02:16.357049 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.356994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:16.362134 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.362115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:02:16.521621 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.521567 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5vgtn"] Jun 11 20:02:16.524269 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:02:16.524244 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod715833a8_5195_4966_a6be_1df1a32d39eb.slice/crio-1d3df20553b308d7876d6eba80fcb0710658877091d7a0a4258a6fbcacca4314 WatchSource:0}: Error finding container 1d3df20553b308d7876d6eba80fcb0710658877091d7a0a4258a6fbcacca4314: Status 404 returned error can't find the container with id 1d3df20553b308d7876d6eba80fcb0710658877091d7a0a4258a6fbcacca4314 Jun 11 20:02:16.553118 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:16.553095 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55nbn"] Jun 11 20:02:16.556180 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:02:16.556146 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc861c7db_2674_4530_808d_d841954e0956.slice/crio-6d089386ed77aa2545d65f6eddd08e306f98a5bc77f94221a7a63af4cd7a81ac WatchSource:0}: Error finding container 6d089386ed77aa2545d65f6eddd08e306f98a5bc77f94221a7a63af4cd7a81ac: Status 404 returned error can't find the container with id 6d089386ed77aa2545d65f6eddd08e306f98a5bc77f94221a7a63af4cd7a81ac Jun 11 20:02:17.326429 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:17.326361 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5vgtn" event={"ID":"715833a8-5195-4966-a6be-1df1a32d39eb","Type":"ContainerStarted","Data":"1d3df20553b308d7876d6eba80fcb0710658877091d7a0a4258a6fbcacca4314"} Jun 11 20:02:17.329784 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:17.329757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55nbn" event={"ID":"c861c7db-2674-4530-808d-d841954e0956","Type":"ContainerStarted","Data":"6d089386ed77aa2545d65f6eddd08e306f98a5bc77f94221a7a63af4cd7a81ac"} Jun 11 20:02:20.350572 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:20.350468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55nbn" event={"ID":"c861c7db-2674-4530-808d-d841954e0956","Type":"ContainerStarted","Data":"e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862"} Jun 11 20:02:20.352119 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:20.352089 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5vgtn" event={"ID":"715833a8-5195-4966-a6be-1df1a32d39eb","Type":"ContainerStarted","Data":"b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830"} Jun 11 20:02:20.366855 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:20.366811 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-55nbn" podStartSLOduration=1.966776917 podStartE2EDuration="5.366798799s" totalImagesPullingTime="3.400021882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:20.365493222 +0000 UTC m=+712.098142527" watchObservedRunningTime="2026-06-11 20:02:20.366798799 +0000 UTC m=+712.099448106" Jun 11 20:02:20.379971 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:20.379922 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5vgtn" podStartSLOduration=1.956920335 podStartE2EDuration="5.379904451s" totalImagesPullingTime="3.422984116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:02:20.379551718 +0000 UTC m=+712.112201030" watchObservedRunningTime="2026-06-11 20:02:20.379904451 +0000 UTC m=+712.112553759" Jun 11 20:02:20.406025 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:20.406002 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5vgtn"] Jun 11 20:02:22.360159 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:22.360112 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5vgtn" podUID="715833a8-5195-4966-a6be-1df1a32d39eb" containerName="authorino" containerID="cri-o://b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830" gracePeriod=30 Jun 11 20:02:22.606897 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:22.606876 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:22.700937 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:22.700912 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q5kj\" (UniqueName: \"kubernetes.io/projected/715833a8-5195-4966-a6be-1df1a32d39eb-kube-api-access-8q5kj\") pod \"715833a8-5195-4966-a6be-1df1a32d39eb\" (UID: \"715833a8-5195-4966-a6be-1df1a32d39eb\") " Jun 11 20:02:22.703087 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:22.703062 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/715833a8-5195-4966-a6be-1df1a32d39eb-kube-api-access-8q5kj" (OuterVolumeSpecName: "kube-api-access-8q5kj") pod "715833a8-5195-4966-a6be-1df1a32d39eb" (UID: "715833a8-5195-4966-a6be-1df1a32d39eb"). InnerVolumeSpecName "kube-api-access-8q5kj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:02:22.801787 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:22.801764 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q5kj\" (UniqueName: \"kubernetes.io/projected/715833a8-5195-4966-a6be-1df1a32d39eb-kube-api-access-8q5kj\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:02:23.365614 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.365581 2580 generic.go:356] "Generic (PLEG): container finished" podID="715833a8-5195-4966-a6be-1df1a32d39eb" containerID="b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830" exitCode=0 Jun 11 20:02:23.365977 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.365625 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5vgtn" Jun 11 20:02:23.365977 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.365622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5vgtn" event={"ID":"715833a8-5195-4966-a6be-1df1a32d39eb","Type":"ContainerDied","Data":"b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830"} Jun 11 20:02:23.365977 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.365751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5vgtn" event={"ID":"715833a8-5195-4966-a6be-1df1a32d39eb","Type":"ContainerDied","Data":"1d3df20553b308d7876d6eba80fcb0710658877091d7a0a4258a6fbcacca4314"} Jun 11 20:02:23.365977 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.365777 2580 scope.go:117] "RemoveContainer" containerID="b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830" Jun 11 20:02:23.373709 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.373693 2580 scope.go:117] "RemoveContainer" containerID="b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830" Jun 11 20:02:23.373972 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:02:23.373957 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830\": container with ID starting with b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830 not found: ID does not exist" containerID="b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830" Jun 11 20:02:23.374037 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.373980 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830"} err="failed to get container status \"b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830\": rpc error: code = NotFound desc = could not find container \"b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830\": container with ID starting with b84a174fc818d244a79487bab02dae66283bacbbf29c82c77321c0fd4c979830 not found: ID does not exist" Jun 11 20:02:23.381428 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.381408 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5vgtn"] Jun 11 20:02:23.384660 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:23.384642 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5vgtn"] Jun 11 20:02:24.706066 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:02:24.706032 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="715833a8-5195-4966-a6be-1df1a32d39eb" path="/var/lib/kubelet/pods/715833a8-5195-4966-a6be-1df1a32d39eb/volumes" Jun 11 20:03:09.837790 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.837760 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:03:09.838298 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.838180 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715833a8-5195-4966-a6be-1df1a32d39eb" containerName="authorino" Jun 11 20:03:09.838298 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.838199 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="715833a8-5195-4966-a6be-1df1a32d39eb" containerName="authorino" Jun 11 20:03:09.838298 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.838287 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="715833a8-5195-4966-a6be-1df1a32d39eb" containerName="authorino" Jun 11 20:03:09.840193 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.840172 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:09.842699 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.842680 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 20:03:09.842774 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.842686 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 20:03:09.843678 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.843662 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 20:03:09.843741 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.843710 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bttkp\"" Jun 11 20:03:09.850624 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.850605 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:03:09.853320 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.853299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnvs\" (UniqueName: \"kubernetes.io/projected/94b720c2-f885-47cc-ac11-e6ad82860244-kube-api-access-jnnvs\") pod \"maas-keycloak-0\" (UID: \"94b720c2-f885-47cc-ac11-e6ad82860244\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:09.953649 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.953624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnvs\" (UniqueName: \"kubernetes.io/projected/94b720c2-f885-47cc-ac11-e6ad82860244-kube-api-access-jnnvs\") pod \"maas-keycloak-0\" (UID: \"94b720c2-f885-47cc-ac11-e6ad82860244\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:09.962980 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:09.962960 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnvs\" (UniqueName: \"kubernetes.io/projected/94b720c2-f885-47cc-ac11-e6ad82860244-kube-api-access-jnnvs\") pod \"maas-keycloak-0\" (UID: \"94b720c2-f885-47cc-ac11-e6ad82860244\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:10.149575 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:10.149487 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:10.273963 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:10.273930 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:03:10.276805 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:03:10.276778 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b720c2_f885_47cc_ac11_e6ad82860244.slice/crio-a635ea5903ba3f1773c8021d6dfd1e21bee93925c256c6f40f763cd1fd43246d WatchSource:0}: Error finding container a635ea5903ba3f1773c8021d6dfd1e21bee93925c256c6f40f763cd1fd43246d: Status 404 returned error can't find the container with id a635ea5903ba3f1773c8021d6dfd1e21bee93925c256c6f40f763cd1fd43246d Jun 11 20:03:10.567788 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:10.567754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"94b720c2-f885-47cc-ac11-e6ad82860244","Type":"ContainerStarted","Data":"a635ea5903ba3f1773c8021d6dfd1e21bee93925c256c6f40f763cd1fd43246d"} Jun 11 20:03:17.610333 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:17.610293 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"94b720c2-f885-47cc-ac11-e6ad82860244","Type":"ContainerStarted","Data":"6f4fd5c2f33268435a0adc5087c234fecb868d61b318788dadd75441e0b2fc38"} Jun 11 20:03:17.629001 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:17.628955 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.958078581 podStartE2EDuration="8.628940124s" totalImagesPullingTime="6.670861543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:17.62712078 +0000 UTC m=+769.359770087" watchObservedRunningTime="2026-06-11 20:03:17.628940124 +0000 UTC m=+769.361589429" Jun 11 20:03:18.150064 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:18.150024 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:18.151769 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:18.151730 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:19.150124 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:19.150076 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:20.150680 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:20.150642 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:20.151280 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:20.151242 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:21.150925 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:21.150880 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:22.150019 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:22.149964 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:23.150265 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:23.150215 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:24.150041 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:24.149992 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:25.150244 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:25.150196 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:26.150818 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:26.150770 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:27.150021 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:27.149974 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:28.150819 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:28.150783 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:29.150102 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:29.150040 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 11 20:03:30.274803 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:30.274766 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:30.292708 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:30.292662 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 20:03:40.281884 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:40.281793 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 20:03:41.146670 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.146639 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2j5j"] Jun 11 20:03:41.149756 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.149739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:41.159007 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.158977 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2j5j"] Jun 11 20:03:41.244906 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.244874 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh4hl\" (UniqueName: \"kubernetes.io/projected/89d1f569-4441-4d00-b756-127686106ff1-kube-api-access-wh4hl\") pod \"authorino-5d4b67c446-c2j5j\" (UID: \"89d1f569-4441-4d00-b756-127686106ff1\") " pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:41.345681 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.345650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh4hl\" (UniqueName: \"kubernetes.io/projected/89d1f569-4441-4d00-b756-127686106ff1-kube-api-access-wh4hl\") pod \"authorino-5d4b67c446-c2j5j\" (UID: \"89d1f569-4441-4d00-b756-127686106ff1\") " pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:41.354170 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.354151 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh4hl\" (UniqueName: \"kubernetes.io/projected/89d1f569-4441-4d00-b756-127686106ff1-kube-api-access-wh4hl\") pod \"authorino-5d4b67c446-c2j5j\" (UID: \"89d1f569-4441-4d00-b756-127686106ff1\") " pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:41.427021 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.426997 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2j5j"] Jun 11 20:03:41.427218 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.427206 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:41.522245 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.522214 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8844466c-vdvsq"] Jun 11 20:03:41.525815 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.525794 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:41.537602 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.537578 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8844466c-vdvsq"] Jun 11 20:03:41.563698 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.563629 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2j5j"] Jun 11 20:03:41.565838 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:03:41.565812 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89d1f569_4441_4d00_b756_127686106ff1.slice/crio-b0b5e1d1d8c52dc918b52ea9f5c8fd95786994a8e68f499169cbf1b54406bb50 WatchSource:0}: Error finding container b0b5e1d1d8c52dc918b52ea9f5c8fd95786994a8e68f499169cbf1b54406bb50: Status 404 returned error can't find the container with id b0b5e1d1d8c52dc918b52ea9f5c8fd95786994a8e68f499169cbf1b54406bb50 Jun 11 20:03:41.617597 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.617571 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8844466c-vdvsq"] Jun 11 20:03:41.617800 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:03:41.617782 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6zm2g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8844466c-vdvsq" podUID="e0af6cbe-592c-482d-b032-6d0197d09f73" Jun 11 20:03:41.647587 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.647559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zm2g\" (UniqueName: \"kubernetes.io/projected/e0af6cbe-592c-482d-b032-6d0197d09f73-kube-api-access-6zm2g\") pod \"authorino-8844466c-vdvsq\" (UID: \"e0af6cbe-592c-482d-b032-6d0197d09f73\") " pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:41.657745 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.657716 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7589f7479-z4gq7"] Jun 11 20:03:41.660986 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.660968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.664164 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.664146 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 20:03:41.672544 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.672508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7589f7479-z4gq7"] Jun 11 20:03:41.737924 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.737855 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:41.737924 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.737877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" event={"ID":"89d1f569-4441-4d00-b756-127686106ff1","Type":"ContainerStarted","Data":"b0b5e1d1d8c52dc918b52ea9f5c8fd95786994a8e68f499169cbf1b54406bb50"} Jun 11 20:03:41.744059 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.744041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:41.748305 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.748289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cg5c\" (UniqueName: \"kubernetes.io/projected/799671d6-84c2-42db-815a-256958b6204c-kube-api-access-7cg5c\") pod \"authorino-7589f7479-z4gq7\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.748375 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.748319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/799671d6-84c2-42db-815a-256958b6204c-tls-cert\") pod \"authorino-7589f7479-z4gq7\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.748375 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.748361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zm2g\" (UniqueName: \"kubernetes.io/projected/e0af6cbe-592c-482d-b032-6d0197d09f73-kube-api-access-6zm2g\") pod \"authorino-8844466c-vdvsq\" (UID: \"e0af6cbe-592c-482d-b032-6d0197d09f73\") " pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:41.758463 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.758444 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zm2g\" (UniqueName: \"kubernetes.io/projected/e0af6cbe-592c-482d-b032-6d0197d09f73-kube-api-access-6zm2g\") pod \"authorino-8844466c-vdvsq\" (UID: \"e0af6cbe-592c-482d-b032-6d0197d09f73\") " pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:41.849641 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.849602 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zm2g\" (UniqueName: \"kubernetes.io/projected/e0af6cbe-592c-482d-b032-6d0197d09f73-kube-api-access-6zm2g\") pod \"e0af6cbe-592c-482d-b032-6d0197d09f73\" (UID: \"e0af6cbe-592c-482d-b032-6d0197d09f73\") " Jun 11 20:03:41.849841 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.849754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cg5c\" (UniqueName: \"kubernetes.io/projected/799671d6-84c2-42db-815a-256958b6204c-kube-api-access-7cg5c\") pod \"authorino-7589f7479-z4gq7\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.849841 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.849792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/799671d6-84c2-42db-815a-256958b6204c-tls-cert\") pod \"authorino-7589f7479-z4gq7\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.851975 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.851947 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0af6cbe-592c-482d-b032-6d0197d09f73-kube-api-access-6zm2g" (OuterVolumeSpecName: "kube-api-access-6zm2g") pod "e0af6cbe-592c-482d-b032-6d0197d09f73" (UID: "e0af6cbe-592c-482d-b032-6d0197d09f73"). InnerVolumeSpecName "kube-api-access-6zm2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:03:41.852487 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.852470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/799671d6-84c2-42db-815a-256958b6204c-tls-cert\") pod \"authorino-7589f7479-z4gq7\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.857995 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.857969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cg5c\" (UniqueName: \"kubernetes.io/projected/799671d6-84c2-42db-815a-256958b6204c-kube-api-access-7cg5c\") pod \"authorino-7589f7479-z4gq7\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:41.950733 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.950712 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zm2g\" (UniqueName: \"kubernetes.io/projected/e0af6cbe-592c-482d-b032-6d0197d09f73-kube-api-access-6zm2g\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:03:41.969379 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:41.969351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:03:42.107347 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.107320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7589f7479-z4gq7"] Jun 11 20:03:42.110009 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:03:42.109975 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod799671d6_84c2_42db_815a_256958b6204c.slice/crio-2fcdcb689d4aaea025c6312b7843f29f13d39d80e5466f0716c666d3ca272951 WatchSource:0}: Error finding container 2fcdcb689d4aaea025c6312b7843f29f13d39d80e5466f0716c666d3ca272951: Status 404 returned error can't find the container with id 2fcdcb689d4aaea025c6312b7843f29f13d39d80e5466f0716c666d3ca272951 Jun 11 20:03:42.743237 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.743202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" event={"ID":"89d1f569-4441-4d00-b756-127686106ff1","Type":"ContainerStarted","Data":"7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1"} Jun 11 20:03:42.743712 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.743281 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" podUID="89d1f569-4441-4d00-b756-127686106ff1" containerName="authorino" containerID="cri-o://7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1" gracePeriod=30 Jun 11 20:03:42.744778 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.744759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8844466c-vdvsq" Jun 11 20:03:42.744778 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.744765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7589f7479-z4gq7" event={"ID":"799671d6-84c2-42db-815a-256958b6204c","Type":"ContainerStarted","Data":"9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c"} Jun 11 20:03:42.744965 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.744801 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7589f7479-z4gq7" event={"ID":"799671d6-84c2-42db-815a-256958b6204c","Type":"ContainerStarted","Data":"2fcdcb689d4aaea025c6312b7843f29f13d39d80e5466f0716c666d3ca272951"} Jun 11 20:03:42.757489 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.757453 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" podStartSLOduration=1.380028281 podStartE2EDuration="1.757440294s" totalImagesPullingTime="377.412013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:42.756724331 +0000 UTC m=+794.489373642" watchObservedRunningTime="2026-06-11 20:03:42.757440294 +0000 UTC m=+794.490089632" Jun 11 20:03:42.779090 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.779064 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8844466c-vdvsq"] Jun 11 20:03:42.782343 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.782322 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8844466c-vdvsq"] Jun 11 20:03:42.795982 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.795938 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7589f7479-z4gq7" podStartSLOduration=1.461467488 podStartE2EDuration="1.795925511s" totalImagesPullingTime="334.458023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:42.794374473 +0000 UTC m=+794.527023781" watchObservedRunningTime="2026-06-11 20:03:42.795925511 +0000 UTC m=+794.528574818" Jun 11 20:03:42.820647 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.820618 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55nbn"] Jun 11 20:03:42.820818 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:42.820797 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-55nbn" podUID="c861c7db-2674-4530-808d-d841954e0956" containerName="authorino" containerID="cri-o://e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862" gracePeriod=30 Jun 11 20:03:43.067687 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.067663 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:43.074169 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.074146 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:03:43.160433 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.160402 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg86k\" (UniqueName: \"kubernetes.io/projected/c861c7db-2674-4530-808d-d841954e0956-kube-api-access-kg86k\") pod \"c861c7db-2674-4530-808d-d841954e0956\" (UID: \"c861c7db-2674-4530-808d-d841954e0956\") " Jun 11 20:03:43.160621 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.160560 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh4hl\" (UniqueName: \"kubernetes.io/projected/89d1f569-4441-4d00-b756-127686106ff1-kube-api-access-wh4hl\") pod \"89d1f569-4441-4d00-b756-127686106ff1\" (UID: \"89d1f569-4441-4d00-b756-127686106ff1\") " Jun 11 20:03:43.162694 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.162669 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d1f569-4441-4d00-b756-127686106ff1-kube-api-access-wh4hl" (OuterVolumeSpecName: "kube-api-access-wh4hl") pod "89d1f569-4441-4d00-b756-127686106ff1" (UID: "89d1f569-4441-4d00-b756-127686106ff1"). InnerVolumeSpecName "kube-api-access-wh4hl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:03:43.162781 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.162694 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c861c7db-2674-4530-808d-d841954e0956-kube-api-access-kg86k" (OuterVolumeSpecName: "kube-api-access-kg86k") pod "c861c7db-2674-4530-808d-d841954e0956" (UID: "c861c7db-2674-4530-808d-d841954e0956"). InnerVolumeSpecName "kube-api-access-kg86k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:03:43.262169 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.262082 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh4hl\" (UniqueName: \"kubernetes.io/projected/89d1f569-4441-4d00-b756-127686106ff1-kube-api-access-wh4hl\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:03:43.262169 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.262107 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg86k\" (UniqueName: \"kubernetes.io/projected/c861c7db-2674-4530-808d-d841954e0956-kube-api-access-kg86k\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:03:43.750339 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.750310 2580 generic.go:356] "Generic (PLEG): container finished" podID="c861c7db-2674-4530-808d-d841954e0956" containerID="e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862" exitCode=0 Jun 11 20:03:43.750806 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.750354 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-55nbn" Jun 11 20:03:43.750806 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.750398 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55nbn" event={"ID":"c861c7db-2674-4530-808d-d841954e0956","Type":"ContainerDied","Data":"e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862"} Jun 11 20:03:43.750806 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.750433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-55nbn" event={"ID":"c861c7db-2674-4530-808d-d841954e0956","Type":"ContainerDied","Data":"6d089386ed77aa2545d65f6eddd08e306f98a5bc77f94221a7a63af4cd7a81ac"} Jun 11 20:03:43.750806 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.750448 2580 scope.go:117] "RemoveContainer" containerID="e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862" Jun 11 20:03:43.751702 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.751684 2580 generic.go:356] "Generic (PLEG): container finished" podID="89d1f569-4441-4d00-b756-127686106ff1" containerID="7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1" exitCode=0 Jun 11 20:03:43.751758 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.751730 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" Jun 11 20:03:43.751801 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.751764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" event={"ID":"89d1f569-4441-4d00-b756-127686106ff1","Type":"ContainerDied","Data":"7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1"} Jun 11 20:03:43.751801 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.751787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-c2j5j" event={"ID":"89d1f569-4441-4d00-b756-127686106ff1","Type":"ContainerDied","Data":"b0b5e1d1d8c52dc918b52ea9f5c8fd95786994a8e68f499169cbf1b54406bb50"} Jun 11 20:03:43.758535 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.758504 2580 scope.go:117] "RemoveContainer" containerID="e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862" Jun 11 20:03:43.758793 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:03:43.758771 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862\": container with ID starting with e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862 not found: ID does not exist" containerID="e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862" Jun 11 20:03:43.758835 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.758802 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862"} err="failed to get container status \"e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862\": rpc error: code = NotFound desc = could not find container \"e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862\": container with ID starting with e1493765a4ec58aa4f20d7c74b497884eacfd88dc77efabcd89028b709dc7862 not found: ID does not exist" Jun 11 20:03:43.758835 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.758818 2580 scope.go:117] "RemoveContainer" containerID="7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1" Jun 11 20:03:43.766272 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.766256 2580 scope.go:117] "RemoveContainer" containerID="7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1" Jun 11 20:03:43.766504 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:03:43.766485 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1\": container with ID starting with 7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1 not found: ID does not exist" containerID="7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1" Jun 11 20:03:43.766560 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.766510 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1"} err="failed to get container status \"7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1\": rpc error: code = NotFound desc = could not find container \"7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1\": container with ID starting with 7aea402a2c6e24c5d8e13c583270066e22efc94646e9cd31272f7262a7f8cff1 not found: ID does not exist" Jun 11 20:03:43.779011 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.778990 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2j5j"] Jun 11 20:03:43.784390 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.784371 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-c2j5j"] Jun 11 20:03:43.794924 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.794903 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55nbn"] Jun 11 20:03:43.798377 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:43.798361 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-55nbn"] Jun 11 20:03:44.706369 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:44.706335 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d1f569-4441-4d00-b756-127686106ff1" path="/var/lib/kubelet/pods/89d1f569-4441-4d00-b756-127686106ff1/volumes" Jun 11 20:03:44.706759 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:44.706738 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c861c7db-2674-4530-808d-d841954e0956" path="/var/lib/kubelet/pods/c861c7db-2674-4530-808d-d841954e0956/volumes" Jun 11 20:03:44.707077 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:44.707060 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0af6cbe-592c-482d-b032-6d0197d09f73" path="/var/lib/kubelet/pods/e0af6cbe-592c-482d-b032-6d0197d09f73/volumes" Jun 11 20:03:46.286777 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.286734 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b744c9df-44ff9"] Jun 11 20:03:46.287219 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.287063 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c861c7db-2674-4530-808d-d841954e0956" containerName="authorino" Jun 11 20:03:46.287219 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.287076 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c861c7db-2674-4530-808d-d841954e0956" containerName="authorino" Jun 11 20:03:46.287219 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.287092 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d1f569-4441-4d00-b756-127686106ff1" containerName="authorino" Jun 11 20:03:46.287219 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.287097 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d1f569-4441-4d00-b756-127686106ff1" containerName="authorino" Jun 11 20:03:46.287219 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.287150 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c861c7db-2674-4530-808d-d841954e0956" containerName="authorino" Jun 11 20:03:46.287219 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.287159 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d1f569-4441-4d00-b756-127686106ff1" containerName="authorino" Jun 11 20:03:46.291437 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.291419 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.294039 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.294020 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 20:03:46.295007 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.294993 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2mrlx\"" Jun 11 20:03:46.295104 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.295088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 20:03:46.308416 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.308385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b744c9df-44ff9"] Jun 11 20:03:46.388109 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.388068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n58n\" (UniqueName: \"kubernetes.io/projected/52d43371-01b6-4088-8493-1d26e0298ad9-kube-api-access-9n58n\") pod \"maas-controller-69b744c9df-44ff9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.388295 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.388214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52d43371-01b6-4088-8493-1d26e0298ad9-webhook-cert\") pod \"maas-controller-69b744c9df-44ff9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.472321 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.472284 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f5c467f45-2wvks"] Jun 11 20:03:46.475643 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.475625 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.486184 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.486156 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5c467f45-2wvks"] Jun 11 20:03:46.489356 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.489329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52d43371-01b6-4088-8493-1d26e0298ad9-webhook-cert\") pod \"maas-controller-69b744c9df-44ff9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.489462 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.489375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n58n\" (UniqueName: \"kubernetes.io/projected/52d43371-01b6-4088-8493-1d26e0298ad9-kube-api-access-9n58n\") pod \"maas-controller-69b744c9df-44ff9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.491954 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.491928 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52d43371-01b6-4088-8493-1d26e0298ad9-webhook-cert\") pod \"maas-controller-69b744c9df-44ff9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.497808 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.497781 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n58n\" (UniqueName: \"kubernetes.io/projected/52d43371-01b6-4088-8493-1d26e0298ad9-kube-api-access-9n58n\") pod \"maas-controller-69b744c9df-44ff9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.590442 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.590356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfctx\" (UniqueName: \"kubernetes.io/projected/c31059b1-d8a8-423c-b737-8aad38b5d1cf-kube-api-access-tfctx\") pod \"maas-controller-f5c467f45-2wvks\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.590442 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.590416 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31059b1-d8a8-423c-b737-8aad38b5d1cf-webhook-cert\") pod \"maas-controller-f5c467f45-2wvks\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.601326 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.601301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:46.691146 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.691112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31059b1-d8a8-423c-b737-8aad38b5d1cf-webhook-cert\") pod \"maas-controller-f5c467f45-2wvks\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.691265 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.691197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfctx\" (UniqueName: \"kubernetes.io/projected/c31059b1-d8a8-423c-b737-8aad38b5d1cf-kube-api-access-tfctx\") pod \"maas-controller-f5c467f45-2wvks\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.693779 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.693756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31059b1-d8a8-423c-b737-8aad38b5d1cf-webhook-cert\") pod \"maas-controller-f5c467f45-2wvks\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.701876 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.701854 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfctx\" (UniqueName: \"kubernetes.io/projected/c31059b1-d8a8-423c-b737-8aad38b5d1cf-kube-api-access-tfctx\") pod \"maas-controller-f5c467f45-2wvks\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.737632 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.737610 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b744c9df-44ff9"] Jun 11 20:03:46.740111 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:03:46.740079 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d43371_01b6_4088_8493_1d26e0298ad9.slice/crio-24f31bebaa2de72359daab8baf860a5e63c6f5a727e2835b01000bc003322ae8 WatchSource:0}: Error finding container 24f31bebaa2de72359daab8baf860a5e63c6f5a727e2835b01000bc003322ae8: Status 404 returned error can't find the container with id 24f31bebaa2de72359daab8baf860a5e63c6f5a727e2835b01000bc003322ae8 Jun 11 20:03:46.767009 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.766976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-44ff9" event={"ID":"52d43371-01b6-4088-8493-1d26e0298ad9","Type":"ContainerStarted","Data":"24f31bebaa2de72359daab8baf860a5e63c6f5a727e2835b01000bc003322ae8"} Jun 11 20:03:46.787167 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.787137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:46.923346 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:46.923314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f5c467f45-2wvks"] Jun 11 20:03:46.924419 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:03:46.924398 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31059b1_d8a8_423c_b737_8aad38b5d1cf.slice/crio-452e1e77da834162275f75e5d2f59a7098dfdad5df6fcce553d97a7db76179a9 WatchSource:0}: Error finding container 452e1e77da834162275f75e5d2f59a7098dfdad5df6fcce553d97a7db76179a9: Status 404 returned error can't find the container with id 452e1e77da834162275f75e5d2f59a7098dfdad5df6fcce553d97a7db76179a9 Jun 11 20:03:47.772197 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:47.772153 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c467f45-2wvks" event={"ID":"c31059b1-d8a8-423c-b737-8aad38b5d1cf","Type":"ContainerStarted","Data":"452e1e77da834162275f75e5d2f59a7098dfdad5df6fcce553d97a7db76179a9"} Jun 11 20:03:49.783032 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:49.782999 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c467f45-2wvks" event={"ID":"c31059b1-d8a8-423c-b737-8aad38b5d1cf","Type":"ContainerStarted","Data":"0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e"} Jun 11 20:03:49.783032 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:49.783066 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:03:49.784365 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:49.784343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-44ff9" event={"ID":"52d43371-01b6-4088-8493-1d26e0298ad9","Type":"ContainerStarted","Data":"576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487"} Jun 11 20:03:49.784482 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:49.784471 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:03:49.823791 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:49.823739 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f5c467f45-2wvks" podStartSLOduration=1.950752661 podStartE2EDuration="3.823724058s" totalImagesPullingTime="1.872971397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:49.822341593 +0000 UTC m=+801.554990919" watchObservedRunningTime="2026-06-11 20:03:49.823724058 +0000 UTC m=+801.556373365" Jun 11 20:03:49.866082 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:03:49.866035 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69b744c9df-44ff9" podStartSLOduration=1.8116007760000001 podStartE2EDuration="3.866016887s" totalImagesPullingTime="2.054416111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:49.863790678 +0000 UTC m=+801.596439998" watchObservedRunningTime="2026-06-11 20:03:49.866016887 +0000 UTC m=+801.598666196" Jun 11 20:04:00.794504 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:00.794470 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:04:00.795050 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:00.794557 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:04:00.855993 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:00.855960 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b744c9df-44ff9"] Jun 11 20:04:00.856191 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:00.856167 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69b744c9df-44ff9" podUID="52d43371-01b6-4088-8493-1d26e0298ad9" containerName="manager" containerID="cri-o://576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487" gracePeriod=30 Jun 11 20:04:01.102974 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.102942 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:04:01.109886 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.109860 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52d43371-01b6-4088-8493-1d26e0298ad9-webhook-cert\") pod \"52d43371-01b6-4088-8493-1d26e0298ad9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " Jun 11 20:04:01.110001 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.109914 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9n58n\" (UniqueName: \"kubernetes.io/projected/52d43371-01b6-4088-8493-1d26e0298ad9-kube-api-access-9n58n\") pod \"52d43371-01b6-4088-8493-1d26e0298ad9\" (UID: \"52d43371-01b6-4088-8493-1d26e0298ad9\") " Jun 11 20:04:01.111896 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.111872 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52d43371-01b6-4088-8493-1d26e0298ad9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "52d43371-01b6-4088-8493-1d26e0298ad9" (UID: "52d43371-01b6-4088-8493-1d26e0298ad9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:04:01.111987 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.111947 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52d43371-01b6-4088-8493-1d26e0298ad9-kube-api-access-9n58n" (OuterVolumeSpecName: "kube-api-access-9n58n") pod "52d43371-01b6-4088-8493-1d26e0298ad9" (UID: "52d43371-01b6-4088-8493-1d26e0298ad9"). InnerVolumeSpecName "kube-api-access-9n58n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:04:01.211253 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.211229 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/52d43371-01b6-4088-8493-1d26e0298ad9-webhook-cert\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.211357 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.211256 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9n58n\" (UniqueName: \"kubernetes.io/projected/52d43371-01b6-4088-8493-1d26e0298ad9-kube-api-access-9n58n\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:04:01.841441 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.841409 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d43371-01b6-4088-8493-1d26e0298ad9" containerID="576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487" exitCode=0 Jun 11 20:04:01.841441 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.841445 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-44ff9" event={"ID":"52d43371-01b6-4088-8493-1d26e0298ad9","Type":"ContainerDied","Data":"576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487"} Jun 11 20:04:01.841934 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.841457 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b744c9df-44ff9" Jun 11 20:04:01.841934 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.841484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b744c9df-44ff9" event={"ID":"52d43371-01b6-4088-8493-1d26e0298ad9","Type":"ContainerDied","Data":"24f31bebaa2de72359daab8baf860a5e63c6f5a727e2835b01000bc003322ae8"} Jun 11 20:04:01.841934 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.841508 2580 scope.go:117] "RemoveContainer" containerID="576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487" Jun 11 20:04:01.850310 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.850294 2580 scope.go:117] "RemoveContainer" containerID="576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487" Jun 11 20:04:01.850580 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:04:01.850561 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487\": container with ID starting with 576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487 not found: ID does not exist" containerID="576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487" Jun 11 20:04:01.850631 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.850593 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487"} err="failed to get container status \"576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487\": rpc error: code = NotFound desc = could not find container \"576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487\": container with ID starting with 576d7564f0213711397785f6bed36cd9df09f968aa4d882a9d0cf69216089487 not found: ID does not exist" Jun 11 20:04:01.862710 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.862683 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69b744c9df-44ff9"] Jun 11 20:04:01.866570 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:01.866550 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69b744c9df-44ff9"] Jun 11 20:04:02.705912 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:02.705873 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52d43371-01b6-4088-8493-1d26e0298ad9" path="/var/lib/kubelet/pods/52d43371-01b6-4088-8493-1d26e0298ad9/volumes" Jun 11 20:04:17.125193 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.125155 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7fbc7cc44-l8qdl"] Jun 11 20:04:17.125613 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.125467 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52d43371-01b6-4088-8493-1d26e0298ad9" containerName="manager" Jun 11 20:04:17.125613 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.125479 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="52d43371-01b6-4088-8493-1d26e0298ad9" containerName="manager" Jun 11 20:04:17.125613 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.125553 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="52d43371-01b6-4088-8493-1d26e0298ad9" containerName="manager" Jun 11 20:04:17.128399 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.128382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.131506 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.131489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 20:04:17.131661 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.131536 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-59vwp\"" Jun 11 20:04:17.141538 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.141491 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fbc7cc44-l8qdl"] Jun 11 20:04:17.246213 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.246183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-openshift-service-ca\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.246213 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.246216 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95tgh\" (UniqueName: \"kubernetes.io/projected/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-kube-api-access-95tgh\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.246435 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.246248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-maas-api-tls\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.347565 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.347531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-openshift-service-ca\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.347565 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.347568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95tgh\" (UniqueName: \"kubernetes.io/projected/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-kube-api-access-95tgh\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.347780 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.347599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-maas-api-tls\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.347780 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:04:17.347705 2580 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 20:04:17.347780 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:04:17.347761 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-maas-api-tls podName:ca66f02e-4df3-4bc5-b4cd-5e347218ac2f nodeName:}" failed. No retries permitted until 2026-06-11 20:04:17.847744579 +0000 UTC m=+829.580393864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-maas-api-tls") pod "maas-api-7fbc7cc44-l8qdl" (UID: "ca66f02e-4df3-4bc5-b4cd-5e347218ac2f") : secret "maas-api-serving-cert" not found Jun 11 20:04:17.348241 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.348221 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-openshift-service-ca\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.358162 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.358132 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95tgh\" (UniqueName: \"kubernetes.io/projected/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-kube-api-access-95tgh\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.718134 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.718101 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4h497"] Jun 11 20:04:17.721632 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.721617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:04:17.724803 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.724769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qsxg9\"" Jun 11 20:04:17.724923 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.724893 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 20:04:17.734633 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.734611 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4h497"] Jun 11 20:04:17.751322 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.751295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhps\" (UniqueName: \"kubernetes.io/projected/3edf0640-830c-4e1c-816d-ac82c5153bfa-kube-api-access-tzhps\") pod \"payload-pre-processing-579785bc64-4h497\" (UID: \"3edf0640-830c-4e1c-816d-ac82c5153bfa\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:04:17.852202 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.852162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-maas-api-tls\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.852357 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.852261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhps\" (UniqueName: \"kubernetes.io/projected/3edf0640-830c-4e1c-816d-ac82c5153bfa-kube-api-access-tzhps\") pod \"payload-pre-processing-579785bc64-4h497\" (UID: \"3edf0640-830c-4e1c-816d-ac82c5153bfa\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:04:17.854710 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.854685 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca66f02e-4df3-4bc5-b4cd-5e347218ac2f-maas-api-tls\") pod \"maas-api-7fbc7cc44-l8qdl\" (UID: \"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f\") " pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:17.860226 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:17.860195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhps\" (UniqueName: \"kubernetes.io/projected/3edf0640-830c-4e1c-816d-ac82c5153bfa-kube-api-access-tzhps\") pod \"payload-pre-processing-579785bc64-4h497\" (UID: \"3edf0640-830c-4e1c-816d-ac82c5153bfa\") " pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:04:18.031862 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.031770 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:04:18.038376 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.038358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:18.171967 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.171919 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-4h497"] Jun 11 20:04:18.175548 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:04:18.175503 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edf0640_830c_4e1c_816d_ac82c5153bfa.slice/crio-9d185c545de20cd15f77e2d002ef627e7d8e87711d84406ddeb88e5e272b2dcc WatchSource:0}: Error finding container 9d185c545de20cd15f77e2d002ef627e7d8e87711d84406ddeb88e5e272b2dcc: Status 404 returned error can't find the container with id 9d185c545de20cd15f77e2d002ef627e7d8e87711d84406ddeb88e5e272b2dcc Jun 11 20:04:18.177482 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.177461 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:04:18.202976 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.202955 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7fbc7cc44-l8qdl"] Jun 11 20:04:18.205383 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:04:18.205360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca66f02e_4df3_4bc5_b4cd_5e347218ac2f.slice/crio-421c8f77c82a08c4ef9102f1aa2f28208ed87a8758e710d632adadf1b801fec0 WatchSource:0}: Error finding container 421c8f77c82a08c4ef9102f1aa2f28208ed87a8758e710d632adadf1b801fec0: Status 404 returned error can't find the container with id 421c8f77c82a08c4ef9102f1aa2f28208ed87a8758e710d632adadf1b801fec0 Jun 11 20:04:18.918601 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.918562 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" event={"ID":"3edf0640-830c-4e1c-816d-ac82c5153bfa","Type":"ContainerStarted","Data":"9d185c545de20cd15f77e2d002ef627e7d8e87711d84406ddeb88e5e272b2dcc"} Jun 11 20:04:18.920251 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:18.920221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" event={"ID":"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f","Type":"ContainerStarted","Data":"421c8f77c82a08c4ef9102f1aa2f28208ed87a8758e710d632adadf1b801fec0"} Jun 11 20:04:20.930861 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:20.930826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" event={"ID":"ca66f02e-4df3-4bc5-b4cd-5e347218ac2f","Type":"ContainerStarted","Data":"0b5b3ea857772a9a262e8a19f524da1cc7a29dacdd8bb4340692811c210a8380"} Jun 11 20:04:20.931223 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:20.930987 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:20.932168 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:20.932150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" event={"ID":"3edf0640-830c-4e1c-816d-ac82c5153bfa","Type":"ContainerStarted","Data":"108da90c9a07cb0c26a98be0c5349215c4eed3f0992766748683e88e4df02049"} Jun 11 20:04:20.932282 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:20.932271 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:04:20.949494 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:20.949449 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" podStartSLOduration=1.319893252 podStartE2EDuration="3.949436638s" totalImagesPullingTime="2.629543386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:20.9476668 +0000 UTC m=+832.680316108" watchObservedRunningTime="2026-06-11 20:04:20.949436638 +0000 UTC m=+832.682085944" Jun 11 20:04:20.962420 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:20.962366 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" podStartSLOduration=1.303083068 podStartE2EDuration="3.962352399s" totalImagesPullingTime="2.659269331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:20.96184363 +0000 UTC m=+832.694492941" watchObservedRunningTime="2026-06-11 20:04:20.962352399 +0000 UTC m=+832.695001709" Jun 11 20:04:26.942006 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:26.941979 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7fbc7cc44-l8qdl" Jun 11 20:04:31.939363 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:04:31.939333 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-4h497" Jun 11 20:05:28.699824 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:05:28.699798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:05:28.701154 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:05:28.701130 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:06:31.024453 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:31.024421 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:06:31.024942 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:31.024621 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" containerID="cri-o://6f4fd5c2f33268435a0adc5087c234fecb868d61b318788dadd75441e0b2fc38" gracePeriod=30 Jun 11 20:06:32.504346 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:32.504319 2580 generic.go:356] "Generic (PLEG): container finished" podID="94b720c2-f885-47cc-ac11-e6ad82860244" containerID="6f4fd5c2f33268435a0adc5087c234fecb868d61b318788dadd75441e0b2fc38" exitCode=143 Jun 11 20:06:32.504681 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:32.504390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"94b720c2-f885-47cc-ac11-e6ad82860244","Type":"ContainerDied","Data":"6f4fd5c2f33268435a0adc5087c234fecb868d61b318788dadd75441e0b2fc38"} Jun 11 20:06:32.567836 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:32.567815 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:32.653273 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:32.653242 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnnvs\" (UniqueName: \"kubernetes.io/projected/94b720c2-f885-47cc-ac11-e6ad82860244-kube-api-access-jnnvs\") pod \"94b720c2-f885-47cc-ac11-e6ad82860244\" (UID: \"94b720c2-f885-47cc-ac11-e6ad82860244\") " Jun 11 20:06:32.655500 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:32.655472 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b720c2-f885-47cc-ac11-e6ad82860244-kube-api-access-jnnvs" (OuterVolumeSpecName: "kube-api-access-jnnvs") pod "94b720c2-f885-47cc-ac11-e6ad82860244" (UID: "94b720c2-f885-47cc-ac11-e6ad82860244"). InnerVolumeSpecName "kube-api-access-jnnvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:06:32.754852 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:32.754823 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnnvs\" (UniqueName: \"kubernetes.io/projected/94b720c2-f885-47cc-ac11-e6ad82860244-kube-api-access-jnnvs\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:06:33.515155 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.515115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"94b720c2-f885-47cc-ac11-e6ad82860244","Type":"ContainerDied","Data":"a635ea5903ba3f1773c8021d6dfd1e21bee93925c256c6f40f763cd1fd43246d"} Jun 11 20:06:33.515155 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.515135 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.515690 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.515208 2580 scope.go:117] "RemoveContainer" containerID="6f4fd5c2f33268435a0adc5087c234fecb868d61b318788dadd75441e0b2fc38" Jun 11 20:06:33.531600 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.531572 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:06:33.535345 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.535325 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:06:33.560389 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.560366 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:06:33.560695 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.560682 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" Jun 11 20:06:33.560746 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.560696 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" Jun 11 20:06:33.560781 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.560747 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" containerName="keycloak" Jun 11 20:06:33.563294 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.563276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.565859 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.565842 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 20:06:33.565994 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.565977 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 20:06:33.566081 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.566048 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 20:06:33.566142 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.566099 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-bttkp\"" Jun 11 20:06:33.566304 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.566291 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 20:06:33.575001 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.574984 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:06:33.661291 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.661252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5b054e74-2fac-4eff-9dd1-2172976bbbf5-test-realms\") pod \"maas-keycloak-0\" (UID: \"5b054e74-2fac-4eff-9dd1-2172976bbbf5\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.661422 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.661312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hl4\" (UniqueName: \"kubernetes.io/projected/5b054e74-2fac-4eff-9dd1-2172976bbbf5-kube-api-access-m4hl4\") pod \"maas-keycloak-0\" (UID: \"5b054e74-2fac-4eff-9dd1-2172976bbbf5\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.762653 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.762625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hl4\" (UniqueName: \"kubernetes.io/projected/5b054e74-2fac-4eff-9dd1-2172976bbbf5-kube-api-access-m4hl4\") pod \"maas-keycloak-0\" (UID: \"5b054e74-2fac-4eff-9dd1-2172976bbbf5\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.762752 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.762701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5b054e74-2fac-4eff-9dd1-2172976bbbf5-test-realms\") pod \"maas-keycloak-0\" (UID: \"5b054e74-2fac-4eff-9dd1-2172976bbbf5\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.763377 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.763359 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/5b054e74-2fac-4eff-9dd1-2172976bbbf5-test-realms\") pod \"maas-keycloak-0\" (UID: \"5b054e74-2fac-4eff-9dd1-2172976bbbf5\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.776564 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.776476 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hl4\" (UniqueName: \"kubernetes.io/projected/5b054e74-2fac-4eff-9dd1-2172976bbbf5-kube-api-access-m4hl4\") pod \"maas-keycloak-0\" (UID: \"5b054e74-2fac-4eff-9dd1-2172976bbbf5\") " pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:33.873143 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:33.873120 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:34.000478 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.000455 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 20:06:34.003053 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:06:34.003017 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b054e74_2fac_4eff_9dd1_2172976bbbf5.slice/crio-7f59b319540862fe4bbe6e16a12f57d788289b3449236ddc011d0d5e673817c6 WatchSource:0}: Error finding container 7f59b319540862fe4bbe6e16a12f57d788289b3449236ddc011d0d5e673817c6: Status 404 returned error can't find the container with id 7f59b319540862fe4bbe6e16a12f57d788289b3449236ddc011d0d5e673817c6 Jun 11 20:06:34.521981 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.521949 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5b054e74-2fac-4eff-9dd1-2172976bbbf5","Type":"ContainerStarted","Data":"49bc3397d3da0b83dccfec65a0343e059577644e3a3f525cb7d9ebef42146464"} Jun 11 20:06:34.522377 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.522005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"5b054e74-2fac-4eff-9dd1-2172976bbbf5","Type":"ContainerStarted","Data":"7f59b319540862fe4bbe6e16a12f57d788289b3449236ddc011d0d5e673817c6"} Jun 11 20:06:34.544871 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.544810 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.192020273 podStartE2EDuration="1.544789336s" totalImagesPullingTime="352.769063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:06:34.541099629 +0000 UTC m=+966.273748936" watchObservedRunningTime="2026-06-11 20:06:34.544789336 +0000 UTC m=+966.277438647" Jun 11 20:06:34.707202 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.707155 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b720c2-f885-47cc-ac11-e6ad82860244" path="/var/lib/kubelet/pods/94b720c2-f885-47cc-ac11-e6ad82860244/volumes" Jun 11 20:06:34.873411 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.873372 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:34.875171 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:34.875136 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:35.874470 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:35.874417 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:36.874119 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:36.874079 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:37.874360 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:37.874314 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:38.874152 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:38.874085 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:39.874059 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:39.874009 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:40.875721 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:40.875672 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:41.874316 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:41.874265 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:42.874223 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:42.874178 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:43.873414 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:43.873378 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:43.873786 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:43.873750 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:44.873898 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:44.873837 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:45.873875 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:45.873817 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:46.874238 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:46.874201 2580 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Jun 11 20:06:47.970382 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:47.969405 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 20:06:47.983212 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:47.983057 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="5b054e74-2fac-4eff-9dd1-2172976bbbf5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 20:06:57.976295 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:06:57.976265 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 20:07:08.685685 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.685638 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bf8699587-mhqxw"] Jun 11 20:07:08.690348 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.690328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.692885 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.692868 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 20:07:08.698240 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.698218 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bf8699587-mhqxw"] Jun 11 20:07:08.789177 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.789146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7nxb\" (UniqueName: \"kubernetes.io/projected/9781e49d-ffd3-4863-9513-5691399309a1-kube-api-access-d7nxb\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.789289 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.789190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9781e49d-ffd3-4863-9513-5691399309a1-oidc-ca\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.789289 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.789241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9781e49d-ffd3-4863-9513-5691399309a1-tls-cert\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.890101 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.890078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9781e49d-ffd3-4863-9513-5691399309a1-oidc-ca\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.890215 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.890119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9781e49d-ffd3-4863-9513-5691399309a1-tls-cert\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.890215 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.890157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7nxb\" (UniqueName: \"kubernetes.io/projected/9781e49d-ffd3-4863-9513-5691399309a1-kube-api-access-d7nxb\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.890678 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.890657 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9781e49d-ffd3-4863-9513-5691399309a1-oidc-ca\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.892799 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.892775 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9781e49d-ffd3-4863-9513-5691399309a1-tls-cert\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:08.899505 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:08.899485 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7nxb\" (UniqueName: \"kubernetes.io/projected/9781e49d-ffd3-4863-9513-5691399309a1-kube-api-access-d7nxb\") pod \"authorino-6bf8699587-mhqxw\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:09.000263 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.000205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:07:09.130040 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.130015 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bf8699587-mhqxw"] Jun 11 20:07:09.132019 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:07:09.131990 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9781e49d_ffd3_4863_9513_5691399309a1.slice/crio-03565a65f3cea00369bade5294ebfa4d5b388622266f07e3ebdf185187d576c6 WatchSource:0}: Error finding container 03565a65f3cea00369bade5294ebfa4d5b388622266f07e3ebdf185187d576c6: Status 404 returned error can't find the container with id 03565a65f3cea00369bade5294ebfa4d5b388622266f07e3ebdf185187d576c6 Jun 11 20:07:09.755541 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.755445 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bf8699587-mhqxw" event={"ID":"9781e49d-ffd3-4863-9513-5691399309a1","Type":"ContainerStarted","Data":"3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d"} Jun 11 20:07:09.755541 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.755486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bf8699587-mhqxw" event={"ID":"9781e49d-ffd3-4863-9513-5691399309a1","Type":"ContainerStarted","Data":"03565a65f3cea00369bade5294ebfa4d5b388622266f07e3ebdf185187d576c6"} Jun 11 20:07:09.771293 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.771237 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bf8699587-mhqxw" podStartSLOduration=1.41455709 podStartE2EDuration="1.77121823s" totalImagesPullingTime="356.66114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:09.770953768 +0000 UTC m=+1001.503603078" watchObservedRunningTime="2026-06-11 20:07:09.77121823 +0000 UTC m=+1001.503867539" Jun 11 20:07:09.798045 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.798020 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7589f7479-z4gq7"] Jun 11 20:07:09.798248 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:09.798225 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7589f7479-z4gq7" podUID="799671d6-84c2-42db-815a-256958b6204c" containerName="authorino" containerID="cri-o://9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c" gracePeriod=30 Jun 11 20:07:10.041443 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.041418 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:07:10.101268 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.101240 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/799671d6-84c2-42db-815a-256958b6204c-tls-cert\") pod \"799671d6-84c2-42db-815a-256958b6204c\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " Jun 11 20:07:10.101401 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.101283 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cg5c\" (UniqueName: \"kubernetes.io/projected/799671d6-84c2-42db-815a-256958b6204c-kube-api-access-7cg5c\") pod \"799671d6-84c2-42db-815a-256958b6204c\" (UID: \"799671d6-84c2-42db-815a-256958b6204c\") " Jun 11 20:07:10.103576 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.103552 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799671d6-84c2-42db-815a-256958b6204c-kube-api-access-7cg5c" (OuterVolumeSpecName: "kube-api-access-7cg5c") pod "799671d6-84c2-42db-815a-256958b6204c" (UID: "799671d6-84c2-42db-815a-256958b6204c"). InnerVolumeSpecName "kube-api-access-7cg5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:07:10.111217 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.111194 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/799671d6-84c2-42db-815a-256958b6204c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "799671d6-84c2-42db-815a-256958b6204c" (UID: "799671d6-84c2-42db-815a-256958b6204c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:07:10.201942 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.201917 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cg5c\" (UniqueName: \"kubernetes.io/projected/799671d6-84c2-42db-815a-256958b6204c-kube-api-access-7cg5c\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:07:10.201942 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.201938 2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/799671d6-84c2-42db-815a-256958b6204c-tls-cert\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:07:10.760840 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.760804 2580 generic.go:356] "Generic (PLEG): container finished" podID="799671d6-84c2-42db-815a-256958b6204c" containerID="9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c" exitCode=0 Jun 11 20:07:10.761190 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.760865 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7589f7479-z4gq7" Jun 11 20:07:10.761190 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.760884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7589f7479-z4gq7" event={"ID":"799671d6-84c2-42db-815a-256958b6204c","Type":"ContainerDied","Data":"9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c"} Jun 11 20:07:10.761190 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.760935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7589f7479-z4gq7" event={"ID":"799671d6-84c2-42db-815a-256958b6204c","Type":"ContainerDied","Data":"2fcdcb689d4aaea025c6312b7843f29f13d39d80e5466f0716c666d3ca272951"} Jun 11 20:07:10.761190 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.760954 2580 scope.go:117] "RemoveContainer" containerID="9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c" Jun 11 20:07:10.770298 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.770280 2580 scope.go:117] "RemoveContainer" containerID="9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c" Jun 11 20:07:10.770575 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:07:10.770555 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c\": container with ID starting with 9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c not found: ID does not exist" containerID="9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c" Jun 11 20:07:10.770628 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.770582 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c"} err="failed to get container status \"9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c\": rpc error: code = NotFound desc = could not find container \"9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c\": container with ID starting with 9209ec5f9ccf93cbf598fbd4f69a48638027c22d9602257b2015aa99560c8a5c not found: ID does not exist" Jun 11 20:07:10.778612 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.778589 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7589f7479-z4gq7"] Jun 11 20:07:10.782455 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:10.782433 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7589f7479-z4gq7"] Jun 11 20:07:12.705894 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:12.705852 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="799671d6-84c2-42db-815a-256958b6204c" path="/var/lib/kubelet/pods/799671d6-84c2-42db-815a-256958b6204c/volumes" Jun 11 20:07:22.119157 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.119111 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz"] Jun 11 20:07:22.119800 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.119651 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799671d6-84c2-42db-815a-256958b6204c" containerName="authorino" Jun 11 20:07:22.119800 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.119673 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="799671d6-84c2-42db-815a-256958b6204c" containerName="authorino" Jun 11 20:07:22.119800 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.119799 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="799671d6-84c2-42db-815a-256958b6204c" containerName="authorino" Jun 11 20:07:22.124353 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.124325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.126901 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.126859 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 20:07:22.126901 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.126863 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 20:07:22.127108 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.126877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 20:07:22.127108 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.126981 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jml7t\"" Jun 11 20:07:22.134173 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.134150 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz"] Jun 11 20:07:22.190386 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.190359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60708e73-f28c-43fa-bad4-7dadf2c054d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.190501 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.190398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.190501 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.190417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.190501 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.190454 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.190501 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.190493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.190684 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.190567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9sc\" (UniqueName: \"kubernetes.io/projected/60708e73-f28c-43fa-bad4-7dadf2c054d2-kube-api-access-7b9sc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.293837 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.292110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.293837 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.292160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.293837 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.292240 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.293837 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.292291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.293837 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.292354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9sc\" (UniqueName: \"kubernetes.io/projected/60708e73-f28c-43fa-bad4-7dadf2c054d2-kube-api-access-7b9sc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.293837 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.292477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60708e73-f28c-43fa-bad4-7dadf2c054d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.297757 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.294978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.297757 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.295232 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.297757 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.295407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.297757 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.295495 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60708e73-f28c-43fa-bad4-7dadf2c054d2-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.297757 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.295660 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60708e73-f28c-43fa-bad4-7dadf2c054d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.303662 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.303639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9sc\" (UniqueName: \"kubernetes.io/projected/60708e73-f28c-43fa-bad4-7dadf2c054d2-kube-api-access-7b9sc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-69bnz\" (UID: \"60708e73-f28c-43fa-bad4-7dadf2c054d2\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.438218 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.438175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:07:22.566826 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.566801 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz"] Jun 11 20:07:22.569203 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:07:22.569177 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60708e73_f28c_43fa_bad4_7dadf2c054d2.slice/crio-82343421997d470c620c8f2e177621ca33fdb8d03a00a78687d86a1d5e22dcf7 WatchSource:0}: Error finding container 82343421997d470c620c8f2e177621ca33fdb8d03a00a78687d86a1d5e22dcf7: Status 404 returned error can't find the container with id 82343421997d470c620c8f2e177621ca33fdb8d03a00a78687d86a1d5e22dcf7 Jun 11 20:07:22.817016 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:22.816939 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" event={"ID":"60708e73-f28c-43fa-bad4-7dadf2c054d2","Type":"ContainerStarted","Data":"82343421997d470c620c8f2e177621ca33fdb8d03a00a78687d86a1d5e22dcf7"} Jun 11 20:07:25.038929 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.038897 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5"] Jun 11 20:07:25.048722 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.048696 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.051668 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.051641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 20:07:25.055607 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.055578 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5"] Jun 11 20:07:25.117316 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.117286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.117316 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.117320 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.117554 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.117347 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvph\" (UniqueName: \"kubernetes.io/projected/138c37ee-2e5e-434f-890c-9ebfced0c01e-kube-api-access-4pvph\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.117604 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.117566 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.117651 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.117634 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138c37ee-2e5e-434f-890c-9ebfced0c01e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.117704 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.117677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.218680 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.218644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138c37ee-2e5e-434f-890c-9ebfced0c01e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.218843 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.218694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.218843 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.218752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.218843 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.218774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.218843 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.218809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvph\" (UniqueName: \"kubernetes.io/projected/138c37ee-2e5e-434f-890c-9ebfced0c01e-kube-api-access-4pvph\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.219064 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.218885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.219209 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.219159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.219367 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.219340 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.219470 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.219448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.221366 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.221341 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138c37ee-2e5e-434f-890c-9ebfced0c01e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.221693 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.221667 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138c37ee-2e5e-434f-890c-9ebfced0c01e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.229069 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.229049 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvph\" (UniqueName: \"kubernetes.io/projected/138c37ee-2e5e-434f-890c-9ebfced0c01e-kube-api-access-4pvph\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5\" (UID: \"138c37ee-2e5e-434f-890c-9ebfced0c01e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:25.363146 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:25.363002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:26.359186 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:26.359158 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5"] Jun 11 20:07:26.362200 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:07:26.362170 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138c37ee_2e5e_434f_890c_9ebfced0c01e.slice/crio-48df51df260cff26bf65fd6764a565b85cf59950e1fd575329d339d24e499c54 WatchSource:0}: Error finding container 48df51df260cff26bf65fd6764a565b85cf59950e1fd575329d339d24e499c54: Status 404 returned error can't find the container with id 48df51df260cff26bf65fd6764a565b85cf59950e1fd575329d339d24e499c54 Jun 11 20:07:26.840311 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:26.840274 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" event={"ID":"138c37ee-2e5e-434f-890c-9ebfced0c01e","Type":"ContainerStarted","Data":"aa6395b1b7aac2bb18c103b5814ef847cc3b4591fdf08bdb31fe59cfea1b9e1b"} Jun 11 20:07:26.840697 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:26.840338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" event={"ID":"138c37ee-2e5e-434f-890c-9ebfced0c01e","Type":"ContainerStarted","Data":"48df51df260cff26bf65fd6764a565b85cf59950e1fd575329d339d24e499c54"} Jun 11 20:07:26.842362 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:26.842329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" event={"ID":"60708e73-f28c-43fa-bad4-7dadf2c054d2","Type":"ContainerStarted","Data":"6d55568862323535c4e565c2889d0d4c3a67cd8f40be707b489a9c7b732f6c5f"} Jun 11 20:07:27.854426 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:27.854388 2580 generic.go:356] "Generic (PLEG): container finished" podID="138c37ee-2e5e-434f-890c-9ebfced0c01e" containerID="aa6395b1b7aac2bb18c103b5814ef847cc3b4591fdf08bdb31fe59cfea1b9e1b" exitCode=0 Jun 11 20:07:27.854799 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:27.854466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" event={"ID":"138c37ee-2e5e-434f-890c-9ebfced0c01e","Type":"ContainerDied","Data":"aa6395b1b7aac2bb18c103b5814ef847cc3b4591fdf08bdb31fe59cfea1b9e1b"} Jun 11 20:07:29.865079 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:29.865048 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" event={"ID":"138c37ee-2e5e-434f-890c-9ebfced0c01e","Type":"ContainerStarted","Data":"b2fcd857e5b4579393ee74a18dfff59c12287fe0173cb50e0365e364fb415323"} Jun 11 20:07:35.030625 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.030574 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" podStartSLOduration=7.773576698 podStartE2EDuration="10.030554468s" totalImagesPullingTime="1.050560732s" totalInitContainerRuntime="1.206417038s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:07:29.90644458 +0000 UTC m=+1021.639093911" watchObservedRunningTime="2026-06-11 20:07:35.030554468 +0000 UTC m=+1026.763203773" Jun 11 20:07:35.031100 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.031080 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx"] Jun 11 20:07:35.037329 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.037308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.040484 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.040457 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 20:07:35.047021 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.046998 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx"] Jun 11 20:07:35.199974 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.199947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.200100 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.199985 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.200100 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.200004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnx9j\" (UniqueName: \"kubernetes.io/projected/f9342de2-bd43-45a9-aebd-3917d8a00da5-kube-api-access-fnx9j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.200100 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.200022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.200216 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.200105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9342de2-bd43-45a9-aebd-3917d8a00da5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.200216 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.200144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.300970 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.300902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301075 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.300966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301075 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301075 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnx9j\" (UniqueName: \"kubernetes.io/projected/f9342de2-bd43-45a9-aebd-3917d8a00da5-kube-api-access-fnx9j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301286 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301286 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9342de2-bd43-45a9-aebd-3917d8a00da5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301392 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301367 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301447 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301429 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.301502 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.301481 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.303255 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.303236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9342de2-bd43-45a9-aebd-3917d8a00da5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.303749 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.303729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9342de2-bd43-45a9-aebd-3917d8a00da5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.309143 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.309125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnx9j\" (UniqueName: \"kubernetes.io/projected/f9342de2-bd43-45a9-aebd-3917d8a00da5-kube-api-access-fnx9j\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx\" (UID: \"f9342de2-bd43-45a9-aebd-3917d8a00da5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.349123 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.349105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:07:35.363072 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.363053 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:35.363234 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.363220 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:35.376782 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.376762 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:07:35.479692 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.479664 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx"] Jun 11 20:07:35.481906 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:07:35.481878 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9342de2_bd43_45a9_aebd_3917d8a00da5.slice/crio-5abd6aaa8fcef5b3d98d56638aa0f142409639a3b063667a1424c1a8329d15bc WatchSource:0}: Error finding container 5abd6aaa8fcef5b3d98d56638aa0f142409639a3b063667a1424c1a8329d15bc: Status 404 returned error can't find the container with id 5abd6aaa8fcef5b3d98d56638aa0f142409639a3b063667a1424c1a8329d15bc Jun 11 20:07:35.895293 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.895256 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" event={"ID":"f9342de2-bd43-45a9-aebd-3917d8a00da5","Type":"ContainerStarted","Data":"fd10dc72b6d6808c7233c923ce236d3265580c1cb1d2a30354f368d81de8b411"} Jun 11 20:07:35.895510 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.895317 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" event={"ID":"f9342de2-bd43-45a9-aebd-3917d8a00da5","Type":"ContainerStarted","Data":"5abd6aaa8fcef5b3d98d56638aa0f142409639a3b063667a1424c1a8329d15bc"} Jun 11 20:07:35.908741 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:07:35.908707 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5" Jun 11 20:08:00.849980 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.849928 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p"] Jun 11 20:08:00.864097 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.864074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:00.867269 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.867245 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 20:08:00.872126 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.871876 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p"] Jun 11 20:08:00.901768 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.901741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:00.901881 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.901777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpsxr\" (UniqueName: \"kubernetes.io/projected/3f324354-b212-44ba-ba9c-9a58e6ddc432-kube-api-access-rpsxr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:00.901881 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.901815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:00.902018 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.901891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:00.902018 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.901994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:00.902125 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:00.902052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f324354-b212-44ba-ba9c-9a58e6ddc432-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003288 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003398 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f324354-b212-44ba-ba9c-9a58e6ddc432-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003398 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003398 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpsxr\" (UniqueName: \"kubernetes.io/projected/3f324354-b212-44ba-ba9c-9a58e6ddc432-kube-api-access-rpsxr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003583 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003583 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003733 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003820 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.003911 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.003892 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.006170 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.006141 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f324354-b212-44ba-ba9c-9a58e6ddc432-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.006271 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.006239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f324354-b212-44ba-ba9c-9a58e6ddc432-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.014026 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.013993 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpsxr\" (UniqueName: \"kubernetes.io/projected/3f324354-b212-44ba-ba9c-9a58e6ddc432-kube-api-access-rpsxr\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mcx2p\" (UID: \"3f324354-b212-44ba-ba9c-9a58e6ddc432\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.175665 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.175644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:01.302453 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:01.302333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p"] Jun 11 20:08:01.304613 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:08:01.304574 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f324354_b212_44ba_ba9c_9a58e6ddc432.slice/crio-7241c1b58b1ac6e3f2245859fc44a2fdae641ed5fb8a94774eafa87557f655e0 WatchSource:0}: Error finding container 7241c1b58b1ac6e3f2245859fc44a2fdae641ed5fb8a94774eafa87557f655e0: Status 404 returned error can't find the container with id 7241c1b58b1ac6e3f2245859fc44a2fdae641ed5fb8a94774eafa87557f655e0 Jun 11 20:08:02.015486 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:02.015442 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" event={"ID":"3f324354-b212-44ba-ba9c-9a58e6ddc432","Type":"ContainerStarted","Data":"7c430565d2caac0be7f23bbbbdc49c73ec652ae5840ea20ac255b1c2e6bfa343"} Jun 11 20:08:02.015486 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:02.015491 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" event={"ID":"3f324354-b212-44ba-ba9c-9a58e6ddc432","Type":"ContainerStarted","Data":"7241c1b58b1ac6e3f2245859fc44a2fdae641ed5fb8a94774eafa87557f655e0"} Jun 11 20:08:03.021146 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:03.021105 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f324354-b212-44ba-ba9c-9a58e6ddc432" containerID="7c430565d2caac0be7f23bbbbdc49c73ec652ae5840ea20ac255b1c2e6bfa343" exitCode=0 Jun 11 20:08:03.021497 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:03.021193 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" event={"ID":"3f324354-b212-44ba-ba9c-9a58e6ddc432","Type":"ContainerDied","Data":"7c430565d2caac0be7f23bbbbdc49c73ec652ae5840ea20ac255b1c2e6bfa343"} Jun 11 20:08:04.027710 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:04.027675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" event={"ID":"3f324354-b212-44ba-ba9c-9a58e6ddc432","Type":"ContainerStarted","Data":"9d60989b8283131f1fb685e6fb949383aadfaf9af069070fa7095b92ece07307"} Jun 11 20:08:04.064104 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:04.064056 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" podStartSLOduration=2.586387007 podStartE2EDuration="4.064039639s" totalImagesPullingTime="235.138704ms" totalInitContainerRuntime="1.242513928s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:08:04.06303402 +0000 UTC m=+1055.795683337" watchObservedRunningTime="2026-06-11 20:08:04.064039639 +0000 UTC m=+1055.796688945" Jun 11 20:08:11.176063 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:11.176031 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:11.176489 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:11.176074 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:11.188184 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:11.188162 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:12.074371 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:12.074343 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mcx2p" Jun 11 20:08:20.098661 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:20.098627 2580 generic.go:356] "Generic (PLEG): container finished" podID="60708e73-f28c-43fa-bad4-7dadf2c054d2" containerID="6d55568862323535c4e565c2889d0d4c3a67cd8f40be707b489a9c7b732f6c5f" exitCode=0 Jun 11 20:08:20.098980 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:20.098702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" event={"ID":"60708e73-f28c-43fa-bad4-7dadf2c054d2","Type":"ContainerDied","Data":"6d55568862323535c4e565c2889d0d4c3a67cd8f40be707b489a9c7b732f6c5f"} Jun 11 20:08:21.104690 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:21.104655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" event={"ID":"60708e73-f28c-43fa-bad4-7dadf2c054d2","Type":"ContainerStarted","Data":"a46fff460e0b4a43ec08bb77d3e566fb986d75ad2eecc9c35eff3ccc2c3c8bd2"} Jun 11 20:08:21.127259 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:21.127204 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" podStartSLOduration=1.609015782 podStartE2EDuration="59.127188593s" totalImagesPullingTime="4.007262175s" totalInitContainerRuntime="53.510910636s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:08:21.125022142 +0000 UTC m=+1072.857671448" watchObservedRunningTime="2026-06-11 20:08:21.127188593 +0000 UTC m=+1072.859837900" Jun 11 20:08:22.438887 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:22.438851 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:08:22.439247 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:22.438923 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:08:22.450861 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:22.450837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:08:23.124092 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:23.124067 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-69bnz" Jun 11 20:08:36.172995 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:36.172963 2580 generic.go:356] "Generic (PLEG): container finished" podID="f9342de2-bd43-45a9-aebd-3917d8a00da5" containerID="fd10dc72b6d6808c7233c923ce236d3265580c1cb1d2a30354f368d81de8b411" exitCode=0 Jun 11 20:08:36.173503 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:36.173045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" event={"ID":"f9342de2-bd43-45a9-aebd-3917d8a00da5","Type":"ContainerDied","Data":"fd10dc72b6d6808c7233c923ce236d3265580c1cb1d2a30354f368d81de8b411"} Jun 11 20:08:37.179751 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:37.179717 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" event={"ID":"f9342de2-bd43-45a9-aebd-3917d8a00da5","Type":"ContainerStarted","Data":"b0f10663c7bef82aa85992cdb43cf7434df85d98be953deeda96550cf26fab54"} Jun 11 20:08:37.238853 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:37.238801 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" podStartSLOduration=1.860912348 podStartE2EDuration="1m2.238785068s" totalImagesPullingTime="209.329787ms" totalInitContainerRuntime="1m0.168542933s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:08:37.237401439 +0000 UTC m=+1088.970050747" watchObservedRunningTime="2026-06-11 20:08:37.238785068 +0000 UTC m=+1088.971434397" Jun 11 20:08:45.349626 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:45.349596 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:08:45.350054 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:45.349668 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:08:45.362086 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:45.362063 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:08:46.233421 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:08:46.233391 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx" Jun 11 20:09:02.476239 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.476205 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d5d49f6cd-2gpqv"] Jun 11 20:09:02.478714 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.478698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.486848 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.486827 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d5d49f6cd-2gpqv"] Jun 11 20:09:02.502592 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.502571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/288d7e5d-ef84-487b-9214-75f0f97e1118-tls-cert\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.502690 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.502600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t226n\" (UniqueName: \"kubernetes.io/projected/288d7e5d-ef84-487b-9214-75f0f97e1118-kube-api-access-t226n\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.502757 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.502735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/288d7e5d-ef84-487b-9214-75f0f97e1118-oidc-ca\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.603344 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.603316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/288d7e5d-ef84-487b-9214-75f0f97e1118-oidc-ca\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.603451 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.603406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/288d7e5d-ef84-487b-9214-75f0f97e1118-tls-cert\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.603451 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.603432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t226n\" (UniqueName: \"kubernetes.io/projected/288d7e5d-ef84-487b-9214-75f0f97e1118-kube-api-access-t226n\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.603981 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.603951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/288d7e5d-ef84-487b-9214-75f0f97e1118-oidc-ca\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.605823 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.605805 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/288d7e5d-ef84-487b-9214-75f0f97e1118-tls-cert\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.611549 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.611503 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t226n\" (UniqueName: \"kubernetes.io/projected/288d7e5d-ef84-487b-9214-75f0f97e1118-kube-api-access-t226n\") pod \"authorino-d5d49f6cd-2gpqv\" (UID: \"288d7e5d-ef84-487b-9214-75f0f97e1118\") " pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.789680 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.789615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" Jun 11 20:09:02.918887 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:02.918861 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d5d49f6cd-2gpqv"] Jun 11 20:09:02.921306 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:09:02.921276 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod288d7e5d_ef84_487b_9214_75f0f97e1118.slice/crio-6c22e9e7baaa88c2341b443dcda6ead7fc5131c7fd00de82c05cf1ed646f40f1 WatchSource:0}: Error finding container 6c22e9e7baaa88c2341b443dcda6ead7fc5131c7fd00de82c05cf1ed646f40f1: Status 404 returned error can't find the container with id 6c22e9e7baaa88c2341b443dcda6ead7fc5131c7fd00de82c05cf1ed646f40f1 Jun 11 20:09:03.304563 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:03.304529 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" event={"ID":"288d7e5d-ef84-487b-9214-75f0f97e1118","Type":"ContainerStarted","Data":"6c22e9e7baaa88c2341b443dcda6ead7fc5131c7fd00de82c05cf1ed646f40f1"} Jun 11 20:09:04.313165 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.313125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" event={"ID":"288d7e5d-ef84-487b-9214-75f0f97e1118","Type":"ContainerStarted","Data":"886eac224f9274ee047fdb917c7a59926e670f2dfee090e06cd02f9d8c27b738"} Jun 11 20:09:04.333486 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.333430 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d5d49f6cd-2gpqv" podStartSLOduration=2.003140052 podStartE2EDuration="2.333411544s" totalImagesPullingTime="330.271492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:09:04.332028494 +0000 UTC m=+1116.064677803" watchObservedRunningTime="2026-06-11 20:09:04.333411544 +0000 UTC m=+1116.066060852" Jun 11 20:09:04.379309 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.378837 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bf8699587-mhqxw"] Jun 11 20:09:04.379309 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.379109 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6bf8699587-mhqxw" podUID="9781e49d-ffd3-4863-9513-5691399309a1" containerName="authorino" containerID="cri-o://3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d" gracePeriod=30 Jun 11 20:09:04.650945 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.650916 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:09:04.718182 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.718153 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9781e49d-ffd3-4863-9513-5691399309a1-tls-cert\") pod \"9781e49d-ffd3-4863-9513-5691399309a1\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " Jun 11 20:09:04.718340 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.718255 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7nxb\" (UniqueName: \"kubernetes.io/projected/9781e49d-ffd3-4863-9513-5691399309a1-kube-api-access-d7nxb\") pod \"9781e49d-ffd3-4863-9513-5691399309a1\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " Jun 11 20:09:04.718340 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.718288 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9781e49d-ffd3-4863-9513-5691399309a1-oidc-ca\") pod \"9781e49d-ffd3-4863-9513-5691399309a1\" (UID: \"9781e49d-ffd3-4863-9513-5691399309a1\") " Jun 11 20:09:04.720474 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.720438 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9781e49d-ffd3-4863-9513-5691399309a1-kube-api-access-d7nxb" (OuterVolumeSpecName: "kube-api-access-d7nxb") pod "9781e49d-ffd3-4863-9513-5691399309a1" (UID: "9781e49d-ffd3-4863-9513-5691399309a1"). InnerVolumeSpecName "kube-api-access-d7nxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:09:04.723448 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.723413 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9781e49d-ffd3-4863-9513-5691399309a1-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "9781e49d-ffd3-4863-9513-5691399309a1" (UID: "9781e49d-ffd3-4863-9513-5691399309a1"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 20:09:04.729147 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.729117 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9781e49d-ffd3-4863-9513-5691399309a1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9781e49d-ffd3-4863-9513-5691399309a1" (UID: "9781e49d-ffd3-4863-9513-5691399309a1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:09:04.819004 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.818962 2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9781e49d-ffd3-4863-9513-5691399309a1-tls-cert\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:09:04.819004 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.818996 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7nxb\" (UniqueName: \"kubernetes.io/projected/9781e49d-ffd3-4863-9513-5691399309a1-kube-api-access-d7nxb\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:09:04.819213 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:04.819026 2580 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9781e49d-ffd3-4863-9513-5691399309a1-oidc-ca\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:09:05.319387 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.319354 2580 generic.go:356] "Generic (PLEG): container finished" podID="9781e49d-ffd3-4863-9513-5691399309a1" containerID="3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d" exitCode=0 Jun 11 20:09:05.319801 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.319400 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bf8699587-mhqxw" Jun 11 20:09:05.319801 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.319443 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bf8699587-mhqxw" event={"ID":"9781e49d-ffd3-4863-9513-5691399309a1","Type":"ContainerDied","Data":"3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d"} Jun 11 20:09:05.319801 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.319484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bf8699587-mhqxw" event={"ID":"9781e49d-ffd3-4863-9513-5691399309a1","Type":"ContainerDied","Data":"03565a65f3cea00369bade5294ebfa4d5b388622266f07e3ebdf185187d576c6"} Jun 11 20:09:05.319801 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.319509 2580 scope.go:117] "RemoveContainer" containerID="3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d" Jun 11 20:09:05.329079 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.329057 2580 scope.go:117] "RemoveContainer" containerID="3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d" Jun 11 20:09:05.329372 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:09:05.329353 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d\": container with ID starting with 3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d not found: ID does not exist" containerID="3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d" Jun 11 20:09:05.329445 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.329381 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d"} err="failed to get container status \"3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d\": rpc error: code = NotFound desc = could not find container \"3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d\": container with ID starting with 3211c02e5c9ea69260f49a09b0a36200ca4350986375269e755308e0b184278d not found: ID does not exist" Jun 11 20:09:05.344478 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.344449 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bf8699587-mhqxw"] Jun 11 20:09:05.352630 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:05.352594 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bf8699587-mhqxw"] Jun 11 20:09:06.707071 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:06.707038 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9781e49d-ffd3-4863-9513-5691399309a1" path="/var/lib/kubelet/pods/9781e49d-ffd3-4863-9513-5691399309a1/volumes" Jun 11 20:09:24.478276 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.478243 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f5c467f45-2wvks"] Jun 11 20:09:24.478709 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.478465 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f5c467f45-2wvks" podUID="c31059b1-d8a8-423c-b737-8aad38b5d1cf" containerName="manager" containerID="cri-o://0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e" gracePeriod=30 Jun 11 20:09:24.722315 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.722289 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:09:24.791700 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.791610 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31059b1-d8a8-423c-b737-8aad38b5d1cf-webhook-cert\") pod \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " Jun 11 20:09:24.791854 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.791720 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfctx\" (UniqueName: \"kubernetes.io/projected/c31059b1-d8a8-423c-b737-8aad38b5d1cf-kube-api-access-tfctx\") pod \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\" (UID: \"c31059b1-d8a8-423c-b737-8aad38b5d1cf\") " Jun 11 20:09:24.793841 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.793813 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c31059b1-d8a8-423c-b737-8aad38b5d1cf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c31059b1-d8a8-423c-b737-8aad38b5d1cf" (UID: "c31059b1-d8a8-423c-b737-8aad38b5d1cf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 20:09:24.793968 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.793901 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31059b1-d8a8-423c-b737-8aad38b5d1cf-kube-api-access-tfctx" (OuterVolumeSpecName: "kube-api-access-tfctx") pod "c31059b1-d8a8-423c-b737-8aad38b5d1cf" (UID: "c31059b1-d8a8-423c-b737-8aad38b5d1cf"). InnerVolumeSpecName "kube-api-access-tfctx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:09:24.892609 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.892576 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfctx\" (UniqueName: \"kubernetes.io/projected/c31059b1-d8a8-423c-b737-8aad38b5d1cf-kube-api-access-tfctx\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:09:24.892609 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:24.892603 2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31059b1-d8a8-423c-b737-8aad38b5d1cf-webhook-cert\") on node \"ip-10-0-138-225.ec2.internal\" DevicePath \"\"" Jun 11 20:09:25.414948 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.414921 2580 generic.go:356] "Generic (PLEG): container finished" podID="c31059b1-d8a8-423c-b737-8aad38b5d1cf" containerID="0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e" exitCode=0 Jun 11 20:09:25.415118 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.414956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c467f45-2wvks" event={"ID":"c31059b1-d8a8-423c-b737-8aad38b5d1cf","Type":"ContainerDied","Data":"0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e"} Jun 11 20:09:25.415118 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.414975 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f5c467f45-2wvks" Jun 11 20:09:25.415118 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.414994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f5c467f45-2wvks" event={"ID":"c31059b1-d8a8-423c-b737-8aad38b5d1cf","Type":"ContainerDied","Data":"452e1e77da834162275f75e5d2f59a7098dfdad5df6fcce553d97a7db76179a9"} Jun 11 20:09:25.415118 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.415020 2580 scope.go:117] "RemoveContainer" containerID="0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e" Jun 11 20:09:25.424429 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.424412 2580 scope.go:117] "RemoveContainer" containerID="0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e" Jun 11 20:09:25.424687 ip-10-0-138-225 kubenswrapper[2580]: E0611 20:09:25.424669 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e\": container with ID starting with 0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e not found: ID does not exist" containerID="0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e" Jun 11 20:09:25.424738 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.424697 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e"} err="failed to get container status \"0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e\": rpc error: code = NotFound desc = could not find container \"0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e\": container with ID starting with 0192cc44f7ce7cf61e90efb58662ce8bc0e3fcb548f6476a2d528b301f8ae94e not found: ID does not exist" Jun 11 20:09:25.438721 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.438701 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f5c467f45-2wvks"] Jun 11 20:09:25.449023 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:25.449003 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f5c467f45-2wvks"] Jun 11 20:09:26.706101 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:09:26.706061 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31059b1-d8a8-423c-b737-8aad38b5d1cf" path="/var/lib/kubelet/pods/c31059b1-d8a8-423c-b737-8aad38b5d1cf/volumes" Jun 11 20:10:28.729089 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:10:28.729062 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:10:28.731323 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:10:28.731304 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:15:28.757760 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:15:28.757734 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:15:28.760415 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:15:28.760384 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:20:28.795136 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:20:28.795101 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:20:28.798087 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:20:28.798054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:25:28.825338 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:25:28.825301 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:25:28.837042 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:25:28.837015 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:30:28.866700 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:30:28.866593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:30:28.873606 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:30:28.873588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:35:28.896791 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:35:28.896686 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:35:28.904624 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:35:28.904608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:38:53.159141 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:38:53.159109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d5d49f6cd-2gpqv_288d7e5d-ef84-487b-9214-75f0f97e1118/authorino/0.log" Jun 11 20:38:58.012929 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:38:58.012893 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fbc7cc44-l8qdl_ca66f02e-4df3-4bc5-b4cd-5e347218ac2f/maas-api/0.log" Jun 11 20:38:58.582586 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:38:58.582552 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zdjnz_cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9/manager/0.log" Jun 11 20:38:58.929706 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:38:58.929680 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mgmzp_8c6be22f-e03c-4a8b-898c-8de4e3f57230/copy-manifests/0.log" Jun 11 20:38:58.939058 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:38:58.939032 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mgmzp_8c6be22f-e03c-4a8b-898c-8de4e3f57230/manager/0.log" Jun 11 20:39:00.273649 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:00.273614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d5d49f6cd-2gpqv_288d7e5d-ef84-487b-9214-75f0f97e1118/authorino/0.log" Jun 11 20:39:00.597082 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:00.597000 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pbqpx_414770f5-3598-4fd8-96a0-a126cc1c49aa/kuadrant-console-plugin/0.log" Jun 11 20:39:01.614200 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:01.614160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd95844fb-gf67n_5543f55a-5caf-47bc-b549-1aa04c1bc4e6/kube-auth-proxy/0.log" Jun 11 20:39:01.954815 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:01.954787 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4h497_3edf0640-830c-4e1c-816d-ac82c5153bfa/payload-pre-processing/0.log" Jun 11 20:39:02.629714 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:02.629683 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-69bnz_60708e73-f28c-43fa-bad4-7dadf2c054d2/main/0.log" Jun 11 20:39:02.636532 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:02.636493 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-69bnz_60708e73-f28c-43fa-bad4-7dadf2c054d2/storage-initializer/0.log" Jun 11 20:39:02.746134 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:02.746104 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5_138c37ee-2e5e-434f-890c-9ebfced0c01e/storage-initializer/0.log" Jun 11 20:39:02.755558 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:02.755537 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-gk5z5_138c37ee-2e5e-434f-890c-9ebfced0c01e/main/0.log" Jun 11 20:39:02.869661 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:02.869621 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx_f9342de2-bd43-45a9-aebd-3917d8a00da5/storage-initializer/0.log" Jun 11 20:39:02.876875 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:02.876853 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cpczrx_f9342de2-bd43-45a9-aebd-3917d8a00da5/main/0.log" Jun 11 20:39:03.098430 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:03.098403 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-mcx2p_3f324354-b212-44ba-ba9c-9a58e6ddc432/storage-initializer/0.log" Jun 11 20:39:03.106077 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:03.106051 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-mcx2p_3f324354-b212-44ba-ba9c-9a58e6ddc432/main/0.log" Jun 11 20:39:10.169846 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:10.169809 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w7djb_fa993e36-9370-45f1-9bcd-d2fdc5543128/global-pull-secret-syncer/0.log" Jun 11 20:39:10.289630 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:10.289602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v4qxh_ae588036-3ea1-473c-b4cf-ffcba9b86491/konnectivity-agent/0.log" Jun 11 20:39:10.355116 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:10.355092 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-225.ec2.internal_3786f2f4dbaca25666ad878803c0e66c/haproxy/0.log" Jun 11 20:39:15.290347 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:15.290314 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d5d49f6cd-2gpqv_288d7e5d-ef84-487b-9214-75f0f97e1118/authorino/0.log" Jun 11 20:39:15.373328 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:15.373302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-pbqpx_414770f5-3598-4fd8-96a0-a126cc1c49aa/kuadrant-console-plugin/0.log" Jun 11 20:39:17.501880 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.501840 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sq27b_9e87c087-46b0-424f-956f-92cf9912bac9/node-exporter/0.log" Jun 11 20:39:17.520444 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.520416 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sq27b_9e87c087-46b0-424f-956f-92cf9912bac9/kube-rbac-proxy/0.log" Jun 11 20:39:17.539006 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.538985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sq27b_9e87c087-46b0-424f-956f-92cf9912bac9/init-textfile/0.log" Jun 11 20:39:17.648124 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.648070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-c22w2_c6d77985-212b-4bb8-a073-523e7e9d5c41/kube-rbac-proxy-main/0.log" Jun 11 20:39:17.667424 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.667403 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-c22w2_c6d77985-212b-4bb8-a073-523e7e9d5c41/kube-rbac-proxy-self/0.log" Jun 11 20:39:17.687194 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.687169 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-c22w2_c6d77985-212b-4bb8-a073-523e7e9d5c41/openshift-state-metrics/0.log" Jun 11 20:39:17.931001 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:17.930972 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-pv7sw_697c1e0f-e454-4530-8f56-9f91be6a1ba7/prometheus-operator-admission-webhook/0.log" Jun 11 20:39:18.096965 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:18.096931 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6775c7ff48-vb9p8_e446ec60-cade-4e52-80bf-187c3709e951/thanos-query/0.log" Jun 11 20:39:18.118010 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:18.117965 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6775c7ff48-vb9p8_e446ec60-cade-4e52-80bf-187c3709e951/kube-rbac-proxy-web/0.log" Jun 11 20:39:18.140196 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:18.140178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6775c7ff48-vb9p8_e446ec60-cade-4e52-80bf-187c3709e951/kube-rbac-proxy/0.log" Jun 11 20:39:18.159498 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:18.159476 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6775c7ff48-vb9p8_e446ec60-cade-4e52-80bf-187c3709e951/prom-label-proxy/0.log" Jun 11 20:39:18.182298 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:18.182248 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6775c7ff48-vb9p8_e446ec60-cade-4e52-80bf-187c3709e951/kube-rbac-proxy-rules/0.log" Jun 11 20:39:18.203724 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:18.203705 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6775c7ff48-vb9p8_e446ec60-cade-4e52-80bf-187c3709e951/kube-rbac-proxy-metrics/0.log" Jun 11 20:39:21.150046 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:21.150014 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-56dqc_5ce33af0-ea35-43c6-a8b9-33e44b9f8251/download-server/0.log" Jun 11 20:39:21.870221 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:21.870192 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-5c2gr_d34d3717-b8e5-432e-9525-87428036c6d9/volume-data-source-validator/0.log" Jun 11 20:39:22.037876 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.037841 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n"] Jun 11 20:39:22.038212 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.038199 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31059b1-d8a8-423c-b737-8aad38b5d1cf" containerName="manager" Jun 11 20:39:22.038260 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.038213 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31059b1-d8a8-423c-b737-8aad38b5d1cf" containerName="manager" Jun 11 20:39:22.038260 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.038225 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9781e49d-ffd3-4863-9513-5691399309a1" containerName="authorino" Jun 11 20:39:22.038260 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.038231 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9781e49d-ffd3-4863-9513-5691399309a1" containerName="authorino" Jun 11 20:39:22.038350 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.038297 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31059b1-d8a8-423c-b737-8aad38b5d1cf" containerName="manager" Jun 11 20:39:22.038350 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.038314 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9781e49d-ffd3-4863-9513-5691399309a1" containerName="authorino" Jun 11 20:39:22.041978 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.041956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.044227 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.044206 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q7ncr\"/\"default-dockercfg-st6b8\"" Jun 11 20:39:22.044338 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.044306 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q7ncr\"/\"openshift-service-ca.crt\"" Jun 11 20:39:22.045251 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.045232 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q7ncr\"/\"kube-root-ca.crt\"" Jun 11 20:39:22.050806 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.050784 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n"] Jun 11 20:39:22.132044 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.131996 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-proc\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.132044 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.132033 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-podres\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.132174 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.132082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-lib-modules\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.132174 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.132099 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24x9n\" (UniqueName: \"kubernetes.io/projected/fbed3f3e-e7f6-4777-89dd-59112691b291-kube-api-access-24x9n\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.132174 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.132122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-sys\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232408 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-lib-modules\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232412 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24x9n\" (UniqueName: \"kubernetes.io/projected/fbed3f3e-e7f6-4777-89dd-59112691b291-kube-api-access-24x9n\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-sys\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-proc\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-podres\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232566 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-sys\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-proc\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232601 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-lib-modules\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.232773 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.232619 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbed3f3e-e7f6-4777-89dd-59112691b291-podres\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.239688 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.239669 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24x9n\" (UniqueName: \"kubernetes.io/projected/fbed3f3e-e7f6-4777-89dd-59112691b291-kube-api-access-24x9n\") pod \"perf-node-gather-daemonset-cvt7n\" (UID: \"fbed3f3e-e7f6-4777-89dd-59112691b291\") " pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.353155 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.353134 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.480149 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.480126 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n"] Jun 11 20:39:22.482336 ip-10-0-138-225 kubenswrapper[2580]: W0611 20:39:22.482311 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfbed3f3e_e7f6_4777_89dd_59112691b291.slice/crio-02e84a7bd4e1439aba3df2ba65787a1e355807aa285d6c08628da48fed9f096d WatchSource:0}: Error finding container 02e84a7bd4e1439aba3df2ba65787a1e355807aa285d6c08628da48fed9f096d: Status 404 returned error can't find the container with id 02e84a7bd4e1439aba3df2ba65787a1e355807aa285d6c08628da48fed9f096d Jun 11 20:39:22.810997 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.810967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" event={"ID":"fbed3f3e-e7f6-4777-89dd-59112691b291","Type":"ContainerStarted","Data":"f2a70e08b0b8bf3bb2f562037379127e49f2a28005379624bd73dfb81af8f687"} Jun 11 20:39:22.811123 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.811016 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" event={"ID":"fbed3f3e-e7f6-4777-89dd-59112691b291","Type":"ContainerStarted","Data":"02e84a7bd4e1439aba3df2ba65787a1e355807aa285d6c08628da48fed9f096d"} Jun 11 20:39:22.811177 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.811128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:22.827512 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:22.827465 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" podStartSLOduration=0.827451072 podStartE2EDuration="827.451072ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:39:22.826156009 +0000 UTC m=+2934.558805330" watchObservedRunningTime="2026-06-11 20:39:22.827451072 +0000 UTC m=+2934.560100381" Jun 11 20:39:23.108710 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:23.108631 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vv2n5_5451f007-016f-4f65-91d8-1751073e2e0a/dns/0.log" Jun 11 20:39:23.127407 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:23.127386 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vv2n5_5451f007-016f-4f65-91d8-1751073e2e0a/kube-rbac-proxy/0.log" Jun 11 20:39:23.222667 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:23.222643 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5qcp_fa9d0da4-8840-4921-a546-9e6edbe6d09f/dns-node-resolver/0.log" Jun 11 20:39:23.758009 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:23.757979 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59855895df-7jfvv_5d5f09fe-1c4e-4a42-b479-ccdc33840f29/registry/0.log" Jun 11 20:39:23.779620 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:23.779591 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59855895df-7jfvv_5d5f09fe-1c4e-4a42-b479-ccdc33840f29/registry/1.log" Jun 11 20:39:23.867437 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:23.867415 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zf86k_020ce4c2-f485-434b-b713-a982de3f269a/node-ca/0.log" Jun 11 20:39:24.899127 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:24.899092 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd95844fb-gf67n_5543f55a-5caf-47bc-b549-1aa04c1bc4e6/kube-auth-proxy/0.log" Jun 11 20:39:25.017686 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:25.017656 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4h497_3edf0640-830c-4e1c-816d-ac82c5153bfa/payload-pre-processing/0.log" Jun 11 20:39:25.781466 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:25.781428 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mxcpr_d27c6e5c-87f9-4ac3-a787-077dad3b1638/serve-healthcheck-canary/0.log" Jun 11 20:39:26.407305 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:26.407274 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5jdd_198dcfd0-4e75-4406-82c8-0de70c25945e/kube-rbac-proxy/0.log" Jun 11 20:39:26.426642 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:26.426611 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5jdd_198dcfd0-4e75-4406-82c8-0de70c25945e/exporter/0.log" Jun 11 20:39:26.447561 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:26.447539 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m5jdd_198dcfd0-4e75-4406-82c8-0de70c25945e/extractor/0.log" Jun 11 20:39:28.825901 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:28.825873 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q7ncr/perf-node-gather-daemonset-cvt7n" Jun 11 20:39:28.930942 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:28.930912 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7fbc7cc44-l8qdl_ca66f02e-4df3-4bc5-b4cd-5e347218ac2f/maas-api/0.log" Jun 11 20:39:29.172752 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:29.172720 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-zdjnz_cc4cd0e9-73f9-478f-a8fa-55e4667f6ec9/manager/0.log" Jun 11 20:39:29.375020 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:29.374997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mgmzp_8c6be22f-e03c-4a8b-898c-8de4e3f57230/manager/0.log" Jun 11 20:39:29.396373 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:29.396340 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-558786d47d-mgmzp_8c6be22f-e03c-4a8b-898c-8de4e3f57230/copy-manifests/0.log" Jun 11 20:39:31.010698 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:31.010669 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d5f49777d-2zrh2_bf09a106-b701-47bb-970f-9c9230171a72/manager/0.log" Jun 11 20:39:31.060228 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:31.060202 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-z86z4_20c8e891-17f0-4d35-aabe-198b37f1dbe8/openshift-lws-operator/0.log" Jun 11 20:39:35.492794 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:35.492762 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd95844fb-gf67n_5543f55a-5caf-47bc-b549-1aa04c1bc4e6/kube-auth-proxy/0.log" Jun 11 20:39:35.593643 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:35.593613 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4h497_3edf0640-830c-4e1c-816d-ac82c5153bfa/payload-pre-processing/0.log" Jun 11 20:39:36.907441 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:36.907367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd95844fb-gf67n_5543f55a-5caf-47bc-b549-1aa04c1bc4e6/kube-auth-proxy/0.log" Jun 11 20:39:37.005595 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:37.005567 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4h497_3edf0640-830c-4e1c-816d-ac82c5153bfa/payload-pre-processing/0.log" Jun 11 20:39:37.852030 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:37.851997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8wz6v_5d393574-9bf1-45d7-989b-f4d5a880feef/kube-multus/0.log" Jun 11 20:39:38.193964 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.193941 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/kube-multus-additional-cni-plugins/0.log" Jun 11 20:39:38.213403 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.213378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/egress-router-binary-copy/0.log" Jun 11 20:39:38.232536 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.232494 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/cni-plugins/0.log" Jun 11 20:39:38.250815 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.250796 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/bond-cni-plugin/0.log" Jun 11 20:39:38.270092 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.270073 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/routeoverride-cni/0.log" Jun 11 20:39:38.288992 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.288974 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/whereabouts-cni-bincopy/0.log" Jun 11 20:39:38.308834 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.308814 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txlh8_554b2a51-977a-4f82-a5de-44d1518daf17/whereabouts-cni/0.log" Jun 11 20:39:38.407011 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.406993 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g2nlh_d4f6fc2a-3608-4f30-8125-6e39c83d1b36/network-metrics-daemon/0.log" Jun 11 20:39:38.424782 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.424763 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g2nlh_d4f6fc2a-3608-4f30-8125-6e39c83d1b36/kube-rbac-proxy/0.log" Jun 11 20:39:38.805629 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.805609 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd95844fb-gf67n_5543f55a-5caf-47bc-b549-1aa04c1bc4e6/kube-auth-proxy/0.log" Jun 11 20:39:38.897695 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:38.897674 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-4h497_3edf0640-830c-4e1c-816d-ac82c5153bfa/payload-pre-processing/0.log" Jun 11 20:39:39.603906 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.603877 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-controller/0.log" Jun 11 20:39:39.619010 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.618985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/0.log" Jun 11 20:39:39.619144 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.618997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovn-acl-logging/1.log" Jun 11 20:39:39.642337 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.642297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/kube-rbac-proxy-node/0.log" Jun 11 20:39:39.665247 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.665213 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 20:39:39.681870 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.681841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/northd/0.log" Jun 11 20:39:39.701534 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.701500 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/nbdb/0.log" Jun 11 20:39:39.720839 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.720809 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/sbdb/0.log" Jun 11 20:39:39.785974 ip-10-0-138-225 kubenswrapper[2580]: I0611 20:39:39.785949 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mdzcf_cca8b044-6099-4fdc-9843-91a2b8daf43f/ovnkube-controller/0.log"