Sep 10 17:43:28.132576 ip-10-0-133-48 systemd[1]: Starting Kubernetes Kubelet... Sep 10 17:43:28.488176 ip-10-0-133-48 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:43:28.488176 ip-10-0-133-48 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 17:43:28.488176 ip-10-0-133-48 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:43:28.488176 ip-10-0-133-48 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 17:43:28.488176 ip-10-0-133-48 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 17:43:28.489725 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.489654 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 17:43:28.493260 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493244 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:28.493260 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493259 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493263 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493266 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493270 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493272 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493275 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493278 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493281 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493285 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493287 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493290 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493292 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493295 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493297 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493305 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493319 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493322 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493324 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493327 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493330 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:28.493335 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493333 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493335 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493338 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493341 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493344 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493348 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493352 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493354 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493357 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493360 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493362 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493365 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493367 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493371 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493374 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493377 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493380 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493383 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493385 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:28.493798 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493388 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493390 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493393 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493395 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493397 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493400 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493402 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493405 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493407 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493410 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493412 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493415 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493417 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493420 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493422 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493426 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493429 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493432 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493434 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493437 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:28.494247 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493439 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493442 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493444 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493447 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493449 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493451 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493454 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493456 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493459 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493461 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493463 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493466 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493469 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493473 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493476 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493479 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493482 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493484 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493487 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493490 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:28.494760 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493492 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493495 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493497 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493500 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493502 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493504 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493507 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493511 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493515 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493517 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493520 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493522 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493525 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493527 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493529 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493532 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493534 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493537 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.493539 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494184 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:28.495228 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494190 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494193 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494198 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494202 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494205 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494208 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494211 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494214 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494216 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494219 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494221 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494224 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494226 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494230 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494233 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494236 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494239 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494242 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:28.495718 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494245 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494248 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494253 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494257 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494260 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494263 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494266 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494269 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494272 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494274 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494278 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494280 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494283 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494285 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494288 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494290 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494292 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494295 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494299 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494302 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:28.496196 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494304 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494322 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494327 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494331 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494335 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494338 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494341 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494344 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494346 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494349 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494351 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494354 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494356 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494359 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494362 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494364 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494367 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494369 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494372 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494375 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:28.496713 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494377 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494380 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494382 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494385 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494387 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494390 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494392 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494394 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494397 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494399 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494401 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494404 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494412 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494415 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494419 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494421 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494424 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494426 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494428 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494431 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:28.497263 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494433 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494436 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494438 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494441 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494444 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494447 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494450 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494452 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494455 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494457 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494460 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494462 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494465 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494467 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494470 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494472 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494475 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494477 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494480 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494482 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:28.497753 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494839 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494843 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494846 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494849 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494852 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494855 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494858 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494860 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494863 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494866 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494868 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494870 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494873 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494876 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494878 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494880 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494883 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494887 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494889 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494892 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:28.498222 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494895 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494897 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494900 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494902 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494904 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494907 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494909 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494912 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494914 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494917 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494919 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494921 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494924 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494927 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494929 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494932 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494934 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494937 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494940 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494942 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:28.498711 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494944 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494947 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494949 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494951 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494954 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494957 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494960 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494963 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494965 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494968 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494970 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494973 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494975 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494978 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494980 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494982 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494985 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494987 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494990 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494992 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:28.499186 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494994 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494997 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.494999 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495003 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495006 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495010 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495013 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495016 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495019 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495022 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495024 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495027 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495029 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495032 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495034 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495037 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495039 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495042 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:28.499676 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495044 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495048 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495051 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495054 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495057 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495060 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495064 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495067 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495070 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495072 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495075 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495078 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495081 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495083 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495085 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495088 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495091 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495094 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495097 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:28.500120 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495099 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495101 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495171 2556 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495202 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495207 2556 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495211 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495216 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495219 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495223 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495226 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495229 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495232 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495236 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495239 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495242 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495245 2556 flags.go:64] FLAG: --cgroup-root="" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495248 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495251 2556 flags.go:64] FLAG: --client-ca-file="" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495254 2556 flags.go:64] FLAG: --cloud-provider="external" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495256 2556 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495260 2556 flags.go:64] FLAG: --cluster-domain="" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495263 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495266 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495269 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 17:43:28.500604 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495272 2556 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495276 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495279 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495282 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495285 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495287 2556 flags.go:64] FLAG: --contention-profiling="false" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495292 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495295 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495298 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495300 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495304 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495320 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495324 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495326 2556 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495329 2556 flags.go:64] FLAG: --enable-server="true" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495332 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495336 2556 flags.go:64] FLAG: --event-burst="100" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495339 2556 flags.go:64] FLAG: --event-qps="50" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495342 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495345 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495349 2556 flags.go:64] FLAG: --eviction-hard="" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495357 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495359 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495362 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495365 2556 flags.go:64] FLAG: --eviction-soft="" Sep 10 17:43:28.501187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495368 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495371 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495374 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495376 2556 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495379 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495382 2556 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495385 2556 flags.go:64] FLAG: --feature-gates="" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495388 2556 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495391 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495394 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495397 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495399 2556 flags.go:64] FLAG: --healthz-port="10248" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495402 2556 flags.go:64] FLAG: --help="false" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495409 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495412 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495415 2556 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495418 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495421 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495424 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495427 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495429 2556 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495432 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495435 2556 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 17:43:28.501873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495439 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495442 2556 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495445 2556 flags.go:64] FLAG: --kube-reserved="" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495448 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495452 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495455 2556 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495458 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495460 2556 flags.go:64] FLAG: --lock-file="" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495463 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495466 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495469 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495474 2556 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495476 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495479 2556 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495482 2556 flags.go:64] FLAG: --logging-format="text" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495485 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495488 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495490 2556 flags.go:64] FLAG: --manifest-url="" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495493 2556 flags.go:64] FLAG: --manifest-url-header="" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495497 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495500 2556 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495504 2556 flags.go:64] FLAG: --max-pods="110" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495507 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495510 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495513 2556 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 17:43:28.502567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495516 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495518 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495521 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495524 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495530 2556 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495533 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495536 2556 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495539 2556 flags.go:64] FLAG: --pod-cidr="" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495542 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495547 2556 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495550 2556 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495553 2556 flags.go:64] FLAG: --pods-per-core="0" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495557 2556 flags.go:64] FLAG: --port="10250" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495560 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495563 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dd1fa0db4c409ae7" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495566 2556 flags.go:64] FLAG: --qos-reserved="" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495569 2556 flags.go:64] FLAG: --read-only-port="10255" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495572 2556 flags.go:64] FLAG: --register-node="true" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495574 2556 flags.go:64] FLAG: --register-with-taints="" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495578 2556 flags.go:64] FLAG: --registry-burst="10" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495580 2556 flags.go:64] FLAG: --registry-qps="5" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495583 2556 flags.go:64] FLAG: --reserved-cpus="" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495586 2556 flags.go:64] FLAG: --reserved-memory="" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495589 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495592 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 17:43:28.503234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495595 2556 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495597 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495600 2556 flags.go:64] FLAG: --runonce="false" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495603 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495607 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495610 2556 flags.go:64] FLAG: --seccomp-default="false" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495612 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495615 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495618 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495621 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495624 2556 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495626 2556 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495629 2556 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495631 2556 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495634 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495637 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495640 2556 flags.go:64] FLAG: --system-cgroups="" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495643 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495648 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495651 2556 flags.go:64] FLAG: --tls-cert-file="" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495654 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495658 2556 flags.go:64] FLAG: --tls-min-version="" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495660 2556 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495663 2556 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495666 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 17:43:28.503917 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495668 2556 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495671 2556 flags.go:64] FLAG: --v="2" Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495675 2556 flags.go:64] FLAG: --version="false" Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495678 2556 flags.go:64] FLAG: --vmodule="" Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495682 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.495685 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495789 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495793 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495796 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495799 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495801 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495805 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495807 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495810 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495812 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495815 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495817 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495820 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495822 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495825 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495827 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:28.504662 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495830 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495832 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495835 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495838 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495840 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495844 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495846 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495849 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495851 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495854 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495856 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495859 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495861 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495864 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495866 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495869 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495871 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495874 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495876 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495879 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:28.505476 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495881 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495884 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495887 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495889 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495891 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495894 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495896 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495899 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495909 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495912 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495915 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495917 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495920 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495922 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495925 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495927 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495931 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495936 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495939 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:28.505966 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495942 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495945 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495948 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495951 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495954 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495956 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495959 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495962 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495965 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495967 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495970 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495972 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495975 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495977 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495980 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495982 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495985 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495988 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495991 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:28.506504 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495994 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495996 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.495999 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496001 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496003 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496006 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496008 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496011 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496013 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496016 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496018 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496022 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496025 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496029 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496032 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496036 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496039 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496042 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496045 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:28.506962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496048 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496051 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496053 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496056 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496058 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496061 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.496063 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.496068 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.502860 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.502876 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.502894 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.502899 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502949 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502953 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502957 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:28.507436 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502960 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502963 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502966 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502969 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502972 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502975 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502977 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502980 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502982 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502985 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502988 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502990 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502993 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502996 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.502998 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503001 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503003 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503006 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503008 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503011 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:28.507800 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503014 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503018 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503022 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503025 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503027 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503030 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503034 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503037 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503039 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503042 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503044 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503047 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503050 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503052 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503055 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503057 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503060 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503062 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503065 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:28.508278 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503069 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503072 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503075 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503078 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503082 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503085 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503088 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503091 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503094 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503096 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503099 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503101 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503104 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503106 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503109 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503111 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503114 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503117 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503119 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503122 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:28.508770 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503125 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503128 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503131 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503133 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503136 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503138 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503141 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503143 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503146 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503149 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503151 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503154 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503157 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503159 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503161 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503164 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503166 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503169 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503171 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503174 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:28.509244 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503176 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503179 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503181 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503184 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503186 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503188 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503191 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503193 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503196 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503199 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503201 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503204 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503207 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503210 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503212 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503215 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:28.509799 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503217 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.503223 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503348 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503355 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503359 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503363 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503366 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503369 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503371 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503374 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503377 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503380 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503384 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503386 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 17:43:28.510172 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503389 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503392 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503395 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503398 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503400 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503403 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503406 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503408 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503410 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503413 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503416 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503419 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503421 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503424 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503426 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503429 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503432 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503435 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503437 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 17:43:28.510519 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503440 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503442 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503444 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503447 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503450 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503452 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503455 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503457 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503459 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503462 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503464 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503466 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503469 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503471 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503474 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503476 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503478 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503481 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503484 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503487 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 17:43:28.510971 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503491 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503493 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503496 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503499 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503501 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503504 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503506 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503509 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503511 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503514 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503517 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503519 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503522 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503524 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503527 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503529 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503532 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503534 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503537 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503539 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 17:43:28.511481 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503542 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503544 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503546 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503549 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503551 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503553 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503556 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503558 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503561 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503563 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503565 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503568 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503570 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503573 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503575 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503578 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503580 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503582 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503585 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 17:43:28.511951 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503587 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503590 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503592 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503594 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503597 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503600 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503602 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503605 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:28.503607 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.503612 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.503701 2556 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.508167 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.509060 2556 server.go:1019] "Starting client certificate rotation" Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.509157 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:43:28.512414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.509185 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 17:43:28.512744 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.511119 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:43:28.512744 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.512145 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 17:43:28.519056 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.519041 2556 log.go:25] "Validated CRI v1 runtime API" Sep 10 17:43:28.523543 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.523530 2556 log.go:25] "Validated CRI v1 image API" Sep 10 17:43:28.525175 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.525160 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 17:43:28.527279 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.527262 2556 fs.go:135] Filesystem UUIDs: map[153188c1-c07a-4365-b668-4fa451b79e4f:/dev/nvme0n1p3 677ce4e4-abd6-420b-8ff2-0dcc62304191:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 10 17:43:28.527387 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.527278 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 17:43:28.531882 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.531781 2556 manager.go:216] Machine: {Timestamp:2026-09-10 17:43:28.530586379 +0000 UTC m=+0.293220099 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199335 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d3c8e4d5cf1ab6ac17e9d187a7e9d SystemUUID:ec2d3c8e-4d5c-f1ab-6ac1-7e9d187a7e9d BootID:be6d5490-ebcb-4129-838a-e4ed13b30326 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:7b:31:70:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:7b:31:70:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:e1:94:10:75:1d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 17:43:28.531882 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.531881 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 17:43:28.531983 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.531951 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 17:43:28.534680 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.534641 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 17:43:28.534802 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.534680 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 17:43:28.535138 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.535124 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:43:28.535244 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.535229 2556 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 17:43:28.535275 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.535247 2556 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 17:43:28.535275 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.535254 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:43:28.535275 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.535265 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 17:43:28.536855 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.536844 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 17:43:28.540024 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540013 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:43:28.540123 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540115 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 17:43:28.540156 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540143 2556 kubelet.go:486] "Attempting to sync node with API server" Sep 10 17:43:28.540156 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540152 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 17:43:28.540218 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540166 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 17:43:28.540218 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540175 2556 kubelet.go:398] "Adding apiserver pod source" Sep 10 17:43:28.540218 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540183 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 17:43:28.540449 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540439 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:43:28.540487 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.540455 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 17:43:28.543035 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.543013 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 17:43:28.545988 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.545972 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 17:43:28.546070 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546002 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 17:43:28.546144 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546133 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 17:43:28.546176 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546148 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 17:43:28.546176 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546154 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 17:43:28.546176 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546159 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 17:43:28.546176 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546166 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 17:43:28.546176 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546172 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 17:43:28.546676 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546667 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 17:43:28.546706 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546677 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 17:43:28.546706 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546684 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 17:43:28.546706 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546689 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 17:43:28.546706 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546697 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 17:43:28.546706 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.546704 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 17:43:28.547436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.547426 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 17:43:28.547475 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.547436 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 17:43:28.549810 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.549791 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 17:43:28.550556 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.550532 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 17:43:28.550599 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.550532 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 17:43:28.551237 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.551223 2556 server.go:1268] "Started kubelet" Sep 10 17:43:28.551330 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.551268 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 17:43:28.552031 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.551961 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 17:43:28.552031 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.552030 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 17:43:28.552017 ip-10-0-133-48 systemd[1]: Started Kubernetes Kubelet. Sep 10 17:43:28.553069 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.553044 2556 server.go:310] "Adding debug handlers to kubelet server" Sep 10 17:43:28.553499 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.553392 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 17:43:28.556711 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.556010 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-48.ec2.internal.18d406998dc51aab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-48.ec2.internal,UID:ip-10-0-133-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-48.ec2.internal,},FirstTimestamp:2026-09-10 17:43:28.551197355 +0000 UTC m=+0.313831075,LastTimestamp:2026-09-10 17:43:28.551197355 +0000 UTC m=+0.313831075,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-48.ec2.internal,}" Sep 10 17:43:28.556988 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.556966 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 17:43:28.558734 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.558717 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 17:43:28.559372 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.559354 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 17:43:28.559488 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.559471 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:28.560152 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560137 2556 factory.go:55] Registering systemd factory Sep 10 17:43:28.560152 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560152 2556 factory.go:223] Registration of the systemd container factory successfully Sep 10 17:43:28.560284 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560231 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 17:43:28.560284 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560234 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 17:43:28.560284 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560255 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 17:43:28.560406 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560360 2556 reconstruct.go:97] "Volume reconstruction finished" Sep 10 17:43:28.560406 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560370 2556 reconciler.go:29] "Reconciler: start to sync state" Sep 10 17:43:28.560406 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560363 2556 factory.go:153] Registering CRI-O factory Sep 10 17:43:28.560406 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560388 2556 factory.go:223] Registration of the crio container factory successfully Sep 10 17:43:28.560509 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560433 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 17:43:28.560509 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560450 2556 factory.go:103] Registering Raw factory Sep 10 17:43:28.560509 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560464 2556 manager.go:1196] Started watching for new ooms in manager Sep 10 17:43:28.560937 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.560921 2556 manager.go:349] Starting recovery of all containers Sep 10 17:43:28.561788 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.561771 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7r8j" Sep 10 17:43:28.564581 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.564556 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 17:43:28.564722 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.564647 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 17:43:28.568971 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.568080 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r7r8j" Sep 10 17:43:28.571591 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.571573 2556 manager.go:354] Recovery completed Sep 10 17:43:28.575710 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.575702 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.577330 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577300 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.577401 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577347 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.577401 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577363 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.577910 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577893 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 17:43:28.577910 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577907 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 17:43:28.578024 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577923 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 10 17:43:28.578024 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.577926 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.578711 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.578614 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.578779 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.578721 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.578779 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.578730 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.579055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.579045 2556 policy_none.go:49] "None policy: Start" Sep 10 17:43:28.579091 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.579060 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 17:43:28.579091 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.579070 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 17:43:28.579694 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.579629 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-48.ec2.internal.18d406998f53dcc6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-48.ec2.internal,UID:ip-10-0-133-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-48.ec2.internal,},FirstTimestamp:2026-09-10 17:43:28.577330374 +0000 UTC m=+0.339964098,LastTimestamp:2026-09-10 17:43:28.577330374 +0000 UTC m=+0.339964098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-48.ec2.internal,}" Sep 10 17:43:28.580397 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.580384 2556 policy_none.go:47] "Start" Sep 10 17:43:28.607842 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.607828 2556 manager.go:337] "Starting Device Plugin manager" Sep 10 17:43:28.607937 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.607859 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 17:43:28.607937 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.607867 2556 server.go:87] "Starting device plugin registration server" Sep 10 17:43:28.608149 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.608139 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 17:43:28.608192 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.608149 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 17:43:28.608452 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.608258 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 17:43:28.608452 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.608364 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 17:43:28.608452 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.608372 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 17:43:28.608752 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.608733 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 17:43:28.608827 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.608784 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:28.696020 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.695983 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 17:43:28.697102 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.697094 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 17:43:28.697153 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.697136 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 17:43:28.697185 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.697160 2556 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 17:43:28.697252 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.697227 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 17:43:28.699220 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.699202 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:28.708914 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.708899 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.709704 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.709686 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.709777 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.709715 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.709777 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.709727 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.709777 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.709751 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.717382 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.717369 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.717458 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.717387 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-48.ec2.internal\": node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:28.734837 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.734822 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:28.798388 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.798333 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal"] Sep 10 17:43:28.798388 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.798384 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.799107 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.799088 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.799187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.799117 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.799187 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.799131 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.800388 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.800377 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.800495 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.800483 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.800538 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.800513 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.801041 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.801023 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.801041 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.801034 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.801192 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.801052 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.801192 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.801056 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.801192 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.801066 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.801192 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.801070 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.802255 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.802243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.802299 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.802264 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 17:43:28.802957 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.802944 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Sep 10 17:43:28.803022 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.802967 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 17:43:28.803022 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.802976 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Sep 10 17:43:28.826813 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.826793 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-48.ec2.internal\" not found" node="ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.831009 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.830996 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-48.ec2.internal\" not found" node="ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.835052 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.835039 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:28.862941 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.862925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/159008f3edd5171bb1bb440b936be3a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"159008f3edd5171bb1bb440b936be3a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.862986 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.862946 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159008f3edd5171bb1bb440b936be3a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"159008f3edd5171bb1bb440b936be3a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.862986 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.862964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f9881a5f465bf70dd944de0203fca5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-48.ec2.internal\" (UID: \"13f9881a5f465bf70dd944de0203fca5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.935755 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:28.935738 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:28.963348 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.963331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/159008f3edd5171bb1bb440b936be3a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"159008f3edd5171bb1bb440b936be3a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.963391 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.963359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159008f3edd5171bb1bb440b936be3a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"159008f3edd5171bb1bb440b936be3a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.963391 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.963377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f9881a5f465bf70dd944de0203fca5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-48.ec2.internal\" (UID: \"13f9881a5f465bf70dd944de0203fca5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.963447 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.963399 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/13f9881a5f465bf70dd944de0203fca5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-48.ec2.internal\" (UID: \"13f9881a5f465bf70dd944de0203fca5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.963447 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.963425 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/159008f3edd5171bb1bb440b936be3a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"159008f3edd5171bb1bb440b936be3a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:28.963447 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:28.963435 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/159008f3edd5171bb1bb440b936be3a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"159008f3edd5171bb1bb440b936be3a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:29.036576 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:29.036551 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:29.130234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.130187 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:29.135414 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.135322 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Sep 10 17:43:29.137432 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:29.137416 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:29.237629 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:29.237602 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:29.338146 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:29.338123 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:29.438600 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:29.438549 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:29.509130 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.509112 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 17:43:29.509512 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.509234 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 17:43:29.539431 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:29.539413 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Sep 10 17:43:29.571357 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.571326 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 17:38:28 +0000 UTC" deadline="2028-04-10 07:41:51.570872546 +0000 UTC" Sep 10 17:43:29.571357 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.571355 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13861h58m21.999520648s" Sep 10 17:43:29.624546 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.624514 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:29.659975 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.659958 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Sep 10 17:43:29.670108 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.670092 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:43:29.672156 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.672138 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Sep 10 17:43:29.673303 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:29.673277 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f9881a5f465bf70dd944de0203fca5.slice/crio-f0615649064b212a39eb56fe11cf74d243ed6ff77c12b44d66cc26fb1ea3d2c9 WatchSource:0}: Error finding container f0615649064b212a39eb56fe11cf74d243ed6ff77c12b44d66cc26fb1ea3d2c9: Status 404 returned error can't find the container with id f0615649064b212a39eb56fe11cf74d243ed6ff77c12b44d66cc26fb1ea3d2c9 Sep 10 17:43:29.673690 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:29.673673 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159008f3edd5171bb1bb440b936be3a3.slice/crio-da969c3107e962ed5db6781377a10de286812b93b35e7e6470b38d7718f3e7c2 WatchSource:0}: Error finding container da969c3107e962ed5db6781377a10de286812b93b35e7e6470b38d7718f3e7c2: Status 404 returned error can't find the container with id da969c3107e962ed5db6781377a10de286812b93b35e7e6470b38d7718f3e7c2 Sep 10 17:43:29.677795 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.677781 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:43:29.680717 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.680705 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 17:43:29.700493 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.700407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" event={"ID":"159008f3edd5171bb1bb440b936be3a3","Type":"ContainerStarted","Data":"da969c3107e962ed5db6781377a10de286812b93b35e7e6470b38d7718f3e7c2"} Sep 10 17:43:29.701416 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.701397 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" event={"ID":"13f9881a5f465bf70dd944de0203fca5","Type":"ContainerStarted","Data":"f0615649064b212a39eb56fe11cf74d243ed6ff77c12b44d66cc26fb1ea3d2c9"} Sep 10 17:43:29.871845 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.871821 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:29.924140 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:29.923993 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:30.541324 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.541291 2556 apiserver.go:52] "Watching apiserver" Sep 10 17:43:30.547970 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.547946 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 17:43:30.548438 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.548407 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5","openshift-cluster-node-tuning-operator/tuned-9spln","openshift-image-registry/node-ca-2s2ss","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal","openshift-network-diagnostics/network-check-target-xcqgj","openshift-dns/node-resolver-285vv","openshift-multus/multus-additional-cni-plugins-nm9xn","openshift-multus/multus-gdkm5","openshift-multus/network-metrics-daemon-8pt67","openshift-network-operator/iptables-alerter-8v7wl","openshift-ovn-kubernetes/ovnkube-node-zm6wj","kube-system/global-pull-secret-syncer-24jdb","kube-system/konnectivity-agent-q4trf"] Sep 10 17:43:30.550066 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.550046 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.551393 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.551339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.552748 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.552406 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v9xrr\"" Sep 10 17:43:30.552748 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.552528 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.552748 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.552606 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.553611 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.553346 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.553611 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.553609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.553751 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.553740 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 17:43:30.555018 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.554104 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9r54c\"" Sep 10 17:43:30.555018 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.554240 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.555992 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.555975 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.556789 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.556607 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.556789 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.556612 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7sshg\"" Sep 10 17:43:30.557240 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.557124 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.558464 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.558300 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.559292 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.559117 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.559419 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.559382 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 17:43:30.559480 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.559446 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 17:43:30.560480 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.559643 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.560480 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.559836 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8n8bx\"" Sep 10 17:43:30.560480 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.560381 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:30.560480 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.560449 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:30.561128 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.560498 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vkhkk\"" Sep 10 17:43:30.561128 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.560705 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 17:43:30.561128 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.560710 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 17:43:30.562380 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.562360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.563752 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.563736 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.563835 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.563815 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:30.564655 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.564595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.565167 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.565149 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.565974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.565958 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:30.566053 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.566007 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:30.566628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.566440 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.566628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.566509 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 17:43:30.566628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.566445 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lvwjp\"" Sep 10 17:43:30.566628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.566447 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 17:43:30.566878 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.566858 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.567135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.567119 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.567220 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.567146 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h9ncw\"" Sep 10 17:43:30.567287 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.567120 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 17:43:30.568419 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.568400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.570124 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.570082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.571926 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.571905 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 17:43:30.572185 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572168 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-blmsv\"" Sep 10 17:43:30.572469 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572450 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 17:43:30.572672 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgt4q\" (UniqueName: \"kubernetes.io/projected/04b228a7-8ea7-48bd-94ff-376834fae6dd-kube-api-access-tgt4q\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.572741 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-host\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.572741 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-tuned\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.572741 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572665 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572664 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572756 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-socket-dir-parent\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5jq\" (UniqueName: \"kubernetes.io/projected/2980f6c2-7fa3-45b6-8b07-171d49df27a8-kube-api-access-kj5jq\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572818 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f900183-c252-4234-97fc-2cbbacf276be-konnectivity-ca\") pod \"konnectivity-agent-q4trf\" (UID: \"7f900183-c252-4234-97fc-2cbbacf276be\") " pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-kubernetes\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-run\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.572974 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-tmp\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.572975 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxzz\" (UniqueName: \"kubernetes.io/projected/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-kube-api-access-7fxzz\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-cni-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573075 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-cnibin\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad3e8332-c705-42e4-971e-ed77dc7a9abb-cni-binary-copy\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-k8s-cni-cncf-io\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-netns\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-cni-bin\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573265 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-kubelet\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-multus-certs\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2980f6c2-7fa3-45b6-8b07-171d49df27a8-host\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysconfig\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573391 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-sys\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573474 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-system-cni-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmc8f\" (UniqueName: \"kubernetes.io/projected/8ecd69d9-0430-480b-b42b-1df45691e6dd-kube-api-access-lmc8f\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573565 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-modprobe-d\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573586 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysctl-d\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-cni-multus\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.573688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-conf-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04b228a7-8ea7-48bd-94ff-376834fae6dd-iptables-alerter-script\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f900183-c252-4234-97fc-2cbbacf276be-agent-certs\") pod \"konnectivity-agent-q4trf\" (UID: \"7f900183-c252-4234-97fc-2cbbacf276be\") " pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-etc-kubernetes\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-lib-modules\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-var-lib-kubelet\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573934 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-daemon-config\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4k6\" (UniqueName: \"kubernetes.io/projected/ad3e8332-c705-42e4-971e-ed77dc7a9abb-kube-api-access-bh4k6\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.573997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04b228a7-8ea7-48bd-94ff-376834fae6dd-host-slash\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574026 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2980f6c2-7fa3-45b6-8b07-171d49df27a8-serviceca\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysctl-conf\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-systemd\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.574135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574111 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6m6w9\"" Sep 10 17:43:30.574732 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-hostroot\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.574732 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 17:43:30.574732 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ecd69d9-0430-480b-b42b-1df45691e6dd-hosts-file\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.574732 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 17:43:30.574732 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.574279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ecd69d9-0430-480b-b42b-1df45691e6dd-tmp-dir\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.576485 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.576383 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 17:43:30.600466 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.600443 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qb62c" Sep 10 17:43:30.607526 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.607483 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qb62c" Sep 10 17:43:30.660931 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.660909 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 17:43:30.672435 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.672413 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 17:43:30.674435 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-etc-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.674526 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.674526 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.674625 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-slash\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.674625 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-kubernetes\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.674625 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxzz\" (UniqueName: \"kubernetes.io/projected/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-kube-api-access-7fxzz\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.674625 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-cni-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.674784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad3e8332-c705-42e4-971e-ed77dc7a9abb-cni-binary-copy\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.674784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674710 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-cni-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.674784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-kubernetes\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.674890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-kubelet\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.674890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-socket-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.674890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-registration-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.674890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:30.674890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovnkube-script-lib\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.674890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674884 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-kubelet\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-kubelet-config\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-system-cni-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmc8f\" (UniqueName: \"kubernetes.io/projected/8ecd69d9-0430-480b-b42b-1df45691e6dd-kube-api-access-lmc8f\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.674977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysctl-d\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675006 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-system-cni-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04b228a7-8ea7-48bd-94ff-376834fae6dd-iptables-alerter-script\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675048 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f900183-c252-4234-97fc-2cbbacf276be-agent-certs\") pod \"konnectivity-agent-q4trf\" (UID: \"7f900183-c252-4234-97fc-2cbbacf276be\") " pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-cnibin\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675093 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.675132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mz2d\" (UniqueName: \"kubernetes.io/projected/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-kube-api-access-9mz2d\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-etc-kubernetes\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675156 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysctl-d\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovnkube-config\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675240 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-etc-kubernetes\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675268 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad3e8332-c705-42e4-971e-ed77dc7a9abb-cni-binary-copy\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-device-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675349 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-daemon-config\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04b228a7-8ea7-48bd-94ff-376834fae6dd-host-slash\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04b228a7-8ea7-48bd-94ff-376834fae6dd-host-slash\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675513 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-sys-fs\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675504 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-systemd\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675576 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-systemd\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675583 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04b228a7-8ea7-48bd-94ff-376834fae6dd-iptables-alerter-script\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.675670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgt4q\" (UniqueName: \"kubernetes.io/projected/04b228a7-8ea7-48bd-94ff-376834fae6dd-kube-api-access-tgt4q\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-tuned\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5jq\" (UniqueName: \"kubernetes.io/projected/2980f6c2-7fa3-45b6-8b07-171d49df27a8-kube-api-access-kj5jq\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-run-netns\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675900 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-daemon-config\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovn-node-metrics-cert\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-run\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-tmp\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.675996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-cnibin\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-cnibin\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2980f6c2-7fa3-45b6-8b07-171d49df27a8-host\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676033 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-run\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676101 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2980f6c2-7fa3-45b6-8b07-171d49df27a8-host\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-node-log\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676142 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-system-cni-dir\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676160 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-k8s-cni-cncf-io\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-netns\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.676337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-cni-bin\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-multus-certs\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676234 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-k8s-cni-cncf-io\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqphb\" (UniqueName: \"kubernetes.io/projected/fc6972a6-3eda-4e40-85e0-38453961b03b-kube-api-access-xqphb\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676253 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-cni-bin\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-kubelet\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-netns\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676306 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-run-multus-certs\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-log-socket\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysconfig\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-sys\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-cni-bin\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-sys\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysconfig\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-modprobe-d\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676507 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-cni-multus\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-host-var-lib-cni-multus\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-conf-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvbx\" (UniqueName: \"kubernetes.io/projected/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-kube-api-access-jlvbx\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-modprobe-d\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-var-lib-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-cni-netd\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-conf-dir\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-env-overrides\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-dbus\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-lib-modules\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-var-lib-kubelet\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4k6\" (UniqueName: \"kubernetes.io/projected/ad3e8332-c705-42e4-971e-ed77dc7a9abb-kube-api-access-bh4k6\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2980f6c2-7fa3-45b6-8b07-171d49df27a8-serviceca\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676822 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-lib-modules\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-ovn\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.677827 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysctl-conf\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.676988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-hostroot\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ecd69d9-0430-480b-b42b-1df45691e6dd-hosts-file\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677034 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ecd69d9-0430-480b-b42b-1df45691e6dd-tmp-dir\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677047 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-var-lib-kubelet\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-systemd\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-sysctl-conf\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677169 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2980f6c2-7fa3-45b6-8b07-171d49df27a8-serviceca\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlqc\" (UniqueName: \"kubernetes.io/projected/7c85c379-4698-4655-95b4-00bf684c0be3-kube-api-access-9qlqc\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677219 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-host\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677225 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-hostroot\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-socket-dir-parent\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677265 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-host\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677268 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f900183-c252-4234-97fc-2cbbacf276be-konnectivity-ca\") pod \"konnectivity-agent-q4trf\" (UID: \"7f900183-c252-4234-97fc-2cbbacf276be\") " pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-systemd-units\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677299 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad3e8332-c705-42e4-971e-ed77dc7a9abb-multus-socket-dir-parent\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677373 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ecd69d9-0430-480b-b42b-1df45691e6dd-tmp-dir\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.678613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677404 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ecd69d9-0430-480b-b42b-1df45691e6dd-hosts-file\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.679345 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.677859 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f900183-c252-4234-97fc-2cbbacf276be-konnectivity-ca\") pod \"konnectivity-agent-q4trf\" (UID: \"7f900183-c252-4234-97fc-2cbbacf276be\") " pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.679656 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.679637 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f900183-c252-4234-97fc-2cbbacf276be-agent-certs\") pod \"konnectivity-agent-q4trf\" (UID: \"7f900183-c252-4234-97fc-2cbbacf276be\") " pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.679962 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.679772 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-etc-tuned\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.679962 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.679835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-tmp\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.681936 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.681914 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:30.682044 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.681945 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:30.682044 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.681959 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:30.682044 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.682027 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:43:31.182007865 +0000 UTC m=+2.944641591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:30.683361 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.683293 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxzz\" (UniqueName: \"kubernetes.io/projected/294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c-kube-api-access-7fxzz\") pod \"tuned-9spln\" (UID: \"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c\") " pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.683655 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.683629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5jq\" (UniqueName: \"kubernetes.io/projected/2980f6c2-7fa3-45b6-8b07-171d49df27a8-kube-api-access-kj5jq\") pod \"node-ca-2s2ss\" (UID: \"2980f6c2-7fa3-45b6-8b07-171d49df27a8\") " pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.684192 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.684153 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgt4q\" (UniqueName: \"kubernetes.io/projected/04b228a7-8ea7-48bd-94ff-376834fae6dd-kube-api-access-tgt4q\") pod \"iptables-alerter-8v7wl\" (UID: \"04b228a7-8ea7-48bd-94ff-376834fae6dd\") " pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.684953 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.684935 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4k6\" (UniqueName: \"kubernetes.io/projected/ad3e8332-c705-42e4-971e-ed77dc7a9abb-kube-api-access-bh4k6\") pod \"multus-gdkm5\" (UID: \"ad3e8332-c705-42e4-971e-ed77dc7a9abb\") " pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.685096 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.685074 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmc8f\" (UniqueName: \"kubernetes.io/projected/8ecd69d9-0430-480b-b42b-1df45691e6dd-kube-api-access-lmc8f\") pod \"node-resolver-285vv\" (UID: \"8ecd69d9-0430-480b-b42b-1df45691e6dd\") " pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.777661 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-socket-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.777661 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-registration-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovnkube-script-lib\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777722 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-kubelet-config\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-cnibin\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777779 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-registration-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.777785 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:30.777865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777829 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.777879 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:43:31.27786013 +0000 UTC m=+3.040493851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777887 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-kubelet-config\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mz2d\" (UniqueName: \"kubernetes.io/projected/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-kube-api-access-9mz2d\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777942 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovnkube-config\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-device-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777987 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.777990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-socket-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-sys-fs\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-run-netns\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovn-node-metrics-cert\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778096 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-node-log\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-system-cni-dir\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.778172 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqphb\" (UniqueName: \"kubernetes.io/projected/fc6972a6-3eda-4e40-85e0-38453961b03b-kube-api-access-xqphb\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-kubelet\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-log-socket\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778188 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-cnibin\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-cni-bin\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-run-netns\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvbx\" (UniqueName: \"kubernetes.io/projected/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-kube-api-access-jlvbx\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778264 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-var-lib-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778288 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-cni-netd\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778298 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-env-overrides\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-dbus\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778370 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-node-log\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778402 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-log-socket\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778412 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778431 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-cni-bin\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-system-cni-dir\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.778784 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.778489 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:30.778532 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:31.278517388 +0000 UTC m=+3.041151114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778581 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-sys-fs\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-ovn\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778303 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovnkube-script-lib\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778683 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-run-ovn-kubernetes\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778689 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-cni-netd\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-var-lib-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c85c379-4698-4655-95b4-00bf684c0be3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-systemd\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778743 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-systemd\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-dbus\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-device-dir\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.779510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778778 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-run-ovn\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778796 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-kubelet\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlqc\" (UniqueName: \"kubernetes.io/projected/7c85c379-4698-4655-95b4-00bf684c0be3-kube-api-access-9qlqc\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778871 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.778990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-systemd-units\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-etc-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779082 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-etc-openvswitch\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-slash\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779136 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-systemd-units\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779163 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779190 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779190 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovnkube-config\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779213 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-host-slash\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779536 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c85c379-4698-4655-95b4-00bf684c0be3-cni-binary-copy\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.780098 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.779825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-env-overrides\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.780756 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.780739 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-ovn-node-metrics-cert\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.787280 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.787232 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqphb\" (UniqueName: \"kubernetes.io/projected/fc6972a6-3eda-4e40-85e0-38453961b03b-kube-api-access-xqphb\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:30.787411 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.787385 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvbx\" (UniqueName: \"kubernetes.io/projected/bb1858c8-9d35-47e5-ad6c-3600ba1c2d27-kube-api-access-jlvbx\") pod \"ovnkube-node-zm6wj\" (UID: \"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27\") " pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:30.787765 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.787745 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mz2d\" (UniqueName: \"kubernetes.io/projected/fe38d522-6b6e-4654-a8b6-26f8cc6d2908-kube-api-access-9mz2d\") pod \"aws-ebs-csi-driver-node-lsdg5\" (UID: \"fe38d522-6b6e-4654-a8b6-26f8cc6d2908\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.789927 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.789907 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlqc\" (UniqueName: \"kubernetes.io/projected/7c85c379-4698-4655-95b4-00bf684c0be3-kube-api-access-9qlqc\") pod \"multus-additional-cni-plugins-nm9xn\" (UID: \"7c85c379-4698-4655-95b4-00bf684c0be3\") " pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.866931 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.866861 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-285vv" Sep 10 17:43:30.875940 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.875921 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8v7wl" Sep 10 17:43:30.885728 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.885710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9spln" Sep 10 17:43:30.890356 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.890337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2s2ss" Sep 10 17:43:30.897896 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.897876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:30.905619 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.905601 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gdkm5" Sep 10 17:43:30.913183 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.913165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" Sep 10 17:43:30.920657 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.920640 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" Sep 10 17:43:30.926143 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:30.926123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:31.182271 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.182195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:31.182422 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.182380 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:31.182422 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.182404 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:31.182422 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.182413 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:31.182540 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.182461 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:43:32.182447253 +0000 UTC m=+3.945080964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:31.282587 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.282557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:31.282745 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.282630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:31.282745 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.282719 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:31.282859 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.282780 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:32.282765531 +0000 UTC m=+4.045399266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:31.282859 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.282718 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:31.282979 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:31.282879 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:43:32.282863389 +0000 UTC m=+4.045497116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:31.603670 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.603643 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecd69d9_0430_480b_b42b_1df45691e6dd.slice/crio-5cea933a592a56a79aeb3279324b36d203ff84beaf261bb84d38bbd25ccdb451 WatchSource:0}: Error finding container 5cea933a592a56a79aeb3279324b36d203ff84beaf261bb84d38bbd25ccdb451: Status 404 returned error can't find the container with id 5cea933a592a56a79aeb3279324b36d203ff84beaf261bb84d38bbd25ccdb451 Sep 10 17:43:31.604712 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.604690 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b228a7_8ea7_48bd_94ff_376834fae6dd.slice/crio-36a1ac7d67f8e150b4fee93881bf9503db5049d76870cc221e1b318ff350b5c3 WatchSource:0}: Error finding container 36a1ac7d67f8e150b4fee93881bf9503db5049d76870cc221e1b318ff350b5c3: Status 404 returned error can't find the container with id 36a1ac7d67f8e150b4fee93881bf9503db5049d76870cc221e1b318ff350b5c3 Sep 10 17:43:31.605723 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.605699 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f900183_c252_4234_97fc_2cbbacf276be.slice/crio-35fc5bd1051fae5ba800230f308c755296de747a7e75e90414099441aa3d32da WatchSource:0}: Error finding container 35fc5bd1051fae5ba800230f308c755296de747a7e75e90414099441aa3d32da: Status 404 returned error can't find the container with id 35fc5bd1051fae5ba800230f308c755296de747a7e75e90414099441aa3d32da Sep 10 17:43:31.610089 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.610067 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:38:30 +0000 UTC" deadline="2028-06-15 01:43:48.694557794 +0000 UTC" Sep 10 17:43:31.610135 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.610089 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15440h0m17.084471358s" Sep 10 17:43:31.627962 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.627944 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c85c379_4698_4655_95b4_00bf684c0be3.slice/crio-e5eca2372251824cbaee4b3086bb9319a166ced771224b57ee3011ddf8f2c089 WatchSource:0}: Error finding container e5eca2372251824cbaee4b3086bb9319a166ced771224b57ee3011ddf8f2c089: Status 404 returned error can't find the container with id e5eca2372251824cbaee4b3086bb9319a166ced771224b57ee3011ddf8f2c089 Sep 10 17:43:31.628809 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.628786 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2980f6c2_7fa3_45b6_8b07_171d49df27a8.slice/crio-05d2d8b1722ff6f176e3c6088d1793b3633e554606c1abbae3cae43c0cd9059f WatchSource:0}: Error finding container 05d2d8b1722ff6f176e3c6088d1793b3633e554606c1abbae3cae43c0cd9059f: Status 404 returned error can't find the container with id 05d2d8b1722ff6f176e3c6088d1793b3633e554606c1abbae3cae43c0cd9059f Sep 10 17:43:31.629422 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.629227 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe38d522_6b6e_4654_a8b6_26f8cc6d2908.slice/crio-06a75dce066b027a628af65f369abdeafa3ff22d7eec8ee399e51ca29c2d274a WatchSource:0}: Error finding container 06a75dce066b027a628af65f369abdeafa3ff22d7eec8ee399e51ca29c2d274a: Status 404 returned error can't find the container with id 06a75dce066b027a628af65f369abdeafa3ff22d7eec8ee399e51ca29c2d274a Sep 10 17:43:31.630046 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.630006 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3e8332_c705_42e4_971e_ed77dc7a9abb.slice/crio-1d3af03e5be49824a32283920494670791ca6650b45e5ca54da40a840dee3c94 WatchSource:0}: Error finding container 1d3af03e5be49824a32283920494670791ca6650b45e5ca54da40a840dee3c94: Status 404 returned error can't find the container with id 1d3af03e5be49824a32283920494670791ca6650b45e5ca54da40a840dee3c94 Sep 10 17:43:31.633210 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:43:31.632735 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1858c8_9d35_47e5_ad6c_3600ba1c2d27.slice/crio-c5b134e266eff0bd79aa76c99423f95c4405899866e71908212d2bafde9107aa WatchSource:0}: Error finding container c5b134e266eff0bd79aa76c99423f95c4405899866e71908212d2bafde9107aa: Status 404 returned error can't find the container with id c5b134e266eff0bd79aa76c99423f95c4405899866e71908212d2bafde9107aa Sep 10 17:43:31.713198 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.713079 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdkm5" event={"ID":"ad3e8332-c705-42e4-971e-ed77dc7a9abb","Type":"ContainerStarted","Data":"1d3af03e5be49824a32283920494670791ca6650b45e5ca54da40a840dee3c94"} Sep 10 17:43:31.715051 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.715029 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" event={"ID":"fe38d522-6b6e-4654-a8b6-26f8cc6d2908","Type":"ContainerStarted","Data":"06a75dce066b027a628af65f369abdeafa3ff22d7eec8ee399e51ca29c2d274a"} Sep 10 17:43:31.716014 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.715984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerStarted","Data":"e5eca2372251824cbaee4b3086bb9319a166ced771224b57ee3011ddf8f2c089"} Sep 10 17:43:31.716981 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.716961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q4trf" event={"ID":"7f900183-c252-4234-97fc-2cbbacf276be","Type":"ContainerStarted","Data":"35fc5bd1051fae5ba800230f308c755296de747a7e75e90414099441aa3d32da"} Sep 10 17:43:31.721167 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.721148 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8v7wl" event={"ID":"04b228a7-8ea7-48bd-94ff-376834fae6dd","Type":"ContainerStarted","Data":"36a1ac7d67f8e150b4fee93881bf9503db5049d76870cc221e1b318ff350b5c3"} Sep 10 17:43:31.725273 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.725254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-285vv" event={"ID":"8ecd69d9-0430-480b-b42b-1df45691e6dd","Type":"ContainerStarted","Data":"5cea933a592a56a79aeb3279324b36d203ff84beaf261bb84d38bbd25ccdb451"} Sep 10 17:43:31.728624 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.728604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"c5b134e266eff0bd79aa76c99423f95c4405899866e71908212d2bafde9107aa"} Sep 10 17:43:31.731762 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.731745 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9spln" event={"ID":"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c","Type":"ContainerStarted","Data":"373fb019a7535cc1c5d928fede6eea4efe9e470cd96c9a853e4b9ff239dce7f4"} Sep 10 17:43:31.732790 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:31.732770 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2s2ss" event={"ID":"2980f6c2-7fa3-45b6-8b07-171d49df27a8","Type":"ContainerStarted","Data":"05d2d8b1722ff6f176e3c6088d1793b3633e554606c1abbae3cae43c0cd9059f"} Sep 10 17:43:32.187700 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.187621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:32.187853 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.187792 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:32.187853 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.187812 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:32.187853 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.187824 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:32.187996 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.187877 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:43:34.187858947 +0000 UTC m=+5.950492667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:32.288086 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.288051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:32.288275 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.288113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:32.288275 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.288234 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:32.288407 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.288291 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:34.28827368 +0000 UTC m=+6.050907410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:32.288708 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.288570 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:32.288708 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.288634 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:43:34.288616689 +0000 UTC m=+6.051250398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:32.610763 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.610657 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 17:38:30 +0000 UTC" deadline="2028-02-11 22:58:16.609082572 +0000 UTC" Sep 10 17:43:32.610763 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.610700 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12461h14m43.998385193s" Sep 10 17:43:32.700351 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.699569 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:32.700351 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.699670 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:32.700351 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.700024 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:32.700351 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.700114 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:32.700351 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.700177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:32.700351 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:32.700240 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:32.746980 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.746057 2556 generic.go:356] "Generic (PLEG): container finished" podID="159008f3edd5171bb1bb440b936be3a3" containerID="e75f4e2b2a722bf28b496013b2fdef5f5d3df8f3d95c034a89e5566818067643" exitCode=0 Sep 10 17:43:32.746980 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.746196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" event={"ID":"159008f3edd5171bb1bb440b936be3a3","Type":"ContainerDied","Data":"e75f4e2b2a722bf28b496013b2fdef5f5d3df8f3d95c034a89e5566818067643"} Sep 10 17:43:32.756715 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:32.755763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" event={"ID":"13f9881a5f465bf70dd944de0203fca5","Type":"ContainerStarted","Data":"ddf0a37fc50da65e5b34629108058d5af715396a54fba855614a7e826c9faf25"} Sep 10 17:43:33.775490 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:33.775409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" event={"ID":"159008f3edd5171bb1bb440b936be3a3","Type":"ContainerStarted","Data":"378d37ee590101500e7fb6e2739079dd1298552bd1e498d9f0dd06f292d2d242"} Sep 10 17:43:33.792471 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:33.791943 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" podStartSLOduration=4.791922674 podStartE2EDuration="4.791922674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:32.776516469 +0000 UTC m=+4.539150200" watchObservedRunningTime="2026-09-10 17:43:33.791922674 +0000 UTC m=+5.554556404" Sep 10 17:43:34.203416 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:34.202746 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:34.203416 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.202909 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:34.203416 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.202932 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:34.203416 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.202944 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:34.203416 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.203007 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:43:38.202983066 +0000 UTC m=+9.965616778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:34.304075 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:34.303297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:34.304075 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:34.303412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:34.304075 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.303530 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:34.304075 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.303590 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:43:38.303572015 +0000 UTC m=+10.066205739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:34.304075 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.303953 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:34.304075 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.304004 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:38.303987793 +0000 UTC m=+10.066621499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:34.698944 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:34.698412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:34.698944 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:34.698412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:34.698944 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.698556 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:34.698944 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.698604 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:34.698944 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:34.698645 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:34.698944 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:34.698735 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:36.697624 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:36.697394 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:36.697624 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:36.697394 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:36.697624 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:36.697528 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:36.697624 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:36.697545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:36.698168 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:36.697668 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:36.698168 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:36.697782 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:38.240469 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:38.240432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:38.240955 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.240639 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:38.240955 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.240668 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:38.240955 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.240682 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:38.240955 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.240750 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:43:46.240730329 +0000 UTC m=+18.003364056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:38.341508 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:38.341475 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:38.341691 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:38.341530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:38.341691 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.341654 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:38.341691 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.341660 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:38.341891 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.341710 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:43:46.341697555 +0000 UTC m=+18.104331280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:38.341891 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.341724 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:43:46.341718044 +0000 UTC m=+18.104351752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:38.700461 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:38.699869 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:38.700461 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.699982 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:38.700461 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:38.700151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:38.700659 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.700438 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:38.700659 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:38.700519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:38.700659 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:38.700609 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:40.698181 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:40.698142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:40.698181 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:40.698170 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:40.698670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:40.698142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:40.698670 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:40.698275 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:40.698670 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:40.698422 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:40.698670 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:40.698526 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:42.697861 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:42.697832 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:42.697861 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:42.697839 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:42.698396 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:42.697865 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:42.698396 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:42.697978 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:42.698396 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:42.698121 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:42.698396 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:42.698200 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:44.697875 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:44.697835 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:44.698330 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:44.697843 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:44.698330 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:44.697976 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:44.698330 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:44.697843 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:44.698330 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:44.698081 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:44.698330 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:44.698117 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:46.299469 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:46.299426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:46.299960 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.299628 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:43:46.299960 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.299656 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:43:46.299960 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.299669 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:46.299960 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.299735 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:44:02.299716641 +0000 UTC m=+34.062350369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:43:46.400425 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:46.400392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:46.400593 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:46.400461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:46.400593 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.400561 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:46.400593 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.400561 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:46.400745 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.400632 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:44:02.40061027 +0000 UTC m=+34.163243979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 17:43:46.400745 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.400653 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:02.400641792 +0000 UTC m=+34.163275500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:43:46.698509 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:46.698193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:46.698509 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:46.698221 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:46.698509 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:46.698263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:46.698720 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.698577 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:46.698720 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.698658 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:46.698816 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:46.698756 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:48.698009 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:48.697976 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:48.698355 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:48.698062 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:48.698355 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:48.698142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:48.698355 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:48.698211 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:48.698355 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:48.698256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:48.698355 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:48.698324 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:49.794231 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.794083 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 17:43:49.806609 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.806582 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gdkm5" event={"ID":"ad3e8332-c705-42e4-971e-ed77dc7a9abb","Type":"ContainerStarted","Data":"4d38f38aad87215a470d8c6d4ff9c73cd356cfdc552b32674085418a7d877714"} Sep 10 17:43:49.808255 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.808236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" event={"ID":"fe38d522-6b6e-4654-a8b6-26f8cc6d2908","Type":"ContainerStarted","Data":"472b2abab2d0c75701fe229fbfaf327cd669628aaeab8ebf5e8d8425f373b14a"} Sep 10 17:43:49.808356 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.808278 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" event={"ID":"fe38d522-6b6e-4654-a8b6-26f8cc6d2908","Type":"ContainerStarted","Data":"86e7ca9f3deaf6730f4b4d21d3fbef08fd3270854804cb29d735ab89b805fd23"} Sep 10 17:43:49.809733 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.809713 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c85c379-4698-4655-95b4-00bf684c0be3" containerID="3ae3b9bcde887a96e0674f9b4327afbdf68d3261a9544770729e0e41a3e76127" exitCode=0 Sep 10 17:43:49.809819 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.809776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerDied","Data":"3ae3b9bcde887a96e0674f9b4327afbdf68d3261a9544770729e0e41a3e76127"} Sep 10 17:43:49.811370 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.811338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q4trf" event={"ID":"7f900183-c252-4234-97fc-2cbbacf276be","Type":"ContainerStarted","Data":"e0eef2408696893979e390eee650c52bf4bd9b0288b6df2c8dc5c09ab8711809"} Sep 10 17:43:49.812893 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.812873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-285vv" event={"ID":"8ecd69d9-0430-480b-b42b-1df45691e6dd","Type":"ContainerStarted","Data":"13b70bd68f5f225184545b564392e668bba700d5b335064af2d390411852c57b"} Sep 10 17:43:49.816050 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816036 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:43:49.816392 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816375 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb1858c8-9d35-47e5-ad6c-3600ba1c2d27" containerID="e1389bcdf558cef9223c1991c2c869a3682b92e9ec470bc24e69d7247680576f" exitCode=1 Sep 10 17:43:49.816457 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816440 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"1c2bae7aa93d30aa99c667872bccec449dcd8a27b9672e59ba7fc78ad0fe473b"} Sep 10 17:43:49.816508 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816496 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"93d15d21075064c8dfca9d87b0f79862ee68bab6963ec07cf6c5eceea1f580ff"} Sep 10 17:43:49.816550 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"ef3f386fa0b308d048b1d049934c3256e9465e7a5ccfaac3dff1195927e1fa46"} Sep 10 17:43:49.816582 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816570 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"ee4cd1d285194f2e14a6c3e14e0fc24cb8948c404f793aea6774a5f6fbcb7cc9"} Sep 10 17:43:49.816624 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerDied","Data":"e1389bcdf558cef9223c1991c2c869a3682b92e9ec470bc24e69d7247680576f"} Sep 10 17:43:49.816682 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.816665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"ee8d931f46ca2594787a0880641410225626c586488a71dfbae5cd1f9d904b8a"} Sep 10 17:43:49.817820 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.817799 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9spln" event={"ID":"294ac58a-a7d8-4ac6-97ec-d4b0aeb3a44c","Type":"ContainerStarted","Data":"33572225854bfb4f921a7a4f2ec6e0651ba175fb14500fa7b66487f46c196754"} Sep 10 17:43:49.819035 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.819018 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2s2ss" event={"ID":"2980f6c2-7fa3-45b6-8b07-171d49df27a8","Type":"ContainerStarted","Data":"799bd5228b70b13c6b1f5d6ee6bb3654b741a0e816e37cd80551bc838d611052"} Sep 10 17:43:49.826843 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.826804 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" podStartSLOduration=20.826793113 podStartE2EDuration="20.826793113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:33.792457334 +0000 UTC m=+5.555091066" watchObservedRunningTime="2026-09-10 17:43:49.826793113 +0000 UTC m=+21.589426842" Sep 10 17:43:49.827008 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.826990 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gdkm5" podStartSLOduration=4.559053793 podStartE2EDuration="21.826983509s" totalImagesPullingTime="17.267929716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:49.826470942 +0000 UTC m=+21.589104671" watchObservedRunningTime="2026-09-10 17:43:49.826983509 +0000 UTC m=+21.589617237" Sep 10 17:43:49.841555 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.841517 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-285vv" podStartSLOduration=4.688559616 podStartE2EDuration="21.841506067s" totalImagesPullingTime="17.152946451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:49.841419703 +0000 UTC m=+21.604053431" watchObservedRunningTime="2026-09-10 17:43:49.841506067 +0000 UTC m=+21.604139795" Sep 10 17:43:49.876516 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.876473 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2s2ss" podStartSLOduration=4.750405482 podStartE2EDuration="21.876459337s" totalImagesPullingTime="17.126053855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:49.858381167 +0000 UTC m=+21.621014906" watchObservedRunningTime="2026-09-10 17:43:49.876459337 +0000 UTC m=+21.639093065" Sep 10 17:43:49.910946 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:49.910900 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q4trf" podStartSLOduration=8.581807775 podStartE2EDuration="21.910886496s" totalImagesPullingTime="13.329078721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:49.879078139 +0000 UTC m=+21.641711867" watchObservedRunningTime="2026-09-10 17:43:49.910886496 +0000 UTC m=+21.673520261" Sep 10 17:43:50.619870 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.619724 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T17:43:49.794228096Z","UUID":"1228e48c-c7ce-435c-a7a3-29bcc7aad068","Handler":null,"Name":"","Endpoint":""} Sep 10 17:43:50.621230 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.621207 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 17:43:50.621368 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.621242 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 17:43:50.697530 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.697504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:50.697649 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.697534 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:50.697649 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.697509 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:50.697649 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:50.697637 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:50.697784 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:50.697750 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:50.697890 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:50.697870 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:50.823394 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.823363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" event={"ID":"fe38d522-6b6e-4654-a8b6-26f8cc6d2908","Type":"ContainerStarted","Data":"ac49ed67ae088d7a85437ecb864c20b3b4394c76e43e979fc71e4383f2a9df3c"} Sep 10 17:43:50.825228 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.825200 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8v7wl" event={"ID":"04b228a7-8ea7-48bd-94ff-376834fae6dd","Type":"ContainerStarted","Data":"44316a0575882bc1ddb100e9096a09619250ea2c594f027e9dc1db95a0ca09b9"} Sep 10 17:43:50.849614 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.849569 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9spln" podStartSLOduration=5.723335694 podStartE2EDuration="22.849554982s" totalImagesPullingTime="17.126219288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:49.930691704 +0000 UTC m=+21.693325431" watchObservedRunningTime="2026-09-10 17:43:50.849554982 +0000 UTC m=+22.612188711" Sep 10 17:43:50.869724 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.869674 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsdg5" podStartSLOduration=4.18102929 podStartE2EDuration="22.869661437s" totalImagesPullingTime="18.688632147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:50.849693667 +0000 UTC m=+22.612327391" watchObservedRunningTime="2026-09-10 17:43:50.869661437 +0000 UTC m=+22.632295165" Sep 10 17:43:50.870147 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:50.870091 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8v7wl" podStartSLOduration=5.737192599 podStartE2EDuration="22.870082479s" totalImagesPullingTime="17.13288988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:50.869804033 +0000 UTC m=+22.632437762" watchObservedRunningTime="2026-09-10 17:43:50.870082479 +0000 UTC m=+22.632716207" Sep 10 17:43:51.830926 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:51.830851 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:43:51.831412 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:51.831345 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"95c88625c4f0d4a105b5725cdeefbcdc9aa9f0862595fe3f45861eac0830534b"} Sep 10 17:43:52.698119 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:52.697924 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:52.698402 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:52.697925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:52.698402 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:52.698197 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:52.698402 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:52.697942 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:52.698402 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:52.698304 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:52.698584 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:52.698433 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:53.015666 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:53.015591 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:53.016270 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:53.016253 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:53.840628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:53.840605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:43:53.841058 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:53.841030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"2492c65d8aa4196aea126935326d9ce24679d5d91a0a0a36a8ae508cd9d6a2b8"} Sep 10 17:43:53.841423 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:53.841406 2556 scope.go:117] "RemoveContainer" containerID="e1389bcdf558cef9223c1991c2c869a3682b92e9ec470bc24e69d7247680576f" Sep 10 17:43:54.697978 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.697811 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:54.698418 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.697817 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:54.698418 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.697822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:54.698418 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:54.698175 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:54.698418 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:54.698051 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:54.698773 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:54.698740 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:54.844989 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.844959 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c85c379-4698-4655-95b4-00bf684c0be3" containerID="7644a6e44a94257a357ee3910c643bdd86486cb00538d7475c823c875762178b" exitCode=0 Sep 10 17:43:54.845181 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.845050 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerDied","Data":"7644a6e44a94257a357ee3910c643bdd86486cb00538d7475c823c875762178b"} Sep 10 17:43:54.855556 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.855538 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:43:54.855872 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.855854 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" event={"ID":"bb1858c8-9d35-47e5-ad6c-3600ba1c2d27","Type":"ContainerStarted","Data":"c138e3dafb4e0eb91c9155b65864e54b6a0d1f906f8c79e8bfd6395d271184e6"} Sep 10 17:43:54.856139 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.856117 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:54.856229 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.856186 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:54.856229 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.856219 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:54.872110 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.872089 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:54.872211 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.872173 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:43:54.895361 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:54.895303 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" podStartSLOduration=9.738535252 podStartE2EDuration="26.895291355s" totalImagesPullingTime="17.156756103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:43:54.894173801 +0000 UTC m=+26.656807522" watchObservedRunningTime="2026-09-10 17:43:54.895291355 +0000 UTC m=+26.657925084" Sep 10 17:43:55.600090 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.600063 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcqgj"] Sep 10 17:43:55.600196 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.600182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:55.600299 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:55.600274 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:55.604069 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.604048 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-24jdb"] Sep 10 17:43:55.604182 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.604145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:55.604282 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:55.604261 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:55.604405 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.604340 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8pt67"] Sep 10 17:43:55.604486 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.604449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:55.604697 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:55.604574 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:55.859998 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.859969 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c85c379-4698-4655-95b4-00bf684c0be3" containerID="ff9e280ec0e97d81a2b2b3c2a1b660a3c7e218d01b9ac650158d85451bb913a3" exitCode=0 Sep 10 17:43:55.860886 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:55.860045 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerDied","Data":"ff9e280ec0e97d81a2b2b3c2a1b660a3c7e218d01b9ac650158d85451bb913a3"} Sep 10 17:43:56.700609 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:56.700581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:56.700750 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:56.700689 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:56.700750 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:56.700732 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:56.700856 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:56.700805 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:56.864887 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:56.864806 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c85c379-4698-4655-95b4-00bf684c0be3" containerID="0f0655001e4e0feafcda007c02ceff9c29b9138db04d8e2ad1cc70c4ed228bcd" exitCode=0 Sep 10 17:43:56.865300 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:56.864885 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerDied","Data":"0f0655001e4e0feafcda007c02ceff9c29b9138db04d8e2ad1cc70c4ed228bcd"} Sep 10 17:43:57.698041 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:57.697811 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:57.698219 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:57.698156 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:43:58.699117 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:58.699012 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:43:58.699117 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:58.699092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:43:58.699636 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:58.699111 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:43:58.699636 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:58.699205 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:43:59.156277 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:59.156199 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:59.156449 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:59.156353 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 17:43:59.156844 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:59.156823 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q4trf" Sep 10 17:43:59.698294 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:43:59.698267 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:43:59.698475 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:43:59.698411 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:44:00.701205 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:00.701178 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:00.701615 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:00.701179 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:44:00.701615 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:00.701274 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xcqgj" podUID="3de3b104-48e6-4485-9c19-59936dcd9ade" Sep 10 17:44:00.701615 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:00.701388 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-24jdb" podUID="4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42" Sep 10 17:44:01.566164 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.566141 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeReady" Sep 10 17:44:01.566279 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.566267 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 17:44:01.606904 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.606883 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rkbd7"] Sep 10 17:44:01.626052 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.626023 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2jhzs"] Sep 10 17:44:01.626167 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.626143 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.628458 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.628442 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 17:44:01.628553 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.628490 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 17:44:01.628595 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.628566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f22bv\"" Sep 10 17:44:01.646392 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.646375 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rkbd7"] Sep 10 17:44:01.646478 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.646423 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2jhzs"] Sep 10 17:44:01.646478 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.646425 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.648562 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.648540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 17:44:01.648562 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.648551 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ck4tw\"" Sep 10 17:44:01.648714 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.648568 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 17:44:01.648714 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.648663 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 17:44:01.697478 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.697450 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:44:01.699738 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.699720 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 17:44:01.699844 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.699834 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kjkcx\"" Sep 10 17:44:01.705427 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.705408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gxf7\" (UniqueName: \"kubernetes.io/projected/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-kube-api-access-5gxf7\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.705678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.705480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.705678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.705501 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-config-volume\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.705678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.705534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-tmp-dir\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.806225 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-tmp-dir\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.806225 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvnwp\" (UniqueName: \"kubernetes.io/projected/89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee-kube-api-access-lvnwp\") pod \"ingress-canary-2jhzs\" (UID: \"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee\") " pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.806446 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee-cert\") pod \"ingress-canary-2jhzs\" (UID: \"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee\") " pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.806446 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gxf7\" (UniqueName: \"kubernetes.io/projected/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-kube-api-access-5gxf7\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.806446 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.806446 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-config-volume\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.806572 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:01.806506 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:01.806613 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:01.806572 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:44:02.306553572 +0000 UTC m=+34.069187284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:01.806613 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806589 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-tmp-dir\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.806927 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.806911 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-config-volume\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.815887 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.815865 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gxf7\" (UniqueName: \"kubernetes.io/projected/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-kube-api-access-5gxf7\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:01.879539 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.879508 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c85c379-4698-4655-95b4-00bf684c0be3" containerID="088e422f8bd1ca9dabd2c1e3bf171752f844a69e121e447b7a7d014bf2b63ecd" exitCode=0 Sep 10 17:44:01.879652 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.879570 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerDied","Data":"088e422f8bd1ca9dabd2c1e3bf171752f844a69e121e447b7a7d014bf2b63ecd"} Sep 10 17:44:01.906903 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.906885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvnwp\" (UniqueName: \"kubernetes.io/projected/89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee-kube-api-access-lvnwp\") pod \"ingress-canary-2jhzs\" (UID: \"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee\") " pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.906997 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.906925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee-cert\") pod \"ingress-canary-2jhzs\" (UID: \"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee\") " pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.911077 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.911040 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee-cert\") pod \"ingress-canary-2jhzs\" (UID: \"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee\") " pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.917428 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.917407 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvnwp\" (UniqueName: \"kubernetes.io/projected/89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee-kube-api-access-lvnwp\") pod \"ingress-canary-2jhzs\" (UID: \"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee\") " pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:01.954150 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:01.954121 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2jhzs" Sep 10 17:44:02.264391 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.264204 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2jhzs"] Sep 10 17:44:02.267735 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:44:02.267712 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dca1b9_b3b0_41ad_b08b_ffc1ee7b8bee.slice/crio-49dd1dfb20a56f2935c9a3180b352eb36f6886d2cfe6284f09042809123379d6 WatchSource:0}: Error finding container 49dd1dfb20a56f2935c9a3180b352eb36f6886d2cfe6284f09042809123379d6: Status 404 returned error can't find the container with id 49dd1dfb20a56f2935c9a3180b352eb36f6886d2cfe6284f09042809123379d6 Sep 10 17:44:02.310169 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.310144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:02.310249 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.310195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:02.310300 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.310286 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:02.310363 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.310300 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 17:44:02.310363 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.310333 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 17:44:02.310363 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.310345 2556 projected.go:196] Error preparing data for projected volume kube-api-access-92xg8 for pod openshift-network-diagnostics/network-check-target-xcqgj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:44:02.310363 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.310362 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:44:03.310345213 +0000 UTC m=+35.072978935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:02.310501 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.310380 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8 podName:3de3b104-48e6-4485-9c19-59936dcd9ade nodeName:}" failed. No retries permitted until 2026-09-10 17:44:34.310369463 +0000 UTC m=+66.073003177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-92xg8" (UniqueName: "kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8") pod "network-check-target-xcqgj" (UID: "3de3b104-48e6-4485-9c19-59936dcd9ade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 17:44:02.410809 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.410756 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:44:02.410809 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.410797 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:44:02.410931 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.410892 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 17:44:02.410931 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.410894 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:44:02.410992 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.410933 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret podName:4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42 nodeName:}" failed. No retries permitted until 2026-09-10 17:44:34.410922572 +0000 UTC m=+66.173556279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret") pod "global-pull-secret-syncer-24jdb" (UID: "4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42") : object "kube-system"/"original-pull-secret" not registered Sep 10 17:44:02.410992 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:02.410946 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:44:34.410939798 +0000 UTC m=+66.173573506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : secret "metrics-daemon-secret" not found Sep 10 17:44:02.697813 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.697736 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:44:02.697938 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.697891 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:02.700402 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.700382 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:44:02.701212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.701194 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgh9m\"" Sep 10 17:44:02.701335 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.701242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:44:02.701335 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.701242 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:44:02.885540 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.885507 2556 generic.go:356] "Generic (PLEG): container finished" podID="7c85c379-4698-4655-95b4-00bf684c0be3" containerID="84a950b4deb0bba648d94b65494120715d0f9c8d9cf55c5e46a460088fd4163d" exitCode=0 Sep 10 17:44:02.886168 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.885595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerDied","Data":"84a950b4deb0bba648d94b65494120715d0f9c8d9cf55c5e46a460088fd4163d"} Sep 10 17:44:02.886793 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:02.886765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2jhzs" event={"ID":"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee","Type":"ContainerStarted","Data":"49dd1dfb20a56f2935c9a3180b352eb36f6886d2cfe6284f09042809123379d6"} Sep 10 17:44:03.319211 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:03.316662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:03.319211 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:03.316841 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:03.319211 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:03.316910 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:44:05.31689247 +0000 UTC m=+37.079526197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:03.892647 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:03.892615 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" event={"ID":"7c85c379-4698-4655-95b4-00bf684c0be3","Type":"ContainerStarted","Data":"1ca59266cee91a15c9f0b8d2ea7b19b41a84f1b7a06f4dc49ceedb2d68903f5c"} Sep 10 17:44:03.913548 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:03.913496 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nm9xn" podStartSLOduration=9.007048155 podStartE2EDuration="35.913477005s" totalImagesPullingTime="26.90642885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:03.911273979 +0000 UTC m=+35.673907708" watchObservedRunningTime="2026-09-10 17:44:03.913477005 +0000 UTC m=+35.676110733" Sep 10 17:44:05.330293 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:05.330261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:05.330701 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:05.330413 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:05.330701 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:05.330476 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:44:09.330458749 +0000 UTC m=+41.093092456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:05.898409 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:05.898321 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2jhzs" event={"ID":"89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee","Type":"ContainerStarted","Data":"dabd5732b0b0973c41b1522e145deb40856d4209520ac9104f44dbeef7d81fe1"} Sep 10 17:44:05.913366 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:05.913304 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2jhzs" podStartSLOduration=2.290486572 podStartE2EDuration="4.913290704s" totalImagesPullingTime="2.622804132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:05.912514867 +0000 UTC m=+37.675148596" watchObservedRunningTime="2026-09-10 17:44:05.913290704 +0000 UTC m=+37.675924433" Sep 10 17:44:09.354272 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:09.354232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:09.354670 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:09.354394 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:09.354670 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:09.354460 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:44:17.354444558 +0000 UTC m=+49.117078265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:17.406123 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:17.406087 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:17.406544 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:17.406220 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:17.406544 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:17.406292 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:44:33.40627569 +0000 UTC m=+65.168909401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:26.875617 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:26.875588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zm6wj" Sep 10 17:44:33.415622 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:33.415569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:44:33.416081 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:33.415731 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:44:33.416081 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:33.415802 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:45:05.415786019 +0000 UTC m=+97.178419726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:44:34.321421 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.321369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:34.323779 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.323759 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 17:44:34.334225 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.334201 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 17:44:34.346244 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.346222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xg8\" (UniqueName: \"kubernetes.io/projected/3de3b104-48e6-4485-9c19-59936dcd9ade-kube-api-access-92xg8\") pod \"network-check-target-xcqgj\" (UID: \"3de3b104-48e6-4485-9c19-59936dcd9ade\") " pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:34.422510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.422456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:44:34.422510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.422528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:44:34.422917 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:34.422633 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:44:34.422917 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:44:34.422737 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:45:38.422714542 +0000 UTC m=+130.185348264 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : secret "metrics-daemon-secret" not found Sep 10 17:44:34.425332 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.425299 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 17:44:34.435648 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.435633 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42-original-pull-secret\") pod \"global-pull-secret-syncer-24jdb\" (UID: \"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42\") " pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:44:34.508290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.508249 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-24jdb" Sep 10 17:44:34.514237 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.514217 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fgh9m\"" Sep 10 17:44:34.522981 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.522959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:34.775884 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.775851 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-24jdb"] Sep 10 17:44:34.778920 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:44:34.778893 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e23ec36_d3bb_4df9_9f81_bd2b06ab0c42.slice/crio-96155464dcd02a675756aa59ed32048171245c631acef532fc485f71185221ee WatchSource:0}: Error finding container 96155464dcd02a675756aa59ed32048171245c631acef532fc485f71185221ee: Status 404 returned error can't find the container with id 96155464dcd02a675756aa59ed32048171245c631acef532fc485f71185221ee Sep 10 17:44:34.801361 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.801339 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xcqgj"] Sep 10 17:44:34.804030 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:44:34.804008 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de3b104_48e6_4485_9c19_59936dcd9ade.slice/crio-50d896e9b7b3b8880567e81a3778a50a61b2e4813f1501816383c62263e8f08d WatchSource:0}: Error finding container 50d896e9b7b3b8880567e81a3778a50a61b2e4813f1501816383c62263e8f08d: Status 404 returned error can't find the container with id 50d896e9b7b3b8880567e81a3778a50a61b2e4813f1501816383c62263e8f08d Sep 10 17:44:34.970789 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.970696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcqgj" event={"ID":"3de3b104-48e6-4485-9c19-59936dcd9ade","Type":"ContainerStarted","Data":"50d896e9b7b3b8880567e81a3778a50a61b2e4813f1501816383c62263e8f08d"} Sep 10 17:44:34.971781 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:34.971759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-24jdb" event={"ID":"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42","Type":"ContainerStarted","Data":"96155464dcd02a675756aa59ed32048171245c631acef532fc485f71185221ee"} Sep 10 17:44:39.987395 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:39.987358 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xcqgj" event={"ID":"3de3b104-48e6-4485-9c19-59936dcd9ade","Type":"ContainerStarted","Data":"2432bb0cb04b69f8c317856bab99533ac96ceb4f7c970e51496bd5dbe5abaf22"} Sep 10 17:44:39.987840 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:39.987491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:44:39.988888 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:39.988865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-24jdb" event={"ID":"4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42","Type":"ContainerStarted","Data":"6aa804f0b5739dcf15e41ab7bc649504b7f6f2325cfe6ea25beed84c8d0f3735"} Sep 10 17:44:40.003006 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:40.002956 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xcqgj" podStartSLOduration=67.746861694 podStartE2EDuration="1m12.002939602s" totalImagesPullingTime="4.256077908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:40.001972566 +0000 UTC m=+71.764606295" watchObservedRunningTime="2026-09-10 17:44:40.002939602 +0000 UTC m=+71.765573332" Sep 10 17:44:40.015460 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:40.015421 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-24jdb" podStartSLOduration=67.730603271 podStartE2EDuration="1m12.015404626s" totalImagesPullingTime="4.284801355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:40.01510279 +0000 UTC m=+71.777736518" watchObservedRunningTime="2026-09-10 17:44:40.015404626 +0000 UTC m=+71.778038355" Sep 10 17:44:42.675128 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.675095 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54"] Sep 10 17:44:42.676773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.676758 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.677986 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.677964 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl"] Sep 10 17:44:42.679126 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.679103 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 17:44:42.679219 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.679148 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 17:44:42.679219 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.679106 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 17:44:42.679219 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.679164 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 17:44:42.679569 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.679556 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.681723 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.681703 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 10 17:44:42.681723 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.681727 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 10 17:44:42.681889 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.681736 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 10 17:44:42.682077 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.682058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 10 17:44:42.688213 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.688192 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54"] Sep 10 17:44:42.706037 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.706016 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl"] Sep 10 17:44:42.781065 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmvdp\" (UniqueName: \"kubernetes.io/projected/18060e43-0d49-4f46-a6c0-659644a66d57-kube-api-access-hmvdp\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.781181 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781068 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4x2x\" (UniqueName: \"kubernetes.io/projected/26088d12-9535-404b-b637-ce53267a9f83-kube-api-access-z4x2x\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.781181 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-ca\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.781181 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.781366 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781184 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.781366 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/26088d12-9535-404b-b637-ce53267a9f83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.781366 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18060e43-0d49-4f46-a6c0-659644a66d57-tmp\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.781366 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-hub\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.781529 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.781376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/18060e43-0d49-4f46-a6c0-659644a66d57-klusterlet-config\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.882410 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18060e43-0d49-4f46-a6c0-659644a66d57-tmp\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.882494 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882417 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-hub\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.882494 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/18060e43-0d49-4f46-a6c0-659644a66d57-klusterlet-config\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.882657 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmvdp\" (UniqueName: \"kubernetes.io/projected/18060e43-0d49-4f46-a6c0-659644a66d57-kube-api-access-hmvdp\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.882710 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4x2x\" (UniqueName: \"kubernetes.io/projected/26088d12-9535-404b-b637-ce53267a9f83-kube-api-access-z4x2x\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.882710 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-ca\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.882796 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.882796 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.882889 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.882806 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/26088d12-9535-404b-b637-ce53267a9f83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.883302 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.883278 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18060e43-0d49-4f46-a6c0-659644a66d57-tmp\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.883594 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.883569 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/26088d12-9535-404b-b637-ce53267a9f83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.885273 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.885233 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/18060e43-0d49-4f46-a6c0-659644a66d57-klusterlet-config\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.885391 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.885270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-hub\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.885507 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.885485 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.885573 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.885512 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.885624 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.885576 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26088d12-9535-404b-b637-ce53267a9f83-ca\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.891227 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.891204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4x2x\" (UniqueName: \"kubernetes.io/projected/26088d12-9535-404b-b637-ce53267a9f83-kube-api-access-z4x2x\") pod \"cluster-proxy-proxy-agent-649b7f7dd8-j5fxl\" (UID: \"26088d12-9535-404b-b637-ce53267a9f83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:42.891500 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.891479 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmvdp\" (UniqueName: \"kubernetes.io/projected/18060e43-0d49-4f46-a6c0-659644a66d57-kube-api-access-hmvdp\") pod \"klusterlet-addon-workmgr-d4c59fb6c-mlp54\" (UID: \"18060e43-0d49-4f46-a6c0-659644a66d57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:42.989447 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:42.989392 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:43.005918 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:43.005895 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:44:43.254824 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:43.254799 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54"] Sep 10 17:44:43.257893 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:44:43.257865 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18060e43_0d49_4f46_a6c0_659644a66d57.slice/crio-757263e4e7e28c94381e5fb54d6e57e61c3990932e4981afe0476b6fc3cadee9 WatchSource:0}: Error finding container 757263e4e7e28c94381e5fb54d6e57e61c3990932e4981afe0476b6fc3cadee9: Status 404 returned error can't find the container with id 757263e4e7e28c94381e5fb54d6e57e61c3990932e4981afe0476b6fc3cadee9 Sep 10 17:44:43.281658 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:43.281638 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl"] Sep 10 17:44:43.285190 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:44:43.285167 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26088d12_9535_404b_b637_ce53267a9f83.slice/crio-ab7b04cc988c76b7ed804840cea3829d7a5149d395ae289440ec7dfac96b9927 WatchSource:0}: Error finding container ab7b04cc988c76b7ed804840cea3829d7a5149d395ae289440ec7dfac96b9927: Status 404 returned error can't find the container with id ab7b04cc988c76b7ed804840cea3829d7a5149d395ae289440ec7dfac96b9927 Sep 10 17:44:43.998015 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:43.997975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" event={"ID":"26088d12-9535-404b-b637-ce53267a9f83","Type":"ContainerStarted","Data":"ab7b04cc988c76b7ed804840cea3829d7a5149d395ae289440ec7dfac96b9927"} Sep 10 17:44:43.999024 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:43.998996 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" event={"ID":"18060e43-0d49-4f46-a6c0-659644a66d57","Type":"ContainerStarted","Data":"757263e4e7e28c94381e5fb54d6e57e61c3990932e4981afe0476b6fc3cadee9"} Sep 10 17:44:49.016750 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.016724 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" event={"ID":"18060e43-0d49-4f46-a6c0-659644a66d57","Type":"ContainerStarted","Data":"4c060a5c10a769b5cd76be246bae01ee9dc6d0361661aef9101818461c752854"} Sep 10 17:44:49.017128 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.016874 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:49.018490 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.018469 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:44:49.018957 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.018938 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" event={"ID":"26088d12-9535-404b-b637-ce53267a9f83","Type":"ContainerStarted","Data":"ca1ebc53304f006da513dff7f7bb04be0f9cf4ef1d9ff19f40470d14317c544e"} Sep 10 17:44:49.019028 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.018967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" event={"ID":"26088d12-9535-404b-b637-ce53267a9f83","Type":"ContainerStarted","Data":"5e9e9a426196fde24e166dc1a2a015dc120d95978f36cfe2aced0976c294c24a"} Sep 10 17:44:49.019028 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.018979 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" event={"ID":"26088d12-9535-404b-b637-ce53267a9f83","Type":"ContainerStarted","Data":"79fb6ff8b4c3120b6a1d50dac97af254ea7525d556cb6328cc355ceec975c4cc"} Sep 10 17:44:49.031355 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.031302 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" podStartSLOduration=1.573216749 podStartE2EDuration="7.031290902s" totalImagesPullingTime="5.458074153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:49.030615363 +0000 UTC m=+80.793249089" watchObservedRunningTime="2026-09-10 17:44:49.031290902 +0000 UTC m=+80.793924677" Sep 10 17:44:49.046357 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:44:49.046305 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" podStartSLOduration=1.615107681 podStartE2EDuration="7.046292359s" totalImagesPullingTime="5.431184678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:44:49.045671269 +0000 UTC m=+80.808305002" watchObservedRunningTime="2026-09-10 17:44:49.046292359 +0000 UTC m=+80.808926088" Sep 10 17:45:05.429573 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:45:05.429482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:45:05.429982 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:45:05.429600 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:45:05.429982 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:45:05.429652 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:46:09.429637908 +0000 UTC m=+161.192271615 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:45:10.993251 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:45:10.993215 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xcqgj" Sep 10 17:45:38.441234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:45:38.441195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:45:38.441658 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:45:38.441359 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:45:38.441658 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:45:38.441433 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:47:40.44141679 +0000 UTC m=+252.204050497 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : secret "metrics-daemon-secret" not found Sep 10 17:46:04.634875 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:46:04.634829 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rkbd7" podUID="e72f3c57-cd6d-4074-8578-b8bffdbfa84f" Sep 10 17:46:04.704484 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:46:04.704444 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:46:05.238943 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:05.238916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rkbd7" Sep 10 17:46:09.450555 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:09.450503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:46:09.450955 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:46:09.450633 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 17:46:09.450955 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:46:09.450689 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls podName:e72f3c57-cd6d-4074-8578-b8bffdbfa84f nodeName:}" failed. No retries permitted until 2026-09-10 17:48:11.45067532 +0000 UTC m=+283.213309027 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls") pod "dns-default-rkbd7" (UID: "e72f3c57-cd6d-4074-8578-b8bffdbfa84f") : secret "dns-default-metrics-tls" not found Sep 10 17:46:18.699216 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:18.699183 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:46:49.017419 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:49.017371 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" podUID="18060e43-0d49-4f46-a6c0-659644a66d57" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Sep 10 17:46:49.359023 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:49.358988 2556 generic.go:356] "Generic (PLEG): container finished" podID="18060e43-0d49-4f46-a6c0-659644a66d57" containerID="4c060a5c10a769b5cd76be246bae01ee9dc6d0361661aef9101818461c752854" exitCode=1 Sep 10 17:46:49.359199 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:49.359062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" event={"ID":"18060e43-0d49-4f46-a6c0-659644a66d57","Type":"ContainerDied","Data":"4c060a5c10a769b5cd76be246bae01ee9dc6d0361661aef9101818461c752854"} Sep 10 17:46:49.359547 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:49.359514 2556 scope.go:117] "RemoveContainer" containerID="4c060a5c10a769b5cd76be246bae01ee9dc6d0361661aef9101818461c752854" Sep 10 17:46:50.363843 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:50.363809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" event={"ID":"18060e43-0d49-4f46-a6c0-659644a66d57","Type":"ContainerStarted","Data":"ada5b156a1a99acd94b6b3cbc844aa127af74dc1a403e02cd0954de9feeb2c17"} Sep 10 17:46:50.364220 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:50.364108 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:46:50.364769 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:46:50.364751 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d4c59fb6c-mlp54" Sep 10 17:47:40.467707 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:40.467666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:47:40.468182 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:40.467808 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 17:47:40.468182 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:40.467866 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs podName:fc6972a6-3eda-4e40-85e0-38453961b03b nodeName:}" failed. No retries permitted until 2026-09-10 17:49:42.467849278 +0000 UTC m=+374.230482999 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs") pod "network-metrics-daemon-8pt67" (UID: "fc6972a6-3eda-4e40-85e0-38453961b03b") : secret "metrics-daemon-secret" not found Sep 10 17:47:51.731884 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.731803 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vlkmv"] Sep 10 17:47:51.733840 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.733820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.736126 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.736100 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 17:47:51.736258 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.736124 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 17:47:51.736258 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.736144 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 17:47:51.736258 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.736113 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 17:47:51.736894 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.736880 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqhnl\"" Sep 10 17:47:51.747511 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.747487 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlkmv"] Sep 10 17:47:51.845971 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.845927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-data-volume\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.845971 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.845964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.846189 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.845998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fbv6\" (UniqueName: \"kubernetes.io/projected/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-api-access-2fbv6\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.846189 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.846023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-crio-socket\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.846189 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.846047 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946699 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.946659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-data-volume\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946699 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.946699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.946736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fbv6\" (UniqueName: \"kubernetes.io/projected/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-api-access-2fbv6\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.946764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-crio-socket\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:51.946793 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:51.946866 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:51.946881 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:52.446861335 +0000 UTC m=+264.209495046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : configmap "kube-rbac-proxy" not found Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.946793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.946897 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-crio-socket\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.946969 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:51.946929 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:52.446900174 +0000 UTC m=+264.209533881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:51.947339 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.947018 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-data-volume\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:51.954162 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:51.954130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fbv6\" (UniqueName: \"kubernetes.io/projected/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-api-access-2fbv6\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:52.452193 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:52.452136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:52.452435 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:52.452218 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:52.452435 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:52.452265 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:52.452435 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:52.452381 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:53.452361802 +0000 UTC m=+265.214995525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : configmap "kube-rbac-proxy" not found Sep 10 17:47:52.452435 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:52.452402 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:52.452609 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:52.452471 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:53.452455409 +0000 UTC m=+265.215089131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:53.460665 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:53.460618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:53.461164 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:53.460675 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:53.461164 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:53.460752 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:53.461164 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:53.460831 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:55.460811443 +0000 UTC m=+267.223445151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : configmap "kube-rbac-proxy" not found Sep 10 17:47:53.461164 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:53.460766 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:53.461164 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:53.460876 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:55.460865932 +0000 UTC m=+267.223499653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:53.494831 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:53.494803 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-285vv_8ecd69d9-0430-480b-b42b-1df45691e6dd/dns-node-resolver/0.log" Sep 10 17:47:54.494947 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:54.494916 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2s2ss_2980f6c2-7fa3-45b6-8b07-171d49df27a8/node-ca/0.log" Sep 10 17:47:55.478428 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:55.478386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:55.478606 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:55.478451 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:55.478606 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:55.478517 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:55.478606 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:55.478548 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:55.478606 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:55.478583 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:59.478568041 +0000 UTC m=+271.241201754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : configmap "kube-rbac-proxy" not found Sep 10 17:47:55.478606 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:55.478604 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:47:59.478591383 +0000 UTC m=+271.241225090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : secret "insights-runtime-extractor-tls" not found Sep 10 17:47:55.495922 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:55.495891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2jhzs_89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee/serve-healthcheck-canary/0.log" Sep 10 17:47:59.507834 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:59.507779 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:59.508300 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:47:59.507870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:47:59.508300 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:59.507958 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 17:47:59.508300 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:59.507973 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:47:59.508300 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:59.508013 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:07.507998265 +0000 UTC m=+279.270631975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : configmap "kube-rbac-proxy" not found Sep 10 17:47:59.508300 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:47:59.508042 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:07.508024328 +0000 UTC m=+279.270658055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : secret "insights-runtime-extractor-tls" not found Sep 10 17:48:07.571465 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:07.571413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:48:07.571850 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:07.571512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:48:07.571850 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:48:07.571571 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 17:48:07.571850 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:48:07.571642 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls podName:ea0ad978-dc33-4bd3-800b-d3fdc34a85f0 nodeName:}" failed. No retries permitted until 2026-09-10 17:48:23.571623721 +0000 UTC m=+295.334257442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vlkmv" (UID: "ea0ad978-dc33-4bd3-800b-d3fdc34a85f0") : secret "insights-runtime-extractor-tls" not found Sep 10 17:48:07.572073 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:07.572053 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:48:08.240339 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:48:08.240285 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rkbd7" podUID="e72f3c57-cd6d-4074-8578-b8bffdbfa84f" Sep 10 17:48:08.581824 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:08.581792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rkbd7" Sep 10 17:48:11.499775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:11.499739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:48:11.501908 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:11.501886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e72f3c57-cd6d-4074-8578-b8bffdbfa84f-metrics-tls\") pod \"dns-default-rkbd7\" (UID: \"e72f3c57-cd6d-4074-8578-b8bffdbfa84f\") " pod="openshift-dns/dns-default-rkbd7" Sep 10 17:48:11.584569 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:11.584541 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f22bv\"" Sep 10 17:48:11.592942 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:11.592918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rkbd7" Sep 10 17:48:11.860008 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:11.859938 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rkbd7"] Sep 10 17:48:11.863133 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:48:11.863095 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode72f3c57_cd6d_4074_8578_b8bffdbfa84f.slice/crio-a80738ebca035a733abbf5d83799cc032286108fbd1059eb9b264dd24011ce5a WatchSource:0}: Error finding container a80738ebca035a733abbf5d83799cc032286108fbd1059eb9b264dd24011ce5a: Status 404 returned error can't find the container with id a80738ebca035a733abbf5d83799cc032286108fbd1059eb9b264dd24011ce5a Sep 10 17:48:12.594735 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:12.594698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rkbd7" event={"ID":"e72f3c57-cd6d-4074-8578-b8bffdbfa84f","Type":"ContainerStarted","Data":"a80738ebca035a733abbf5d83799cc032286108fbd1059eb9b264dd24011ce5a"} Sep 10 17:48:13.434270 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.434242 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-795d4d8598-d9x96"] Sep 10 17:48:13.436290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.436268 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.438940 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.438915 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 17:48:13.439044 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.438920 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 17:48:13.439107 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.439049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 17:48:13.439659 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.439640 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wsfqd\"" Sep 10 17:48:13.445648 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.445632 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 17:48:13.456038 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.456017 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795d4d8598-d9x96"] Sep 10 17:48:13.600492 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.600414 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rkbd7" event={"ID":"e72f3c57-cd6d-4074-8578-b8bffdbfa84f","Type":"ContainerStarted","Data":"bf2d42733f828abb123dd661bba1baeb4496ca249f941070386d29422966b76f"} Sep 10 17:48:13.600492 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.600467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rkbd7" event={"ID":"e72f3c57-cd6d-4074-8578-b8bffdbfa84f","Type":"ContainerStarted","Data":"56ebbdae82ab033982b2818b41e524b463d6e6ea4b0e5473e3063f90f63860b6"} Sep 10 17:48:13.600873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.600592 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rkbd7" Sep 10 17:48:13.614994 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.614974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-registry-tls\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615109 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcjm\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-kube-api-access-pxcjm\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615109 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615018 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bca68580-beed-4e2e-a5fc-aaca49b02c8e-ca-trust-extracted\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615109 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bca68580-beed-4e2e-a5fc-aaca49b02c8e-trusted-ca\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615206 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-bound-sa-token\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615206 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bca68580-beed-4e2e-a5fc-aaca49b02c8e-registry-certificates\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615206 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bca68580-beed-4e2e-a5fc-aaca49b02c8e-installation-pull-secrets\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.615292 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.615231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bca68580-beed-4e2e-a5fc-aaca49b02c8e-image-registry-private-configuration\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.621111 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.621060 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rkbd7" podStartSLOduration=251.225758922 podStartE2EDuration="4m12.621044152s" totalImagesPullingTime="1.39528523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:13.620781356 +0000 UTC m=+285.383415109" watchObservedRunningTime="2026-09-10 17:48:13.621044152 +0000 UTC m=+285.383677883" Sep 10 17:48:13.715937 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.715907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-bound-sa-token\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.715952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bca68580-beed-4e2e-a5fc-aaca49b02c8e-registry-certificates\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.715977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bca68580-beed-4e2e-a5fc-aaca49b02c8e-installation-pull-secrets\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bca68580-beed-4e2e-a5fc-aaca49b02c8e-image-registry-private-configuration\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716073 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-registry-tls\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcjm\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-kube-api-access-pxcjm\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716405 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bca68580-beed-4e2e-a5fc-aaca49b02c8e-ca-trust-extracted\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716405 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bca68580-beed-4e2e-a5fc-aaca49b02c8e-trusted-ca\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716883 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716856 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bca68580-beed-4e2e-a5fc-aaca49b02c8e-registry-certificates\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.716997 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.716923 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bca68580-beed-4e2e-a5fc-aaca49b02c8e-ca-trust-extracted\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.717578 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.717558 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bca68580-beed-4e2e-a5fc-aaca49b02c8e-trusted-ca\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.718598 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.718551 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bca68580-beed-4e2e-a5fc-aaca49b02c8e-image-registry-private-configuration\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.718684 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.718623 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-registry-tls\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.718725 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.718687 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bca68580-beed-4e2e-a5fc-aaca49b02c8e-installation-pull-secrets\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.723870 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.723852 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-bound-sa-token\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.724383 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.724366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcjm\" (UniqueName: \"kubernetes.io/projected/bca68580-beed-4e2e-a5fc-aaca49b02c8e-kube-api-access-pxcjm\") pod \"image-registry-795d4d8598-d9x96\" (UID: \"bca68580-beed-4e2e-a5fc-aaca49b02c8e\") " pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:13.746168 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:13.746146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:14.013677 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:14.013655 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-795d4d8598-d9x96"] Sep 10 17:48:14.015843 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:48:14.015820 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca68580_beed_4e2e_a5fc_aaca49b02c8e.slice/crio-3fee2e6aacfd4a844bbfa750fca8e169d086e636874fc6338cca431690d9c049 WatchSource:0}: Error finding container 3fee2e6aacfd4a844bbfa750fca8e169d086e636874fc6338cca431690d9c049: Status 404 returned error can't find the container with id 3fee2e6aacfd4a844bbfa750fca8e169d086e636874fc6338cca431690d9c049 Sep 10 17:48:14.608767 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:14.608724 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" event={"ID":"bca68580-beed-4e2e-a5fc-aaca49b02c8e","Type":"ContainerStarted","Data":"a233a87be9a17761aa2edf2d7d17a32cc9e432a968e5911b8f5abf4b3733d9da"} Sep 10 17:48:14.609197 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:14.608799 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" event={"ID":"bca68580-beed-4e2e-a5fc-aaca49b02c8e","Type":"ContainerStarted","Data":"3fee2e6aacfd4a844bbfa750fca8e169d086e636874fc6338cca431690d9c049"} Sep 10 17:48:14.609197 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:14.608897 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:14.628965 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:14.628914 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" podStartSLOduration=1.6289021369999999 podStartE2EDuration="1.628902137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:14.62811521 +0000 UTC m=+286.390748939" watchObservedRunningTime="2026-09-10 17:48:14.628902137 +0000 UTC m=+286.391535865" Sep 10 17:48:21.700160 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:48:21.700126 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8pt67" podUID="fc6972a6-3eda-4e40-85e0-38453961b03b" Sep 10 17:48:23.007060 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:23.007024 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" podUID="26088d12-9535-404b-b637-ce53267a9f83" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 17:48:23.584378 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:23.584339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:48:23.586594 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:23.586572 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ea0ad978-dc33-4bd3-800b-d3fdc34a85f0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vlkmv\" (UID: \"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0\") " pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:48:23.610638 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:23.610613 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rkbd7" Sep 10 17:48:23.842853 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:23.842774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vlkmv" Sep 10 17:48:24.112211 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:24.112138 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vlkmv"] Sep 10 17:48:24.115200 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:48:24.115178 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea0ad978_dc33_4bd3_800b_d3fdc34a85f0.slice/crio-a4b6486be56ae65468dc4c779fc42d54b6a26feaedf653acaea3839f2aec5efb WatchSource:0}: Error finding container a4b6486be56ae65468dc4c779fc42d54b6a26feaedf653acaea3839f2aec5efb: Status 404 returned error can't find the container with id a4b6486be56ae65468dc4c779fc42d54b6a26feaedf653acaea3839f2aec5efb Sep 10 17:48:24.641967 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:24.641929 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlkmv" event={"ID":"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0","Type":"ContainerStarted","Data":"30ddeaf1a00c78a187578e615cb640ee0b710ab14929035910d7d68b343960d9"} Sep 10 17:48:24.642132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:24.641983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlkmv" event={"ID":"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0","Type":"ContainerStarted","Data":"a4b6486be56ae65468dc4c779fc42d54b6a26feaedf653acaea3839f2aec5efb"} Sep 10 17:48:25.648084 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:25.648042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlkmv" event={"ID":"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0","Type":"ContainerStarted","Data":"2623acce4e93c63e8e015375aa8cf0eaacd8183e3659638daa372d1fc090710f"} Sep 10 17:48:26.652904 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:26.652832 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vlkmv" event={"ID":"ea0ad978-dc33-4bd3-800b-d3fdc34a85f0","Type":"ContainerStarted","Data":"3c0c0250c56d18d52ecc7b9b81c28714036d219a04f1c85bcae0120bc26d1b9a"} Sep 10 17:48:28.570679 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:28.570653 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:48:28.571104 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:28.570879 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:48:28.577838 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:28.577815 2556 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 17:48:29.992865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:29.992810 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vlkmv" podStartSLOduration=36.909805751 podStartE2EDuration="38.992793629s" totalImagesPullingTime="2.082987878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 17:47:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:26.671375128 +0000 UTC m=+298.434008856" watchObservedRunningTime="2026-09-10 17:48:29.992793629 +0000 UTC m=+301.755427352" Sep 10 17:48:29.995362 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:29.993299 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hhlbc"] Sep 10 17:48:29.997488 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:29.997461 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.000007 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:29.999984 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 17:48:30.000248 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.000229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 17:48:30.001027 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.001007 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bc95g\"" Sep 10 17:48:30.001143 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.001125 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 17:48:30.001213 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.001188 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 17:48:30.001271 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.001217 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 17:48:30.001438 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.001423 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 17:48:30.023551 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc4dc\" (UniqueName: \"kubernetes.io/projected/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-kube-api-access-xc4dc\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023703 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-textfile\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023703 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-root\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023703 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-wtmp\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023828 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-sys\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023828 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-tls\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023828 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023930 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-metrics-client-ca\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.023930 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.023860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-accelerators-collector-config\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125011 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.124982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125027 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-metrics-client-ca\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-accelerators-collector-config\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc4dc\" (UniqueName: \"kubernetes.io/projected/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-kube-api-access-xc4dc\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-textfile\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125150 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-root\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125208 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-root\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125536 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-wtmp\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125536 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-sys\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125536 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125295 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-tls\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125536 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125398 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-sys\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125536 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125398 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-wtmp\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125697 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125611 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-textfile\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.125812 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125787 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-accelerators-collector-config\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.126005 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.125985 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-metrics-client-ca\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.127353 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.127324 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.127466 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.127450 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-node-exporter-tls\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.134376 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.134359 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc4dc\" (UniqueName: \"kubernetes.io/projected/8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932-kube-api-access-xc4dc\") pod \"node-exporter-hhlbc\" (UID: \"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932\") " pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.306574 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.306502 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hhlbc" Sep 10 17:48:30.315735 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:48:30.315712 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f33aed3_5164_4cfe_b5cf_f2d0ce5b7932.slice/crio-96fce506b601c4babbd0d2120c0a58e326d6498016c6387f0613f5ea6d1f8a0e WatchSource:0}: Error finding container 96fce506b601c4babbd0d2120c0a58e326d6498016c6387f0613f5ea6d1f8a0e: Status 404 returned error can't find the container with id 96fce506b601c4babbd0d2120c0a58e326d6498016c6387f0613f5ea6d1f8a0e Sep 10 17:48:30.317525 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.317508 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:48:30.667824 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:30.667745 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhlbc" event={"ID":"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932","Type":"ContainerStarted","Data":"96fce506b601c4babbd0d2120c0a58e326d6498016c6387f0613f5ea6d1f8a0e"} Sep 10 17:48:31.672628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:31.672596 2556 generic.go:356] "Generic (PLEG): container finished" podID="8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932" containerID="958ffc8b64957e39969ce83107a21606abdcd3f7f35d6dbec7c7d906bf082662" exitCode=0 Sep 10 17:48:31.673030 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:31.672640 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhlbc" event={"ID":"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932","Type":"ContainerDied","Data":"958ffc8b64957e39969ce83107a21606abdcd3f7f35d6dbec7c7d906bf082662"} Sep 10 17:48:32.678990 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:32.678952 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhlbc" event={"ID":"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932","Type":"ContainerStarted","Data":"5a737b0eda501d8d757d76fb1e0996dd8902c010ef03d2612de55ccee86f6a2c"} Sep 10 17:48:32.679433 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:32.679010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hhlbc" event={"ID":"8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932","Type":"ContainerStarted","Data":"cce3c037b360a745ce5513608162412d0d946d39badf197785ae9e6f12d8bfd9"} Sep 10 17:48:32.702787 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:32.702739 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hhlbc" podStartSLOduration=2.535440399 podStartE2EDuration="3.702724388s" totalImagesPullingTime="1.108185959s" totalInitContainerRuntime="59.09803ms" isStatefulPod=true podCreationTimestamp="2026-09-10 17:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:32.701143354 +0000 UTC m=+304.463777085" watchObservedRunningTime="2026-09-10 17:48:32.702724388 +0000 UTC m=+304.465358135" Sep 10 17:48:33.007131 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:33.007093 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" podUID="26088d12-9535-404b-b637-ce53267a9f83" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 17:48:33.697341 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:33.697286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:48:34.293399 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.293368 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-694dd7b5c7-rrd4r"] Sep 10 17:48:34.296363 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.296349 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.298968 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.298945 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 10 17:48:34.299699 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.299677 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-beo6vg0vh2t79\"" Sep 10 17:48:34.299779 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.299735 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g278j\"" Sep 10 17:48:34.299825 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.299773 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 10 17:48:34.299825 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.299775 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 10 17:48:34.299956 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.299776 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 10 17:48:34.308865 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.308845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-694dd7b5c7-rrd4r"] Sep 10 17:48:34.354723 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-secret-metrics-server-client-certs\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.354723 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-secret-metrics-server-tls\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.354910 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc10fbce-3f8b-48cd-825e-5d821c3d03da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.354910 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5kjq\" (UniqueName: \"kubernetes.io/projected/cc10fbce-3f8b-48cd-825e-5d821c3d03da-kube-api-access-n5kjq\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.354910 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc10fbce-3f8b-48cd-825e-5d821c3d03da-audit-log\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.354910 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc10fbce-3f8b-48cd-825e-5d821c3d03da-metrics-server-audit-profiles\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.355037 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.354928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-client-ca-bundle\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455566 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455527 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc10fbce-3f8b-48cd-825e-5d821c3d03da-metrics-server-audit-profiles\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455566 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-client-ca-bundle\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-secret-metrics-server-client-certs\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-secret-metrics-server-tls\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc10fbce-3f8b-48cd-825e-5d821c3d03da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5kjq\" (UniqueName: \"kubernetes.io/projected/cc10fbce-3f8b-48cd-825e-5d821c3d03da-kube-api-access-n5kjq\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.455773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.455716 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc10fbce-3f8b-48cd-825e-5d821c3d03da-audit-log\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.456087 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.456063 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc10fbce-3f8b-48cd-825e-5d821c3d03da-audit-log\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.456386 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.456360 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc10fbce-3f8b-48cd-825e-5d821c3d03da-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.456595 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.456575 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc10fbce-3f8b-48cd-825e-5d821c3d03da-metrics-server-audit-profiles\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.458185 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.458157 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-secret-metrics-server-tls\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.458395 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.458378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-client-ca-bundle\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.458517 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.458502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc10fbce-3f8b-48cd-825e-5d821c3d03da-secret-metrics-server-client-certs\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.467501 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.467480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5kjq\" (UniqueName: \"kubernetes.io/projected/cc10fbce-3f8b-48cd-825e-5d821c3d03da-kube-api-access-n5kjq\") pod \"metrics-server-694dd7b5c7-rrd4r\" (UID: \"cc10fbce-3f8b-48cd-825e-5d821c3d03da\") " pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.604753 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.604670 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:34.879441 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:34.879320 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-694dd7b5c7-rrd4r"] Sep 10 17:48:34.882856 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:48:34.882829 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc10fbce_3f8b_48cd_825e_5d821c3d03da.slice/crio-40ba358b4142e7686dca8b9bf9e647aa437222e22e6470180ac0c6074255a09a WatchSource:0}: Error finding container 40ba358b4142e7686dca8b9bf9e647aa437222e22e6470180ac0c6074255a09a: Status 404 returned error can't find the container with id 40ba358b4142e7686dca8b9bf9e647aa437222e22e6470180ac0c6074255a09a Sep 10 17:48:35.618440 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:35.618409 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-795d4d8598-d9x96" Sep 10 17:48:35.690788 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:35.690757 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" event={"ID":"cc10fbce-3f8b-48cd-825e-5d821c3d03da","Type":"ContainerStarted","Data":"40ba358b4142e7686dca8b9bf9e647aa437222e22e6470180ac0c6074255a09a"} Sep 10 17:48:36.695474 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:36.695389 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" event={"ID":"cc10fbce-3f8b-48cd-825e-5d821c3d03da","Type":"ContainerStarted","Data":"8af150b1c01cdd94696dbcb35ca894bb3a4abea7c743d2ad87f2cec5beaafddc"} Sep 10 17:48:36.712649 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:36.712599 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" podStartSLOduration=1.291433927 podStartE2EDuration="2.712584068s" totalImagesPullingTime="1.421150141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:36.711295958 +0000 UTC m=+308.473929687" watchObservedRunningTime="2026-09-10 17:48:36.712584068 +0000 UTC m=+308.475217797" Sep 10 17:48:43.007820 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.007783 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" podUID="26088d12-9535-404b-b637-ce53267a9f83" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 10 17:48:43.008281 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.007848 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" Sep 10 17:48:43.008343 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.008288 2556 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"ca1ebc53304f006da513dff7f7bb04be0f9cf4ef1d9ff19f40470d14317c544e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 10 17:48:43.008384 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.008358 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" podUID="26088d12-9535-404b-b637-ce53267a9f83" containerName="service-proxy" containerID="cri-o://ca1ebc53304f006da513dff7f7bb04be0f9cf4ef1d9ff19f40470d14317c544e" gracePeriod=30 Sep 10 17:48:43.723014 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.722974 2556 generic.go:356] "Generic (PLEG): container finished" podID="26088d12-9535-404b-b637-ce53267a9f83" containerID="ca1ebc53304f006da513dff7f7bb04be0f9cf4ef1d9ff19f40470d14317c544e" exitCode=2 Sep 10 17:48:43.723220 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.723016 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" event={"ID":"26088d12-9535-404b-b637-ce53267a9f83","Type":"ContainerDied","Data":"ca1ebc53304f006da513dff7f7bb04be0f9cf4ef1d9ff19f40470d14317c544e"} Sep 10 17:48:43.723220 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:43.723076 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-649b7f7dd8-j5fxl" event={"ID":"26088d12-9535-404b-b637-ce53267a9f83","Type":"ContainerStarted","Data":"46b7fe2178a948c61685f7cf917c05c8a1c1003bdd54c3a327bdffe972cdfb5b"} Sep 10 17:48:44.695186 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.695148 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-844d74b4dc-x9rh4"] Sep 10 17:48:44.698729 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.698708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.701006 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.700986 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 17:48:44.701112 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701040 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 17:48:44.701189 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701121 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 17:48:44.701791 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701767 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-62lmz\"" Sep 10 17:48:44.701907 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701812 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 17:48:44.701987 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701941 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 17:48:44.701987 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 17:48:44.701987 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.701971 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 17:48:44.710546 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.710524 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844d74b4dc-x9rh4"] Sep 10 17:48:44.738641 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.738615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjx6x\" (UniqueName: \"kubernetes.io/projected/b0f30831-25e9-4394-996d-1959c9d33d61-kube-api-access-sjx6x\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.738808 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.738661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-oauth-config\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.738808 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.738743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-console-config\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.738808 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.738783 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-serving-cert\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.738913 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.738817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-service-ca\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.738913 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.738835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-oauth-serving-cert\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840032 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.839976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-serving-cert\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840228 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-service-ca\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840228 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-oauth-serving-cert\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840228 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjx6x\" (UniqueName: \"kubernetes.io/projected/b0f30831-25e9-4394-996d-1959c9d33d61-kube-api-access-sjx6x\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840228 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840215 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-oauth-config\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840476 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-console-config\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840813 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840794 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-oauth-serving-cert\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840902 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-service-ca\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.840902 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.840859 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-console-config\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.842576 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.842558 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-serving-cert\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.842659 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.842562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-oauth-config\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:44.848456 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:44.848436 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjx6x\" (UniqueName: \"kubernetes.io/projected/b0f30831-25e9-4394-996d-1959c9d33d61-kube-api-access-sjx6x\") pod \"console-844d74b4dc-x9rh4\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:45.007522 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:45.007493 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:45.277141 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:45.277070 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-844d74b4dc-x9rh4"] Sep 10 17:48:45.279858 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:48:45.279833 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f30831_25e9_4394_996d_1959c9d33d61.slice/crio-5d089f5a403d2f466ef4a57b1c08a08a0a4348a2c77122c63f60b335af243714 WatchSource:0}: Error finding container 5d089f5a403d2f466ef4a57b1c08a08a0a4348a2c77122c63f60b335af243714: Status 404 returned error can't find the container with id 5d089f5a403d2f466ef4a57b1c08a08a0a4348a2c77122c63f60b335af243714 Sep 10 17:48:45.730241 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:45.730156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d74b4dc-x9rh4" event={"ID":"b0f30831-25e9-4394-996d-1959c9d33d61","Type":"ContainerStarted","Data":"5d089f5a403d2f466ef4a57b1c08a08a0a4348a2c77122c63f60b335af243714"} Sep 10 17:48:48.742814 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:48.742773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d74b4dc-x9rh4" event={"ID":"b0f30831-25e9-4394-996d-1959c9d33d61","Type":"ContainerStarted","Data":"a200c277fc4f30f4ba5fc9226c9eb4cad021de6e8ed5302978da968c816efc9e"} Sep 10 17:48:48.763366 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:48.763292 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-844d74b4dc-x9rh4" podStartSLOduration=1.812790822 podStartE2EDuration="4.763272397s" totalImagesPullingTime="2.950481575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:48:48.762883961 +0000 UTC m=+320.525517690" watchObservedRunningTime="2026-09-10 17:48:48.763272397 +0000 UTC m=+320.525906126" Sep 10 17:48:54.605731 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:54.605680 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:54.606132 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:54.605794 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:48:55.008096 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:55.008059 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:55.008264 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:55.008127 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:55.012877 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:55.012845 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:48:55.769280 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:48:55.769251 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:49:04.357688 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:04.357657 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-694dd7b5c7-rrd4r_cc10fbce-3f8b-48cd-825e-5d821c3d03da/metrics-server/0.log" Sep 10 17:49:04.752856 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:04.752815 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844d74b4dc-x9rh4"] Sep 10 17:49:05.357692 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:05.357661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhlbc_8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932/init-textfile/0.log" Sep 10 17:49:05.558618 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:05.558594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhlbc_8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932/node-exporter/0.log" Sep 10 17:49:05.757731 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:05.757705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhlbc_8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932/kube-rbac-proxy/0.log" Sep 10 17:49:11.557589 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:11.557560 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-844d74b4dc-x9rh4_b0f30831-25e9-4394-996d-1959c9d33d61/console/0.log" Sep 10 17:49:14.610950 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:14.610919 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:49:14.615522 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:14.615493 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-694dd7b5c7-rrd4r" Sep 10 17:49:29.772396 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:29.772290 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-844d74b4dc-x9rh4" podUID="b0f30831-25e9-4394-996d-1959c9d33d61" containerName="console" containerID="cri-o://a200c277fc4f30f4ba5fc9226c9eb4cad021de6e8ed5302978da968c816efc9e" gracePeriod=15 Sep 10 17:49:29.890703 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:29.890674 2556 generic.go:356] "Generic (PLEG): container finished" podID="b0f30831-25e9-4394-996d-1959c9d33d61" containerID="a200c277fc4f30f4ba5fc9226c9eb4cad021de6e8ed5302978da968c816efc9e" exitCode=0 Sep 10 17:49:29.890816 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:29.890719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d74b4dc-x9rh4" event={"ID":"b0f30831-25e9-4394-996d-1959c9d33d61","Type":"ContainerDied","Data":"a200c277fc4f30f4ba5fc9226c9eb4cad021de6e8ed5302978da968c816efc9e"} Sep 10 17:49:30.002386 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.002362 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:49:30.094430 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094349 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-oauth-serving-cert\") pod \"b0f30831-25e9-4394-996d-1959c9d33d61\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " Sep 10 17:49:30.094430 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094384 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-serving-cert\") pod \"b0f30831-25e9-4394-996d-1959c9d33d61\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " Sep 10 17:49:30.094430 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094408 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-oauth-config\") pod \"b0f30831-25e9-4394-996d-1959c9d33d61\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " Sep 10 17:49:30.094678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094437 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-service-ca\") pod \"b0f30831-25e9-4394-996d-1959c9d33d61\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " Sep 10 17:49:30.094678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094475 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjx6x\" (UniqueName: \"kubernetes.io/projected/b0f30831-25e9-4394-996d-1959c9d33d61-kube-api-access-sjx6x\") pod \"b0f30831-25e9-4394-996d-1959c9d33d61\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " Sep 10 17:49:30.094678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094506 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-console-config\") pod \"b0f30831-25e9-4394-996d-1959c9d33d61\" (UID: \"b0f30831-25e9-4394-996d-1959c9d33d61\") " Sep 10 17:49:30.094858 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094829 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0f30831-25e9-4394-996d-1959c9d33d61" (UID: "b0f30831-25e9-4394-996d-1959c9d33d61"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:30.094919 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094832 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0f30831-25e9-4394-996d-1959c9d33d61" (UID: "b0f30831-25e9-4394-996d-1959c9d33d61"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:30.094967 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.094913 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-console-config" (OuterVolumeSpecName: "console-config") pod "b0f30831-25e9-4394-996d-1959c9d33d61" (UID: "b0f30831-25e9-4394-996d-1959c9d33d61"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:49:30.096689 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.096663 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0f30831-25e9-4394-996d-1959c9d33d61" (UID: "b0f30831-25e9-4394-996d-1959c9d33d61"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:30.096800 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.096784 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0f30831-25e9-4394-996d-1959c9d33d61" (UID: "b0f30831-25e9-4394-996d-1959c9d33d61"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:49:30.096845 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.096805 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0f30831-25e9-4394-996d-1959c9d33d61-kube-api-access-sjx6x" (OuterVolumeSpecName: "kube-api-access-sjx6x") pod "b0f30831-25e9-4394-996d-1959c9d33d61" (UID: "b0f30831-25e9-4394-996d-1959c9d33d61"). InnerVolumeSpecName "kube-api-access-sjx6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:49:30.195843 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.195815 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-oauth-config\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:49:30.195843 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.195839 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-service-ca\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:49:30.195997 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.195849 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjx6x\" (UniqueName: \"kubernetes.io/projected/b0f30831-25e9-4394-996d-1959c9d33d61-kube-api-access-sjx6x\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:49:30.195997 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.195858 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-console-config\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:49:30.195997 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.195868 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0f30831-25e9-4394-996d-1959c9d33d61-oauth-serving-cert\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:49:30.195997 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.195876 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0f30831-25e9-4394-996d-1959c9d33d61-console-serving-cert\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:49:30.895251 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.895220 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-844d74b4dc-x9rh4" event={"ID":"b0f30831-25e9-4394-996d-1959c9d33d61","Type":"ContainerDied","Data":"5d089f5a403d2f466ef4a57b1c08a08a0a4348a2c77122c63f60b335af243714"} Sep 10 17:49:30.895665 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.895234 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-844d74b4dc-x9rh4" Sep 10 17:49:30.895665 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.895270 2556 scope.go:117] "RemoveContainer" containerID="a200c277fc4f30f4ba5fc9226c9eb4cad021de6e8ed5302978da968c816efc9e" Sep 10 17:49:30.911078 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.911054 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-844d74b4dc-x9rh4"] Sep 10 17:49:30.914344 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:30.914326 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-844d74b4dc-x9rh4"] Sep 10 17:49:32.703212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:32.703180 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0f30831-25e9-4394-996d-1959c9d33d61" path="/var/lib/kubelet/pods/b0f30831-25e9-4394-996d-1959c9d33d61/volumes" Sep 10 17:49:42.471007 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:42.470968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:49:42.473250 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:42.473218 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fc6972a6-3eda-4e40-85e0-38453961b03b-metrics-certs\") pod \"network-metrics-daemon-8pt67\" (UID: \"fc6972a6-3eda-4e40-85e0-38453961b03b\") " pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:49:42.700782 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:42.700755 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kjkcx\"" Sep 10 17:49:42.708598 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:42.708578 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8pt67" Sep 10 17:49:42.978682 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:49:42.978647 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6972a6_3eda_4e40_85e0_38453961b03b.slice/crio-4af235c3bb90ffd72b8b421e60437889bde05605108da152934328307c573529 WatchSource:0}: Error finding container 4af235c3bb90ffd72b8b421e60437889bde05605108da152934328307c573529: Status 404 returned error can't find the container with id 4af235c3bb90ffd72b8b421e60437889bde05605108da152934328307c573529 Sep 10 17:49:42.979759 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:42.979736 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8pt67"] Sep 10 17:49:43.940242 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:43.940206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pt67" event={"ID":"fc6972a6-3eda-4e40-85e0-38453961b03b","Type":"ContainerStarted","Data":"4af235c3bb90ffd72b8b421e60437889bde05605108da152934328307c573529"} Sep 10 17:49:44.945622 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:44.945586 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pt67" event={"ID":"fc6972a6-3eda-4e40-85e0-38453961b03b","Type":"ContainerStarted","Data":"98e281823ec8f401e0cdf938e0f5429cc0a4e0d6ca76764221d7ae0271678b5e"} Sep 10 17:49:44.946070 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:44.945635 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8pt67" event={"ID":"fc6972a6-3eda-4e40-85e0-38453961b03b","Type":"ContainerStarted","Data":"988aa457fdfee29fa1db508d9f6b650af84b7db92b6e22b3d6a019d1618c8426"} Sep 10 17:49:44.964916 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:49:44.964876 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8pt67" podStartSLOduration=375.769557508 podStartE2EDuration="6m16.964862895s" totalImagesPullingTime="1.195305387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:49:44.96421246 +0000 UTC m=+376.726846189" watchObservedRunningTime="2026-09-10 17:49:44.964862895 +0000 UTC m=+376.727496623" Sep 10 17:51:46.890154 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.890115 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns"] Sep 10 17:51:46.890641 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.890342 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0f30831-25e9-4394-996d-1959c9d33d61" containerName="console" Sep 10 17:51:46.890641 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.890354 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0f30831-25e9-4394-996d-1959c9d33d61" containerName="console" Sep 10 17:51:46.890641 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.890406 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0f30831-25e9-4394-996d-1959c9d33d61" containerName="console" Sep 10 17:51:46.893207 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.893191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:46.896031 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.896002 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 17:51:46.896243 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.896227 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 17:51:46.896327 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.896251 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 17:51:46.896401 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.896381 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 17:51:46.896539 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.896524 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-65whl\"" Sep 10 17:51:46.912299 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.912266 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns"] Sep 10 17:51:46.914849 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.914817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:46.914980 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.914862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:46.914980 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.914888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c48xs\" (UniqueName: \"kubernetes.io/projected/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-kube-api-access-c48xs\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:46.914980 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.914913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-tmp\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:46.914980 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:46.914953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-manifests\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.016292 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.016247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-manifests\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.016520 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.016355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.016520 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.016375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.016520 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.016390 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c48xs\" (UniqueName: \"kubernetes.io/projected/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-kube-api-access-c48xs\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.016520 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.016412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-tmp\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.016761 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.016740 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-manifests\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.018726 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.018695 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-tmp\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.018892 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.018770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.018948 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.018937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.036283 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.036246 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c48xs\" (UniqueName: \"kubernetes.io/projected/c9ba18d1-e301-4011-9c4c-9dba77aafbbe-kube-api-access-c48xs\") pod \"opendatahub-operator-controller-manager-86cbcccc5-qlzns\" (UID: \"c9ba18d1-e301-4011-9c4c-9dba77aafbbe\") " pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.203675 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.203588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:47.486829 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:47.486743 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns"] Sep 10 17:51:47.490024 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:51:47.489998 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ba18d1_e301_4011_9c4c_9dba77aafbbe.slice/crio-343486cd9d9dcc81cbaf8d216f1ff8d1f820ddf388a84108dc2ca568ca925b37 WatchSource:0}: Error finding container 343486cd9d9dcc81cbaf8d216f1ff8d1f820ddf388a84108dc2ca568ca925b37: Status 404 returned error can't find the container with id 343486cd9d9dcc81cbaf8d216f1ff8d1f820ddf388a84108dc2ca568ca925b37 Sep 10 17:51:48.348592 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:48.348551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" event={"ID":"c9ba18d1-e301-4011-9c4c-9dba77aafbbe","Type":"ContainerStarted","Data":"343486cd9d9dcc81cbaf8d216f1ff8d1f820ddf388a84108dc2ca568ca925b37"} Sep 10 17:51:51.363019 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:51.362974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" event={"ID":"c9ba18d1-e301-4011-9c4c-9dba77aafbbe","Type":"ContainerStarted","Data":"13971e325fafec069d4f4c7abb27820c5497a7876fb3bff69173730d6bebe645"} Sep 10 17:51:52.368333 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:52.368275 2556 generic.go:356] "Generic (PLEG): container finished" podID="c9ba18d1-e301-4011-9c4c-9dba77aafbbe" containerID="13971e325fafec069d4f4c7abb27820c5497a7876fb3bff69173730d6bebe645" exitCode=0 Sep 10 17:51:52.368712 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:52.368348 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" event={"ID":"c9ba18d1-e301-4011-9c4c-9dba77aafbbe","Type":"ContainerDied","Data":"13971e325fafec069d4f4c7abb27820c5497a7876fb3bff69173730d6bebe645"} Sep 10 17:51:53.373435 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:53.373402 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" event={"ID":"c9ba18d1-e301-4011-9c4c-9dba77aafbbe","Type":"ContainerStarted","Data":"b13eaece50a70cc0f2f853b189b66d413b0bb90937681c4dad323ee37bd7209a"} Sep 10 17:51:53.373926 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:53.373546 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:51:53.394399 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:51:53.394347 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" podStartSLOduration=3.046347915 podStartE2EDuration="7.3943292s" totalImagesPullingTime="3.277699158s" totalInitContainerRuntime="1.070282127s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:51:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:51:53.392493934 +0000 UTC m=+505.155127664" watchObservedRunningTime="2026-09-10 17:51:53.3943292 +0000 UTC m=+505.156962925" Sep 10 17:52:04.378557 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:04.378528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86cbcccc5-qlzns" Sep 10 17:52:06.394626 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.394591 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d767bb89-54d2s"] Sep 10 17:52:06.404082 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.404062 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.406695 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.406673 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 17:52:06.406842 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.406825 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 17:52:06.406952 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.406933 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 17:52:06.407016 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.406936 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 17:52:06.419197 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.419163 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d767bb89-54d2s"] Sep 10 17:52:06.455649 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.455618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca543ea-75ec-4958-9642-c9b86b82d2ae-tmp\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.455825 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.455663 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca543ea-75ec-4958-9642-c9b86b82d2ae-tls-certs\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.455825 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.455698 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89xbv\" (UniqueName: \"kubernetes.io/projected/2ca543ea-75ec-4958-9642-c9b86b82d2ae-kube-api-access-89xbv\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.556788 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.556754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca543ea-75ec-4958-9642-c9b86b82d2ae-tls-certs\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.556975 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.556811 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89xbv\" (UniqueName: \"kubernetes.io/projected/2ca543ea-75ec-4958-9642-c9b86b82d2ae-kube-api-access-89xbv\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.556975 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.556866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca543ea-75ec-4958-9642-c9b86b82d2ae-tmp\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.558993 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.558971 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ca543ea-75ec-4958-9642-c9b86b82d2ae-tmp\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.559756 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.559729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ca543ea-75ec-4958-9642-c9b86b82d2ae-tls-certs\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.570748 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.570723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89xbv\" (UniqueName: \"kubernetes.io/projected/2ca543ea-75ec-4958-9642-c9b86b82d2ae-kube-api-access-89xbv\") pod \"kube-auth-proxy-6d767bb89-54d2s\" (UID: \"2ca543ea-75ec-4958-9642-c9b86b82d2ae\") " pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.713441 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.713363 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" Sep 10 17:52:06.982120 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:06.981954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d767bb89-54d2s"] Sep 10 17:52:06.984717 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:52:06.984691 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca543ea_75ec_4958_9642_c9b86b82d2ae.slice/crio-73b496fa49d9dd78533af778e56194cd810fedb22d5cced613fed77cc5fc48a0 WatchSource:0}: Error finding container 73b496fa49d9dd78533af778e56194cd810fedb22d5cced613fed77cc5fc48a0: Status 404 returned error can't find the container with id 73b496fa49d9dd78533af778e56194cd810fedb22d5cced613fed77cc5fc48a0 Sep 10 17:52:07.426196 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.426155 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" event={"ID":"2ca543ea-75ec-4958-9642-c9b86b82d2ae","Type":"ContainerStarted","Data":"73b496fa49d9dd78533af778e56194cd810fedb22d5cced613fed77cc5fc48a0"} Sep 10 17:52:07.814771 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.814027 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2"] Sep 10 17:52:07.816282 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.816247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.819302 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.819107 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 17:52:07.819302 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.819144 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wm55z\"" Sep 10 17:52:07.819524 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.819438 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 17:52:07.819524 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.819459 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 17:52:07.819689 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.819459 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 17:52:07.830704 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.830672 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2"] Sep 10 17:52:07.867659 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.867821 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867738 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.867821 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmlhj\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-kube-api-access-qmlhj\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.867930 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edce50ae-940e-42cb-96cc-83be705fe792-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.867930 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.867930 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.867930 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.867921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.968888 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.968846 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edce50ae-940e-42cb-96cc-83be705fe792-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969065 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.968901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969065 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.968930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969065 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.968958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969065 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.969010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969276 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.969096 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969276 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.969133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmlhj\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-kube-api-access-qmlhj\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.969645 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.969600 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.971890 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.971865 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edce50ae-940e-42cb-96cc-83be705fe792-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.972007 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.971874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.972071 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.972013 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.972134 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.972118 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.984540 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.984518 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:07.985031 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:07.985010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmlhj\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-kube-api-access-qmlhj\") pod \"istiod-openshift-gateway-7b7995d5cd-jgvh2\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:08.128556 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:08.128466 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:08.410376 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:08.410238 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2"] Sep 10 17:52:09.498104 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:52:09.498071 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedce50ae_940e_42cb_96cc_83be705fe792.slice/crio-505d00c09a8f7d716c97c936a4a3c9b45214e2c3bc9ecfe2a61de2b9ada53183 WatchSource:0}: Error finding container 505d00c09a8f7d716c97c936a4a3c9b45214e2c3bc9ecfe2a61de2b9ada53183: Status 404 returned error can't find the container with id 505d00c09a8f7d716c97c936a4a3c9b45214e2c3bc9ecfe2a61de2b9ada53183 Sep 10 17:52:10.439494 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:10.439455 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" event={"ID":"edce50ae-940e-42cb-96cc-83be705fe792","Type":"ContainerStarted","Data":"505d00c09a8f7d716c97c936a4a3c9b45214e2c3bc9ecfe2a61de2b9ada53183"} Sep 10 17:52:10.440874 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:10.440847 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" event={"ID":"2ca543ea-75ec-4958-9642-c9b86b82d2ae","Type":"ContainerStarted","Data":"511fcae41d125584d704c9804225fd71ee4ad45290bd46a3f40f5dd0657d96dc"} Sep 10 17:52:10.456478 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:10.456437 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d767bb89-54d2s" podStartSLOduration=1.9111277530000002 podStartE2EDuration="4.456423195s" totalImagesPullingTime="2.545295442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:10.455016414 +0000 UTC m=+522.217650147" watchObservedRunningTime="2026-09-10 17:52:10.456423195 +0000 UTC m=+522.219056923" Sep 10 17:52:12.099961 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:12.099921 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:12.100229 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:12.099994 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:12.449462 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:12.449371 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" event={"ID":"edce50ae-940e-42cb-96cc-83be705fe792","Type":"ContainerStarted","Data":"bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891"} Sep 10 17:52:12.449591 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:12.449531 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:12.468792 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:12.468744 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" podStartSLOduration=2.869172771 podStartE2EDuration="5.468731942s" totalImagesPullingTime="2.599559171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:12.467110795 +0000 UTC m=+524.229744524" watchObservedRunningTime="2026-09-10 17:52:12.468731942 +0000 UTC m=+524.231365670" Sep 10 17:52:13.154196 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.154166 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b"] Sep 10 17:52:13.156257 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.156225 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.158630 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.158611 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kd5gk\"" Sep 10 17:52:13.169580 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.169560 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b"] Sep 10 17:52:13.214143 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214261 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214261 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214261 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214192 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47de2584-fc5d-4675-9e65-81a40904490c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214385 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214385 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214385 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47de2584-fc5d-4675-9e65-81a40904490c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214470 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214389 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47de2584-fc5d-4675-9e65-81a40904490c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.214470 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.214404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfqhb\" (UniqueName: \"kubernetes.io/projected/47de2584-fc5d-4675-9e65-81a40904490c-kube-api-access-cfqhb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315423 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315553 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315436 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315553 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315553 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47de2584-fc5d-4675-9e65-81a40904490c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315553 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315514 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315553 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315760 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47de2584-fc5d-4675-9e65-81a40904490c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315760 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47de2584-fc5d-4675-9e65-81a40904490c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315760 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfqhb\" (UniqueName: \"kubernetes.io/projected/47de2584-fc5d-4675-9e65-81a40904490c-kube-api-access-cfqhb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315901 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.315901 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.315885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.316127 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.316089 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.316222 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.316201 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.316302 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.316281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47de2584-fc5d-4675-9e65-81a40904490c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.317825 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.317799 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47de2584-fc5d-4675-9e65-81a40904490c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.318139 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.318117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47de2584-fc5d-4675-9e65-81a40904490c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.323015 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.322995 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47de2584-fc5d-4675-9e65-81a40904490c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.323210 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.323194 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfqhb\" (UniqueName: \"kubernetes.io/projected/47de2584-fc5d-4675-9e65-81a40904490c-kube-api-access-cfqhb\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b\" (UID: \"47de2584-fc5d-4675-9e65-81a40904490c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.454944 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.454868 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:13.465799 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.465779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:13.740369 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:13.740284 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b"] Sep 10 17:52:13.743113 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:52:13.743089 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47de2584_fc5d_4675_9e65_81a40904490c.slice/crio-b01610a03222bfa3524ce59a4680e78a5fceca694c827ccfdc3485573bd778d8 WatchSource:0}: Error finding container b01610a03222bfa3524ce59a4680e78a5fceca694c827ccfdc3485573bd778d8: Status 404 returned error can't find the container with id b01610a03222bfa3524ce59a4680e78a5fceca694c827ccfdc3485573bd778d8 Sep 10 17:52:14.460202 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:14.460171 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" event={"ID":"47de2584-fc5d-4675-9e65-81a40904490c","Type":"ContainerStarted","Data":"b01610a03222bfa3524ce59a4680e78a5fceca694c827ccfdc3485573bd778d8"} Sep 10 17:52:17.308719 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:17.308684 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:17.308992 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:17.308750 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:17.308992 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:17.308783 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:17.478142 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:17.478107 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" event={"ID":"47de2584-fc5d-4675-9e65-81a40904490c","Type":"ContainerStarted","Data":"294dcb7fbeb2d1ece192bc35b5478547026d67097e225ef60464eca5eeca96cb"} Sep 10 17:52:17.497459 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:17.497406 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" podStartSLOduration=0.934167611 podStartE2EDuration="4.49738903s" totalImagesPullingTime="3.563221419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:17.496166421 +0000 UTC m=+529.258800150" watchObservedRunningTime="2026-09-10 17:52:17.49738903 +0000 UTC m=+529.260022740" Sep 10 17:52:18.466243 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:18.466210 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:18.470468 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:18.470445 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:18.481682 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:18.481653 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:18.482406 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:18.482389 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b" Sep 10 17:52:24.647437 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.647358 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26"] Sep 10 17:52:24.649590 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.649574 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.663204 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.663182 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26"] Sep 10 17:52:24.806911 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.806875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.807086 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.806928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.807086 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.806961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.807086 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.806991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6mxd\" (UniqueName: \"kubernetes.io/projected/b5bf3705-c5e2-4ada-9324-f26bdede0a10-kube-api-access-j6mxd\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.807086 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.807021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.807086 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.807047 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.807256 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.807130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5bf3705-c5e2-4ada-9324-f26bdede0a10-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907739 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907739 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907739 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907728 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907991 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907746 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6mxd\" (UniqueName: \"kubernetes.io/projected/b5bf3705-c5e2-4ada-9324-f26bdede0a10-kube-api-access-j6mxd\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907991 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907991 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.907991 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.907815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5bf3705-c5e2-4ada-9324-f26bdede0a10-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.908674 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.908641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.909923 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.909896 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5bf3705-c5e2-4ada-9324-f26bdede0a10-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.910022 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.909985 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.910060 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.910022 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.910093 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.910072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.921162 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.921137 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5bf3705-c5e2-4ada-9324-f26bdede0a10-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.927568 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.927545 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6mxd\" (UniqueName: \"kubernetes.io/projected/b5bf3705-c5e2-4ada-9324-f26bdede0a10-kube-api-access-j6mxd\") pod \"istiod-openshift-gateway-5677ccb49b-lrz26\" (UID: \"b5bf3705-c5e2-4ada-9324-f26bdede0a10\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:24.957522 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:24.957485 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:25.229550 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.229467 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26"] Sep 10 17:52:25.232083 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:52:25.232057 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bf3705_c5e2_4ada_9324_f26bdede0a10.slice/crio-1cc47647d5b34e88086a53edf8ba039f05736bf4b8cbe0b926eba6d4415ca198 WatchSource:0}: Error finding container 1cc47647d5b34e88086a53edf8ba039f05736bf4b8cbe0b926eba6d4415ca198: Status 404 returned error can't find the container with id 1cc47647d5b34e88086a53edf8ba039f05736bf4b8cbe0b926eba6d4415ca198 Sep 10 17:52:25.235059 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.235019 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:25.235139 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.235094 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:52:25.507516 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.507484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" event={"ID":"b5bf3705-c5e2-4ada-9324-f26bdede0a10","Type":"ContainerStarted","Data":"12d992fe1ecf59c4395d0bfc64390b2b1a880e25d600203e149edb245da326af"} Sep 10 17:52:25.507681 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.507534 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" event={"ID":"b5bf3705-c5e2-4ada-9324-f26bdede0a10","Type":"ContainerStarted","Data":"1cc47647d5b34e88086a53edf8ba039f05736bf4b8cbe0b926eba6d4415ca198"} Sep 10 17:52:25.507681 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.507590 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:25.534615 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:25.534569 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" podStartSLOduration=1.53455491 podStartE2EDuration="1.53455491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:25.532727462 +0000 UTC m=+537.295361190" watchObservedRunningTime="2026-09-10 17:52:25.53455491 +0000 UTC m=+537.297188637" Sep 10 17:52:26.512845 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.512817 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-lrz26" Sep 10 17:52:26.601697 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.601662 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2"] Sep 10 17:52:26.601869 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.601848 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" podUID="edce50ae-940e-42cb-96cc-83be705fe792" containerName="discovery" containerID="cri-o://bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891" gracePeriod=30 Sep 10 17:52:26.833654 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.833630 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:26.925420 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925379 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmlhj\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-kube-api-access-qmlhj\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.925587 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925437 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edce50ae-940e-42cb-96cc-83be705fe792-local-certs\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.925587 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925456 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-dns-cert\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.925587 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925488 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-ca-configmap\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.925755 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925591 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-kubeconfig\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.925755 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925614 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-cacerts\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.925755 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925643 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-istio-token\") pod \"edce50ae-940e-42cb-96cc-83be705fe792\" (UID: \"edce50ae-940e-42cb-96cc-83be705fe792\") " Sep 10 17:52:26.926009 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.925962 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:52:26.927860 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.927832 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-cacerts" (OuterVolumeSpecName: "cacerts") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:52:26.927860 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.927847 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-kube-api-access-qmlhj" (OuterVolumeSpecName: "kube-api-access-qmlhj") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "kube-api-access-qmlhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:52:26.928020 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.927932 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:52:26.928020 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.927973 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-istio-token" (OuterVolumeSpecName: "istio-token") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:52:26.928122 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.928039 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:52:26.928122 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:26.928037 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edce50ae-940e-42cb-96cc-83be705fe792-local-certs" (OuterVolumeSpecName: "local-certs") pod "edce50ae-940e-42cb-96cc-83be705fe792" (UID: "edce50ae-940e-42cb-96cc-83be705fe792"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026693 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-kubeconfig\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026721 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-cacerts\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026731 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-istio-token\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026740 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmlhj\" (UniqueName: \"kubernetes.io/projected/edce50ae-940e-42cb-96cc-83be705fe792-kube-api-access-qmlhj\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026748 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edce50ae-940e-42cb-96cc-83be705fe792-local-certs\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026756 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-dns-cert\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.026775 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.026764 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edce50ae-940e-42cb-96cc-83be705fe792-istio-csr-ca-configmap\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:52:27.491071 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.490989 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7"] Sep 10 17:52:27.491351 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.491335 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edce50ae-940e-42cb-96cc-83be705fe792" containerName="discovery" Sep 10 17:52:27.491400 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.491354 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="edce50ae-940e-42cb-96cc-83be705fe792" containerName="discovery" Sep 10 17:52:27.491444 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.491433 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="edce50ae-940e-42cb-96cc-83be705fe792" containerName="discovery" Sep 10 17:52:27.493567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.493551 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.495882 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.495865 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Sep 10 17:52:27.495959 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.495900 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5gm7z\"" Sep 10 17:52:27.504449 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.504426 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7"] Sep 10 17:52:27.515349 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.515298 2556 generic.go:356] "Generic (PLEG): container finished" podID="edce50ae-940e-42cb-96cc-83be705fe792" containerID="bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891" exitCode=0 Sep 10 17:52:27.515818 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.515397 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" Sep 10 17:52:27.515818 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.515437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" event={"ID":"edce50ae-940e-42cb-96cc-83be705fe792","Type":"ContainerDied","Data":"bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891"} Sep 10 17:52:27.515818 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.515475 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2" event={"ID":"edce50ae-940e-42cb-96cc-83be705fe792","Type":"ContainerDied","Data":"505d00c09a8f7d716c97c936a4a3c9b45214e2c3bc9ecfe2a61de2b9ada53183"} Sep 10 17:52:27.515818 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.515502 2556 scope.go:117] "RemoveContainer" containerID="bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891" Sep 10 17:52:27.528573 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.528549 2556 scope.go:117] "RemoveContainer" containerID="bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891" Sep 10 17:52:27.528888 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:52:27.528865 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891\": container with ID starting with bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891 not found: ID does not exist" containerID="bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891" Sep 10 17:52:27.528932 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.528896 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891"} err="failed to get container status \"bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891\": rpc error: code = NotFound desc = could not find container \"bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891\": container with ID starting with bba7c7dde72096e53ce30fa0914f3a83207bddf7822f8f95d3048bc991a89891 not found: ID does not exist" Sep 10 17:52:27.541753 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.541725 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2"] Sep 10 17:52:27.546570 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.546547 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jgvh2"] Sep 10 17:52:27.632499 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.632466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e187b87-85e3-4e18-a258-eb95ac7dbe57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c45c7\" (UID: \"2e187b87-85e3-4e18-a258-eb95ac7dbe57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.632663 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.632541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrg8g\" (UniqueName: \"kubernetes.io/projected/2e187b87-85e3-4e18-a258-eb95ac7dbe57-kube-api-access-xrg8g\") pod \"llmisvc-controller-manager-777c6bd7d5-c45c7\" (UID: \"2e187b87-85e3-4e18-a258-eb95ac7dbe57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.733735 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.733694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e187b87-85e3-4e18-a258-eb95ac7dbe57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c45c7\" (UID: \"2e187b87-85e3-4e18-a258-eb95ac7dbe57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.733735 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.733742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrg8g\" (UniqueName: \"kubernetes.io/projected/2e187b87-85e3-4e18-a258-eb95ac7dbe57-kube-api-access-xrg8g\") pod \"llmisvc-controller-manager-777c6bd7d5-c45c7\" (UID: \"2e187b87-85e3-4e18-a258-eb95ac7dbe57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.736056 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.736035 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e187b87-85e3-4e18-a258-eb95ac7dbe57-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c45c7\" (UID: \"2e187b87-85e3-4e18-a258-eb95ac7dbe57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.744942 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.744918 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrg8g\" (UniqueName: \"kubernetes.io/projected/2e187b87-85e3-4e18-a258-eb95ac7dbe57-kube-api-access-xrg8g\") pod \"llmisvc-controller-manager-777c6bd7d5-c45c7\" (UID: \"2e187b87-85e3-4e18-a258-eb95ac7dbe57\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:27.802945 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:27.802910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:28.088041 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:28.088014 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7"] Sep 10 17:52:28.089921 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:52:28.089893 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2e187b87_85e3_4e18_a258_eb95ac7dbe57.slice/crio-dba6534416cddf8f16a8cd6de47933f1b8b1f623de428a46a3a6af71e33eb701 WatchSource:0}: Error finding container dba6534416cddf8f16a8cd6de47933f1b8b1f623de428a46a3a6af71e33eb701: Status 404 returned error can't find the container with id dba6534416cddf8f16a8cd6de47933f1b8b1f623de428a46a3a6af71e33eb701 Sep 10 17:52:28.519539 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:28.519504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" event={"ID":"2e187b87-85e3-4e18-a258-eb95ac7dbe57","Type":"ContainerStarted","Data":"dba6534416cddf8f16a8cd6de47933f1b8b1f623de428a46a3a6af71e33eb701"} Sep 10 17:52:28.702737 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:28.702707 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edce50ae-940e-42cb-96cc-83be705fe792" path="/var/lib/kubelet/pods/edce50ae-940e-42cb-96cc-83be705fe792/volumes" Sep 10 17:52:31.534430 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:31.534391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" event={"ID":"2e187b87-85e3-4e18-a258-eb95ac7dbe57","Type":"ContainerStarted","Data":"74c0888b38182f6616c9124f5a793e3525e18567d715e6607151a2433c6bd403"} Sep 10 17:52:31.534889 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:31.534513 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:52:31.551790 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:52:31.551746 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" podStartSLOduration=2.001322336 podStartE2EDuration="4.551732842s" totalImagesPullingTime="2.550410506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:52:31.550292115 +0000 UTC m=+543.312925840" watchObservedRunningTime="2026-09-10 17:52:31.551732842 +0000 UTC m=+543.314366572" Sep 10 17:53:02.540670 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:02.540637 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c45c7" Sep 10 17:53:28.592596 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:28.592568 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:53:28.593000 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:28.592675 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:53:45.468653 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.468621 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6f59f84b-4f4zp"] Sep 10 17:53:45.471773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.471756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.474226 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.474205 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 10 17:53:45.474226 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.474220 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 10 17:53:45.475148 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.475132 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 10 17:53:45.475194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.475177 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-62lmz\"" Sep 10 17:53:45.475331 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.475294 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 17:53:45.475392 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.475345 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 10 17:53:45.475662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.475640 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 10 17:53:45.476082 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.476065 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 17:53:45.479063 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.478738 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 10 17:53:45.484341 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.484299 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6f59f84b-4f4zp"] Sep 10 17:53:45.557915 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.557878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-oauth-serving-cert\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.558094 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.557927 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-serving-cert\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.558094 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.557945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-trusted-ca-bundle\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.558094 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.558003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-oauth-config\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.558094 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.558031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ztpt\" (UniqueName: \"kubernetes.io/projected/ed3a80bb-d12d-4453-a491-ce0501ad31d9-kube-api-access-2ztpt\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.558094 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.558056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-config\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.558094 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.558095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-service-ca\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658453 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658416 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-service-ca\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658639 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-oauth-serving-cert\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658639 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-serving-cert\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658639 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658532 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-trusted-ca-bundle\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658639 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-oauth-config\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658639 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ztpt\" (UniqueName: \"kubernetes.io/projected/ed3a80bb-d12d-4453-a491-ce0501ad31d9-kube-api-access-2ztpt\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.658886 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.658618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-config\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.659139 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.659109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-service-ca\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.659273 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.659251 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-oauth-serving-cert\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.659399 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.659366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-trusted-ca-bundle\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.659399 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.659382 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-config\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.660976 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.660953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-oauth-config\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.661119 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.661103 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed3a80bb-d12d-4453-a491-ce0501ad31d9-console-serving-cert\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.667759 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.667737 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ztpt\" (UniqueName: \"kubernetes.io/projected/ed3a80bb-d12d-4453-a491-ce0501ad31d9-kube-api-access-2ztpt\") pod \"console-5f6f59f84b-4f4zp\" (UID: \"ed3a80bb-d12d-4453-a491-ce0501ad31d9\") " pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:45.781123 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:45.781090 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:46.049941 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:46.049916 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6f59f84b-4f4zp"] Sep 10 17:53:46.052438 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:53:46.052414 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3a80bb_d12d_4453_a491_ce0501ad31d9.slice/crio-5c81baa4cedc93a4e6ca11dc0aad571062cf573ed1e8684fab9c40a5b9342f62 WatchSource:0}: Error finding container 5c81baa4cedc93a4e6ca11dc0aad571062cf573ed1e8684fab9c40a5b9342f62: Status 404 returned error can't find the container with id 5c81baa4cedc93a4e6ca11dc0aad571062cf573ed1e8684fab9c40a5b9342f62 Sep 10 17:53:46.800563 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:46.800531 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f59f84b-4f4zp" event={"ID":"ed3a80bb-d12d-4453-a491-ce0501ad31d9","Type":"ContainerStarted","Data":"788b0720682e977154df0ee9159db918efd4e4898754841a108000249acf8aa1"} Sep 10 17:53:46.800936 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:46.800587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f59f84b-4f4zp" event={"ID":"ed3a80bb-d12d-4453-a491-ce0501ad31d9","Type":"ContainerStarted","Data":"5c81baa4cedc93a4e6ca11dc0aad571062cf573ed1e8684fab9c40a5b9342f62"} Sep 10 17:53:46.819203 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:46.819156 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6f59f84b-4f4zp" podStartSLOduration=1.8191434069999999 podStartE2EDuration="1.819143407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:53:46.817576158 +0000 UTC m=+618.580209887" watchObservedRunningTime="2026-09-10 17:53:46.819143407 +0000 UTC m=+618.581777136" Sep 10 17:53:55.781429 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:55.781320 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:55.781429 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:55.781382 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:55.787264 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:55.787239 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:53:55.841570 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:53:55.841545 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6f59f84b-4f4zp" Sep 10 17:57:39.998795 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:39.998766 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl"] Sep 10 17:57:40.001753 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.001729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.004599 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.004577 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jqr5w\"" Sep 10 17:57:40.004874 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.004857 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 17:57:40.004970 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.004864 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 17:57:40.020251 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.020228 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl"] Sep 10 17:57:40.191672 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.191629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.191840 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.191707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dtlc\" (UniqueName: \"kubernetes.io/projected/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-kube-api-access-6dtlc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.292678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.292582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dtlc\" (UniqueName: \"kubernetes.io/projected/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-kube-api-access-6dtlc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.292678 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.292652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.292970 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.292955 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.300401 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.300380 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dtlc\" (UniqueName: \"kubernetes.io/projected/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-kube-api-access-6dtlc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.311338 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.311321 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:40.590046 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.590023 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl"] Sep 10 17:57:40.593170 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:57:40.593136 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d9ecf8_29b0_4e0e_aed5_26f0afd1812c.slice/crio-c3d9ec646d0ba7e5e2ac4830bf73e028c16b535732bdf87930f038890f721154 WatchSource:0}: Error finding container c3d9ec646d0ba7e5e2ac4830bf73e028c16b535732bdf87930f038890f721154: Status 404 returned error can't find the container with id c3d9ec646d0ba7e5e2ac4830bf73e028c16b535732bdf87930f038890f721154 Sep 10 17:57:40.595605 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.595590 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 17:57:40.706637 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:40.706600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" event={"ID":"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c","Type":"ContainerStarted","Data":"c3d9ec646d0ba7e5e2ac4830bf73e028c16b535732bdf87930f038890f721154"} Sep 10 17:57:44.726036 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:44.725953 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" event={"ID":"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c","Type":"ContainerStarted","Data":"7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864"} Sep 10 17:57:44.726412 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:44.726054 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:44.748170 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:44.748117 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" podStartSLOduration=1.94006809 podStartE2EDuration="5.748099255s" totalImagesPullingTime="3.808031165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:44.745797689 +0000 UTC m=+856.508431418" watchObservedRunningTime="2026-09-10 17:57:44.748099255 +0000 UTC m=+856.510732983" Sep 10 17:57:55.732939 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:55.732907 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:57.536927 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.536892 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb"] Sep 10 17:57:57.542936 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.542909 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.553382 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.553360 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb"] Sep 10 17:57:57.616873 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.616846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrlt\" (UniqueName: \"kubernetes.io/projected/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-kube-api-access-dvrlt\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.617015 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.616878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.717484 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.717448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrlt\" (UniqueName: \"kubernetes.io/projected/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-kube-api-access-dvrlt\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.717644 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.717491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.717857 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.717836 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.732947 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.732922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrlt\" (UniqueName: \"kubernetes.io/projected/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-kube-api-access-dvrlt\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.802773 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.802704 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl"] Sep 10 17:57:57.802914 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.802879 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" containerName="manager" containerID="cri-o://7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864" gracePeriod=2 Sep 10 17:57:57.813024 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.812997 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl"] Sep 10 17:57:57.820595 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.820571 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb"] Sep 10 17:57:57.820788 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.820777 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:57:57.822300 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:57:57.822269 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-29bkl\": pods \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:57.836336 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.836289 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb"] Sep 10 17:57:57.838750 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.838515 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr"] Sep 10 17:57:57.838928 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.838905 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" containerName="manager" Sep 10 17:57:57.838928 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.838930 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" containerName="manager" Sep 10 17:57:57.839111 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.839022 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" containerName="manager" Sep 10 17:57:57.842290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.842265 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:57.847499 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.847477 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf"] Sep 10 17:57:57.850237 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.850210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:57.856871 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.856849 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr"] Sep 10 17:57:57.879171 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.879146 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf"] Sep 10 17:57:57.886205 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:57:57.886162 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:57.915569 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:57:57.915537 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:57.919915 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.919894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7l8g\" (UniqueName: \"kubernetes.io/projected/6442f3e8-3f68-4929-a44c-0bb5666c37dc-kube-api-access-k7l8g\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7hbf\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:57.920023 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:57.919975 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6442f3e8-3f68-4929-a44c-0bb5666c37dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7hbf\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.021105 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.021080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4bmx\" (UniqueName: \"kubernetes.io/projected/67300f9d-902b-430a-a3c0-d843a7d6e85e-kube-api-access-d4bmx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfxsr\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.021212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.021138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6442f3e8-3f68-4929-a44c-0bb5666c37dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7hbf\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.021212 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.021192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7l8g\" (UniqueName: \"kubernetes.io/projected/6442f3e8-3f68-4929-a44c-0bb5666c37dc-kube-api-access-k7l8g\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7hbf\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.021346 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.021217 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67300f9d-902b-430a-a3c0-d843a7d6e85e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfxsr\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.021510 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.021489 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6442f3e8-3f68-4929-a44c-0bb5666c37dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7hbf\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.030778 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.030755 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7l8g\" (UniqueName: \"kubernetes.io/projected/6442f3e8-3f68-4929-a44c-0bb5666c37dc-kube-api-access-k7l8g\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-r7hbf\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.032340 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.032326 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:58.034572 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:57:58.034546 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:58.122364 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.122258 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-extensions-socket-volume\") pod \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " Sep 10 17:57:58.122364 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.122303 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dtlc\" (UniqueName: \"kubernetes.io/projected/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-kube-api-access-6dtlc\") pod \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\" (UID: \"f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c\") " Sep 10 17:57:58.122574 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.122435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4bmx\" (UniqueName: \"kubernetes.io/projected/67300f9d-902b-430a-a3c0-d843a7d6e85e-kube-api-access-d4bmx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfxsr\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.122574 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.122548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67300f9d-902b-430a-a3c0-d843a7d6e85e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfxsr\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.122725 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.122705 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" (UID: "f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:57:58.122879 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.122863 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67300f9d-902b-430a-a3c0-d843a7d6e85e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfxsr\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.124370 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.124347 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-kube-api-access-6dtlc" (OuterVolumeSpecName: "kube-api-access-6dtlc") pod "f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" (UID: "f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c"). InnerVolumeSpecName "kube-api-access-6dtlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:57:58.131245 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.131222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4bmx\" (UniqueName: \"kubernetes.io/projected/67300f9d-902b-430a-a3c0-d843a7d6e85e-kube-api-access-d4bmx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hfxsr\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.190668 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.190643 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.197586 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.197565 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.223804 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.223772 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-extensions-socket-volume\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:57:58.223804 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.223807 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dtlc\" (UniqueName: \"kubernetes.io/projected/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c-kube-api-access-6dtlc\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:57:58.470456 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.470386 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr"] Sep 10 17:57:58.473157 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:57:58.473127 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67300f9d_902b_430a_a3c0_d843a7d6e85e.slice/crio-334e0046c903cdf8364fd1fa046dd2e5eceedee2f88cfaa3a566c79d8eb99cd7 WatchSource:0}: Error finding container 334e0046c903cdf8364fd1fa046dd2e5eceedee2f88cfaa3a566c79d8eb99cd7: Status 404 returned error can't find the container with id 334e0046c903cdf8364fd1fa046dd2e5eceedee2f88cfaa3a566c79d8eb99cd7 Sep 10 17:57:58.473943 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.473921 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf"] Sep 10 17:57:58.477010 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:57:58.476988 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6442f3e8_3f68_4929_a44c_0bb5666c37dc.slice/crio-a7ecbe2455f913f5d714eaeefb062eef8ff84485615e91229451ea391d9cd9f5 WatchSource:0}: Error finding container a7ecbe2455f913f5d714eaeefb062eef8ff84485615e91229451ea391d9cd9f5: Status 404 returned error can't find the container with id a7ecbe2455f913f5d714eaeefb062eef8ff84485615e91229451ea391d9cd9f5 Sep 10 17:57:58.701021 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:57:58.700981 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-29bkl\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:58.702989 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.702960 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" path="/var/lib/kubelet/pods/f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c/volumes" Sep 10 17:57:58.781657 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.781628 2556 generic.go:356] "Generic (PLEG): container finished" podID="f4d9ecf8-29b0-4e0e-aed5-26f0afd1812c" containerID="7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864" exitCode=0 Sep 10 17:57:58.781812 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.781676 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-29bkl" Sep 10 17:57:58.781812 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.781706 2556 scope.go:117] "RemoveContainer" containerID="7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864" Sep 10 17:57:58.783765 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.783737 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" event={"ID":"6442f3e8-3f68-4929-a44c-0bb5666c37dc","Type":"ContainerStarted","Data":"9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c"} Sep 10 17:57:58.783876 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.783791 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" event={"ID":"6442f3e8-3f68-4929-a44c-0bb5666c37dc","Type":"ContainerStarted","Data":"a7ecbe2455f913f5d714eaeefb062eef8ff84485615e91229451ea391d9cd9f5"} Sep 10 17:57:58.783954 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.783888 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:57:58.785680 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.785652 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" event={"ID":"67300f9d-902b-430a-a3c0-d843a7d6e85e","Type":"ContainerStarted","Data":"87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a"} Sep 10 17:57:58.785774 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.785701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" event={"ID":"67300f9d-902b-430a-a3c0-d843a7d6e85e","Type":"ContainerStarted","Data":"334e0046c903cdf8364fd1fa046dd2e5eceedee2f88cfaa3a566c79d8eb99cd7"} Sep 10 17:57:58.785774 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.785747 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:57:58.789804 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.789785 2556 scope.go:117] "RemoveContainer" containerID="7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864" Sep 10 17:57:58.790076 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:57:58.790059 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864\": container with ID starting with 7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864 not found: ID does not exist" containerID="7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864" Sep 10 17:57:58.790126 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.790085 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864"} err="failed to get container status \"7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864\": rpc error: code = NotFound desc = could not find container \"7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864\": container with ID starting with 7a5f1c5d122d5439c3fd6f0067d86b49254ca93733954df4834ab3b129825864 not found: ID does not exist" Sep 10 17:57:58.814746 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.814699 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" podStartSLOduration=1.814682684 podStartE2EDuration="1.814682684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:58.81362062 +0000 UTC m=+870.576254341" watchObservedRunningTime="2026-09-10 17:57:58.814682684 +0000 UTC m=+870.577316412" Sep 10 17:57:58.831958 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:57:58.831903 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" podStartSLOduration=1.831889071 podStartE2EDuration="1.831889071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:57:58.831746574 +0000 UTC m=+870.594380312" watchObservedRunningTime="2026-09-10 17:57:58.831889071 +0000 UTC m=+870.594522799" Sep 10 17:58:00.366170 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:00.366128 2556 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-8rpzb_kuadrant-system_b51cc85f-9468-4ac4-9170-3fcc5c8f07ff_0(4a586f63ce893dc4411f8d48229d8f0fe07e48c697dd43a531e98f96c11b9ce2): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-8rpzb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Sep 10 17:58:00.366530 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:00.366201 2556 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-8rpzb_kuadrant-system_b51cc85f-9468-4ac4-9170-3fcc5c8f07ff_0(4a586f63ce893dc4411f8d48229d8f0fe07e48c697dd43a531e98f96c11b9ce2): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-8rpzb to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:00.799941 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.799906 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:00.807778 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.807757 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:00.809752 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:00.809726 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="b51cc85f-9468-4ac4-9170-3fcc5c8f07ff" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:00.848129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.848101 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvrlt\" (UniqueName: \"kubernetes.io/projected/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-kube-api-access-dvrlt\") pod \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " Sep 10 17:58:00.848217 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.848182 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-extensions-socket-volume\") pod \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\" (UID: \"b51cc85f-9468-4ac4-9170-3fcc5c8f07ff\") " Sep 10 17:58:00.848478 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.848455 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b51cc85f-9468-4ac4-9170-3fcc5c8f07ff" (UID: "b51cc85f-9468-4ac4-9170-3fcc5c8f07ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:58:00.850166 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.850143 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-kube-api-access-dvrlt" (OuterVolumeSpecName: "kube-api-access-dvrlt") pod "b51cc85f-9468-4ac4-9170-3fcc5c8f07ff" (UID: "b51cc85f-9468-4ac4-9170-3fcc5c8f07ff"). InnerVolumeSpecName "kube-api-access-dvrlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:58:00.949352 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.949292 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvrlt\" (UniqueName: \"kubernetes.io/projected/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-kube-api-access-dvrlt\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:00.949352 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:00.949346 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff-extensions-socket-volume\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:01.803863 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:01.803830 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:01.806138 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:01.806108 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="b51cc85f-9468-4ac4-9170-3fcc5c8f07ff" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:01.811195 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:01.811167 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-8rpzb\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="b51cc85f-9468-4ac4-9170-3fcc5c8f07ff" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-8rpzb" Sep 10 17:58:02.703158 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:02.703120 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51cc85f-9468-4ac4-9170-3fcc5c8f07ff" path="/var/lib/kubelet/pods/b51cc85f-9468-4ac4-9170-3fcc5c8f07ff/volumes" Sep 10 17:58:09.792715 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:09.792679 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:58:09.793140 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:09.792788 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:58:09.869995 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:09.869962 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr"] Sep 10 17:58:09.870220 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:09.870177 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" podUID="67300f9d-902b-430a-a3c0-d843a7d6e85e" containerName="manager" containerID="cri-o://87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a" gracePeriod=10 Sep 10 17:58:10.109609 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.109583 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k"] Sep 10 17:58:10.112070 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.112052 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:58:10.113044 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.113029 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.128758 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.128736 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k"] Sep 10 17:58:10.222694 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.222667 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67300f9d-902b-430a-a3c0-d843a7d6e85e-extensions-socket-volume\") pod \"67300f9d-902b-430a-a3c0-d843a7d6e85e\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " Sep 10 17:58:10.222886 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.222713 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4bmx\" (UniqueName: \"kubernetes.io/projected/67300f9d-902b-430a-a3c0-d843a7d6e85e-kube-api-access-d4bmx\") pod \"67300f9d-902b-430a-a3c0-d843a7d6e85e\" (UID: \"67300f9d-902b-430a-a3c0-d843a7d6e85e\") " Sep 10 17:58:10.222886 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.222876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb23742d-6603-4ac5-b233-4248f1f3bc2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zbx8k\" (UID: \"cb23742d-6603-4ac5-b233-4248f1f3bc2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.222994 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.222923 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j857j\" (UniqueName: \"kubernetes.io/projected/cb23742d-6603-4ac5-b233-4248f1f3bc2f-kube-api-access-j857j\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zbx8k\" (UID: \"cb23742d-6603-4ac5-b233-4248f1f3bc2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.223106 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.223078 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67300f9d-902b-430a-a3c0-d843a7d6e85e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67300f9d-902b-430a-a3c0-d843a7d6e85e" (UID: "67300f9d-902b-430a-a3c0-d843a7d6e85e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:58:10.224581 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.224562 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67300f9d-902b-430a-a3c0-d843a7d6e85e-kube-api-access-d4bmx" (OuterVolumeSpecName: "kube-api-access-d4bmx") pod "67300f9d-902b-430a-a3c0-d843a7d6e85e" (UID: "67300f9d-902b-430a-a3c0-d843a7d6e85e"). InnerVolumeSpecName "kube-api-access-d4bmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:58:10.324055 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.324022 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb23742d-6603-4ac5-b233-4248f1f3bc2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zbx8k\" (UID: \"cb23742d-6603-4ac5-b233-4248f1f3bc2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.324177 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.324066 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j857j\" (UniqueName: \"kubernetes.io/projected/cb23742d-6603-4ac5-b233-4248f1f3bc2f-kube-api-access-j857j\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zbx8k\" (UID: \"cb23742d-6603-4ac5-b233-4248f1f3bc2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.324177 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.324097 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67300f9d-902b-430a-a3c0-d843a7d6e85e-extensions-socket-volume\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:10.324177 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.324107 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4bmx\" (UniqueName: \"kubernetes.io/projected/67300f9d-902b-430a-a3c0-d843a7d6e85e-kube-api-access-d4bmx\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:10.324423 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.324406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb23742d-6603-4ac5-b233-4248f1f3bc2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zbx8k\" (UID: \"cb23742d-6603-4ac5-b233-4248f1f3bc2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.334993 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.334962 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j857j\" (UniqueName: \"kubernetes.io/projected/cb23742d-6603-4ac5-b233-4248f1f3bc2f-kube-api-access-j857j\") pod \"kuadrant-operator-controller-manager-5769f99d9f-zbx8k\" (UID: \"cb23742d-6603-4ac5-b233-4248f1f3bc2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.421818 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.421739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.697061 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.697031 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k"] Sep 10 17:58:10.699707 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:58:10.699682 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb23742d_6603_4ac5_b233_4248f1f3bc2f.slice/crio-02d871720fdf81558ff7cbd8fb439632aef7a7402c04c1a86f243337b5e8bfab WatchSource:0}: Error finding container 02d871720fdf81558ff7cbd8fb439632aef7a7402c04c1a86f243337b5e8bfab: Status 404 returned error can't find the container with id 02d871720fdf81558ff7cbd8fb439632aef7a7402c04c1a86f243337b5e8bfab Sep 10 17:58:10.842779 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.842751 2556 generic.go:356] "Generic (PLEG): container finished" podID="67300f9d-902b-430a-a3c0-d843a7d6e85e" containerID="87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a" exitCode=0 Sep 10 17:58:10.843236 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.842806 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" Sep 10 17:58:10.843236 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.842841 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" event={"ID":"67300f9d-902b-430a-a3c0-d843a7d6e85e","Type":"ContainerDied","Data":"87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a"} Sep 10 17:58:10.843236 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.842916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr" event={"ID":"67300f9d-902b-430a-a3c0-d843a7d6e85e","Type":"ContainerDied","Data":"334e0046c903cdf8364fd1fa046dd2e5eceedee2f88cfaa3a566c79d8eb99cd7"} Sep 10 17:58:10.843236 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.842940 2556 scope.go:117] "RemoveContainer" containerID="87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a" Sep 10 17:58:10.844573 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.844546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" event={"ID":"cb23742d-6603-4ac5-b233-4248f1f3bc2f","Type":"ContainerStarted","Data":"8b816c472945c42aade014e1467746b336164427a942da67cc749dd15a97a3cd"} Sep 10 17:58:10.844712 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.844589 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" event={"ID":"cb23742d-6603-4ac5-b233-4248f1f3bc2f","Type":"ContainerStarted","Data":"02d871720fdf81558ff7cbd8fb439632aef7a7402c04c1a86f243337b5e8bfab"} Sep 10 17:58:10.844712 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.844617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:10.850738 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.850723 2556 scope.go:117] "RemoveContainer" containerID="87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a" Sep 10 17:58:10.850980 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:10.850963 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a\": container with ID starting with 87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a not found: ID does not exist" containerID="87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a" Sep 10 17:58:10.851027 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.850988 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a"} err="failed to get container status \"87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a\": rpc error: code = NotFound desc = could not find container \"87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a\": container with ID starting with 87422c0333cf99f035a9b5d7a0c6edd0587cf38645c7de49c8958f55f4c1999a not found: ID does not exist" Sep 10 17:58:10.868933 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.868799 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" podStartSLOduration=0.86878136 podStartE2EDuration="868.78136ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:10.868534197 +0000 UTC m=+882.631167926" watchObservedRunningTime="2026-09-10 17:58:10.86878136 +0000 UTC m=+882.631415091" Sep 10 17:58:10.886143 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.886111 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr"] Sep 10 17:58:10.891964 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:10.891939 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hfxsr"] Sep 10 17:58:12.703138 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:12.703096 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67300f9d-902b-430a-a3c0-d843a7d6e85e" path="/var/lib/kubelet/pods/67300f9d-902b-430a-a3c0-d843a7d6e85e/volumes" Sep 10 17:58:21.853043 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:21.852963 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-zbx8k" Sep 10 17:58:21.905227 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:21.905196 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf"] Sep 10 17:58:21.905450 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:21.905423 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" podUID="6442f3e8-3f68-4929-a44c-0bb5666c37dc" containerName="manager" containerID="cri-o://9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c" gracePeriod=10 Sep 10 17:58:22.139360 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.139337 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:58:22.224253 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.224222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7l8g\" (UniqueName: \"kubernetes.io/projected/6442f3e8-3f68-4929-a44c-0bb5666c37dc-kube-api-access-k7l8g\") pod \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " Sep 10 17:58:22.224413 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.224270 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6442f3e8-3f68-4929-a44c-0bb5666c37dc-extensions-socket-volume\") pod \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\" (UID: \"6442f3e8-3f68-4929-a44c-0bb5666c37dc\") " Sep 10 17:58:22.224662 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.224640 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6442f3e8-3f68-4929-a44c-0bb5666c37dc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6442f3e8-3f68-4929-a44c-0bb5666c37dc" (UID: "6442f3e8-3f68-4929-a44c-0bb5666c37dc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 17:58:22.226251 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.226228 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6442f3e8-3f68-4929-a44c-0bb5666c37dc-kube-api-access-k7l8g" (OuterVolumeSpecName: "kube-api-access-k7l8g") pod "6442f3e8-3f68-4929-a44c-0bb5666c37dc" (UID: "6442f3e8-3f68-4929-a44c-0bb5666c37dc"). InnerVolumeSpecName "kube-api-access-k7l8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:58:22.325723 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.325697 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7l8g\" (UniqueName: \"kubernetes.io/projected/6442f3e8-3f68-4929-a44c-0bb5666c37dc-kube-api-access-k7l8g\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:22.325723 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.325720 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6442f3e8-3f68-4929-a44c-0bb5666c37dc-extensions-socket-volume\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:22.896764 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.896734 2556 generic.go:356] "Generic (PLEG): container finished" podID="6442f3e8-3f68-4929-a44c-0bb5666c37dc" containerID="9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c" exitCode=0 Sep 10 17:58:22.897170 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.896774 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" Sep 10 17:58:22.897170 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.896813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" event={"ID":"6442f3e8-3f68-4929-a44c-0bb5666c37dc","Type":"ContainerDied","Data":"9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c"} Sep 10 17:58:22.897170 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.896870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf" event={"ID":"6442f3e8-3f68-4929-a44c-0bb5666c37dc","Type":"ContainerDied","Data":"a7ecbe2455f913f5d714eaeefb062eef8ff84485615e91229451ea391d9cd9f5"} Sep 10 17:58:22.897170 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.896907 2556 scope.go:117] "RemoveContainer" containerID="9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c" Sep 10 17:58:22.904628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.904608 2556 scope.go:117] "RemoveContainer" containerID="9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c" Sep 10 17:58:22.904891 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:22.904874 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c\": container with ID starting with 9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c not found: ID does not exist" containerID="9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c" Sep 10 17:58:22.904940 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.904898 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c"} err="failed to get container status \"9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c\": rpc error: code = NotFound desc = could not find container \"9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c\": container with ID starting with 9c4f820a6bcc64caea4f880aaa445b9d3915f38ab9296f8f6497ee8d5678f73c not found: ID does not exist" Sep 10 17:58:22.922089 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.922060 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf"] Sep 10 17:58:22.926441 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:22.926421 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-r7hbf"] Sep 10 17:58:24.704527 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:24.704484 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6442f3e8-3f68-4929-a44c-0bb5666c37dc" path="/var/lib/kubelet/pods/6442f3e8-3f68-4929-a44c-0bb5666c37dc/volumes" Sep 10 17:58:26.165229 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165195 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb"] Sep 10 17:58:26.165647 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165631 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67300f9d-902b-430a-a3c0-d843a7d6e85e" containerName="manager" Sep 10 17:58:26.165689 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165650 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="67300f9d-902b-430a-a3c0-d843a7d6e85e" containerName="manager" Sep 10 17:58:26.165689 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165666 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6442f3e8-3f68-4929-a44c-0bb5666c37dc" containerName="manager" Sep 10 17:58:26.165689 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165674 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6442f3e8-3f68-4929-a44c-0bb5666c37dc" containerName="manager" Sep 10 17:58:26.165772 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165762 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="67300f9d-902b-430a-a3c0-d843a7d6e85e" containerName="manager" Sep 10 17:58:26.165807 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.165773 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6442f3e8-3f68-4929-a44c-0bb5666c37dc" containerName="manager" Sep 10 17:58:26.167934 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.167916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.170566 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.170541 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vswq6\"" Sep 10 17:58:26.179127 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.179103 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb"] Sep 10 17:58:26.259716 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.259716 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259717 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8mp6\" (UniqueName: \"kubernetes.io/projected/8fa59f79-b12e-420c-a003-90034472f95a-kube-api-access-l8mp6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.259943 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa59f79-b12e-420c-a003-90034472f95a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.259943 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259839 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa59f79-b12e-420c-a003-90034472f95a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.259943 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.260050 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.260050 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.259998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.260050 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.260028 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.260157 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.260081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa59f79-b12e-420c-a003-90034472f95a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.360975 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.360941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa59f79-b12e-420c-a003-90034472f95a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.360975 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.360981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa59f79-b12e-420c-a003-90034472f95a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361066 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361085 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa59f79-b12e-420c-a003-90034472f95a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8mp6\" (UniqueName: \"kubernetes.io/projected/8fa59f79-b12e-420c-a003-90034472f95a-kube-api-access-l8mp6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361610 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361551 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361719 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361680 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361841 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361732 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361841 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361802 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.361841 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.361820 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fa59f79-b12e-420c-a003-90034472f95a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.363576 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.363552 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fa59f79-b12e-420c-a003-90034472f95a-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.363655 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.363616 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fa59f79-b12e-420c-a003-90034472f95a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.368627 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.368604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fa59f79-b12e-420c-a003-90034472f95a-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.368859 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.368840 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8mp6\" (UniqueName: \"kubernetes.io/projected/8fa59f79-b12e-420c-a003-90034472f95a-kube-api-access-l8mp6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-x84kb\" (UID: \"8fa59f79-b12e-420c-a003-90034472f95a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.480210 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.480131 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:26.753473 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.753447 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb"] Sep 10 17:58:26.755386 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:58:26.755363 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa59f79_b12e_420c_a003_90034472f95a.slice/crio-7dd4cfc0862f2a96b4e71dd7b76069a08943aff754cf3bbab554cfbb44fcf926 WatchSource:0}: Error finding container 7dd4cfc0862f2a96b4e71dd7b76069a08943aff754cf3bbab554cfbb44fcf926: Status 404 returned error can't find the container with id 7dd4cfc0862f2a96b4e71dd7b76069a08943aff754cf3bbab554cfbb44fcf926 Sep 10 17:58:26.757944 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.757905 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:58:26.758014 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.757998 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:58:26.758058 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.758043 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 17:58:26.917673 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.917630 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" event={"ID":"8fa59f79-b12e-420c-a003-90034472f95a","Type":"ContainerStarted","Data":"8562d7b6ec11f1ff8c41aab5fd7386595f1d85d62ef5d3cd3a39cd3bb4ec9f89"} Sep 10 17:58:26.917848 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.917696 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" event={"ID":"8fa59f79-b12e-420c-a003-90034472f95a","Type":"ContainerStarted","Data":"7dd4cfc0862f2a96b4e71dd7b76069a08943aff754cf3bbab554cfbb44fcf926"} Sep 10 17:58:26.936682 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:26.936633 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" podStartSLOduration=0.936616087 podStartE2EDuration="936.616087ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:26.935731154 +0000 UTC m=+898.698364885" watchObservedRunningTime="2026-09-10 17:58:26.936616087 +0000 UTC m=+898.699249817" Sep 10 17:58:27.481129 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:27.481086 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:27.485809 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:27.485780 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:27.922095 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:27.922066 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:27.922912 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:27.922893 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 17:58:28.620409 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:28.620384 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:58:28.620796 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:28.620384 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 17:58:41.266022 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.265982 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:41.268978 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.268954 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.271215 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.271187 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 10 17:58:41.271331 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.271227 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d7c9p\"" Sep 10 17:58:41.278239 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.278215 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:41.373338 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.369018 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:41.394430 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.394393 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqmjz\" (UniqueName: \"kubernetes.io/projected/8498a42d-78d3-42e6-b853-47b97e019822-kube-api-access-rqmjz\") pod \"limitador-limitador-8588749977-wg4jx\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.394588 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.394500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8498a42d-78d3-42e6-b853-47b97e019822-config-file\") pod \"limitador-limitador-8588749977-wg4jx\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.494978 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.494941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqmjz\" (UniqueName: \"kubernetes.io/projected/8498a42d-78d3-42e6-b853-47b97e019822-kube-api-access-rqmjz\") pod \"limitador-limitador-8588749977-wg4jx\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.495146 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.495018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8498a42d-78d3-42e6-b853-47b97e019822-config-file\") pod \"limitador-limitador-8588749977-wg4jx\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.495685 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.495666 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8498a42d-78d3-42e6-b853-47b97e019822-config-file\") pod \"limitador-limitador-8588749977-wg4jx\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.502919 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.502894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqmjz\" (UniqueName: \"kubernetes.io/projected/8498a42d-78d3-42e6-b853-47b97e019822-kube-api-access-rqmjz\") pod \"limitador-limitador-8588749977-wg4jx\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.579677 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.579591 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:41.846940 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.846891 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:41.849457 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:58:41.849431 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8498a42d_78d3_42e6_b853_47b97e019822.slice/crio-068662f6c23f232b75b3d75deecfbe62f1e96b51e77d9e8f2d5ab9bf294b2665 WatchSource:0}: Error finding container 068662f6c23f232b75b3d75deecfbe62f1e96b51e77d9e8f2d5ab9bf294b2665: Status 404 returned error can't find the container with id 068662f6c23f232b75b3d75deecfbe62f1e96b51e77d9e8f2d5ab9bf294b2665 Sep 10 17:58:41.975523 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:41.975480 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" event={"ID":"8498a42d-78d3-42e6-b853-47b97e019822","Type":"ContainerStarted","Data":"068662f6c23f232b75b3d75deecfbe62f1e96b51e77d9e8f2d5ab9bf294b2665"} Sep 10 17:58:43.985148 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:43.985111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" event={"ID":"8498a42d-78d3-42e6-b853-47b97e019822","Type":"ContainerStarted","Data":"fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678"} Sep 10 17:58:43.985628 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:43.985235 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:54.991240 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:54.991212 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:55.008651 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:55.008600 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" podStartSLOduration=12.909146004 podStartE2EDuration="14.008584117s" totalImagesPullingTime="1.099438113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:58:43.999647842 +0000 UTC m=+915.762281583" watchObservedRunningTime="2026-09-10 17:58:55.008584117 +0000 UTC m=+926.771217845" Sep 10 17:58:55.780171 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:55.780132 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:55.780416 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:55.780384 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" podUID="8498a42d-78d3-42e6-b853-47b97e019822" containerName="limitador" containerID="cri-o://fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678" gracePeriod=30 Sep 10 17:58:56.321802 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.321781 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:56.402364 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.402265 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8498a42d-78d3-42e6-b853-47b97e019822-config-file\") pod \"8498a42d-78d3-42e6-b853-47b97e019822\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " Sep 10 17:58:56.402364 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.402348 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqmjz\" (UniqueName: \"kubernetes.io/projected/8498a42d-78d3-42e6-b853-47b97e019822-kube-api-access-rqmjz\") pod \"8498a42d-78d3-42e6-b853-47b97e019822\" (UID: \"8498a42d-78d3-42e6-b853-47b97e019822\") " Sep 10 17:58:56.402726 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.402702 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8498a42d-78d3-42e6-b853-47b97e019822-config-file" (OuterVolumeSpecName: "config-file") pod "8498a42d-78d3-42e6-b853-47b97e019822" (UID: "8498a42d-78d3-42e6-b853-47b97e019822"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 17:58:56.404261 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.404239 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8498a42d-78d3-42e6-b853-47b97e019822-kube-api-access-rqmjz" (OuterVolumeSpecName: "kube-api-access-rqmjz") pod "8498a42d-78d3-42e6-b853-47b97e019822" (UID: "8498a42d-78d3-42e6-b853-47b97e019822"). InnerVolumeSpecName "kube-api-access-rqmjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:58:56.503077 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.503040 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8498a42d-78d3-42e6-b853-47b97e019822-config-file\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:56.503077 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:56.503070 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqmjz\" (UniqueName: \"kubernetes.io/projected/8498a42d-78d3-42e6-b853-47b97e019822-kube-api-access-rqmjz\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:58:57.039144 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.039105 2556 generic.go:356] "Generic (PLEG): container finished" podID="8498a42d-78d3-42e6-b853-47b97e019822" containerID="fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678" exitCode=0 Sep 10 17:58:57.039350 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.039150 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" Sep 10 17:58:57.039350 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.039195 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" event={"ID":"8498a42d-78d3-42e6-b853-47b97e019822","Type":"ContainerDied","Data":"fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678"} Sep 10 17:58:57.039350 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.039255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wg4jx" event={"ID":"8498a42d-78d3-42e6-b853-47b97e019822","Type":"ContainerDied","Data":"068662f6c23f232b75b3d75deecfbe62f1e96b51e77d9e8f2d5ab9bf294b2665"} Sep 10 17:58:57.039350 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.039283 2556 scope.go:117] "RemoveContainer" containerID="fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678" Sep 10 17:58:57.046999 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.046983 2556 scope.go:117] "RemoveContainer" containerID="fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678" Sep 10 17:58:57.047265 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:58:57.047250 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678\": container with ID starting with fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678 not found: ID does not exist" containerID="fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678" Sep 10 17:58:57.047302 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.047273 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678"} err="failed to get container status \"fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678\": rpc error: code = NotFound desc = could not find container \"fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678\": container with ID starting with fe284d8f2f723942430eb0cee7b27f2b8f24c4ef0bbda6db7478ee770d30a678 not found: ID does not exist" Sep 10 17:58:57.054417 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.054397 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:57.057915 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:57.057894 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wg4jx"] Sep 10 17:58:58.703268 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:58.703238 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8498a42d-78d3-42e6-b853-47b97e019822" path="/var/lib/kubelet/pods/8498a42d-78d3-42e6-b853-47b97e019822/volumes" Sep 10 17:58:59.791337 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.791289 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh"] Sep 10 17:58:59.791777 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.791581 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8498a42d-78d3-42e6-b853-47b97e019822" containerName="limitador" Sep 10 17:58:59.791777 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.791593 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8498a42d-78d3-42e6-b853-47b97e019822" containerName="limitador" Sep 10 17:58:59.791777 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.791636 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8498a42d-78d3-42e6-b853-47b97e019822" containerName="limitador" Sep 10 17:58:59.794253 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.794230 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:58:59.796548 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.796527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Sep 10 17:58:59.796677 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.796570 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Sep 10 17:58:59.797298 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.797277 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Sep 10 17:58:59.797418 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.797277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ckv27\"" Sep 10 17:58:59.803044 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.803022 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh"] Sep 10 17:58:59.829977 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.829951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8a38edf-ed27-464d-b94b-44cd1c4c8af1-data\") pod \"postgres-69fb4594cf-zbcdh\" (UID: \"a8a38edf-ed27-464d-b94b-44cd1c4c8af1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:58:59.830095 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.829989 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69kmp\" (UniqueName: \"kubernetes.io/projected/a8a38edf-ed27-464d-b94b-44cd1c4c8af1-kube-api-access-69kmp\") pod \"postgres-69fb4594cf-zbcdh\" (UID: \"a8a38edf-ed27-464d-b94b-44cd1c4c8af1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:58:59.931284 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.931251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69kmp\" (UniqueName: \"kubernetes.io/projected/a8a38edf-ed27-464d-b94b-44cd1c4c8af1-kube-api-access-69kmp\") pod \"postgres-69fb4594cf-zbcdh\" (UID: \"a8a38edf-ed27-464d-b94b-44cd1c4c8af1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:58:59.931455 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.931374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8a38edf-ed27-464d-b94b-44cd1c4c8af1-data\") pod \"postgres-69fb4594cf-zbcdh\" (UID: \"a8a38edf-ed27-464d-b94b-44cd1c4c8af1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:58:59.931677 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.931662 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a8a38edf-ed27-464d-b94b-44cd1c4c8af1-data\") pod \"postgres-69fb4594cf-zbcdh\" (UID: \"a8a38edf-ed27-464d-b94b-44cd1c4c8af1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:58:59.940236 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:58:59.940207 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69kmp\" (UniqueName: \"kubernetes.io/projected/a8a38edf-ed27-464d-b94b-44cd1c4c8af1-kube-api-access-69kmp\") pod \"postgres-69fb4594cf-zbcdh\" (UID: \"a8a38edf-ed27-464d-b94b-44cd1c4c8af1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:59:00.106577 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:00.106474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:59:00.372734 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:00.372712 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh"] Sep 10 17:59:00.374935 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:59:00.374908 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a38edf_ed27_464d_b94b_44cd1c4c8af1.slice/crio-c21b6a9f4a364b3c841d9f1776190f66f27d69fe0a9799858b38f171eb7fcd10 WatchSource:0}: Error finding container c21b6a9f4a364b3c841d9f1776190f66f27d69fe0a9799858b38f171eb7fcd10: Status 404 returned error can't find the container with id c21b6a9f4a364b3c841d9f1776190f66f27d69fe0a9799858b38f171eb7fcd10 Sep 10 17:59:01.069436 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:01.069398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" event={"ID":"a8a38edf-ed27-464d-b94b-44cd1c4c8af1","Type":"ContainerStarted","Data":"c21b6a9f4a364b3c841d9f1776190f66f27d69fe0a9799858b38f171eb7fcd10"} Sep 10 17:59:05.090657 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:05.090576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" event={"ID":"a8a38edf-ed27-464d-b94b-44cd1c4c8af1","Type":"ContainerStarted","Data":"860a243b407a562cd10efc29b7f4f440a23ee98eb5c9fd0c6f59ab975b4e60dd"} Sep 10 17:59:05.090992 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:05.090711 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:59:05.107064 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:05.107016 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" podStartSLOduration=1.656306292 podStartE2EDuration="6.107003281s" totalImagesPullingTime="4.450696989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:05.105350592 +0000 UTC m=+936.867984323" watchObservedRunningTime="2026-09-10 17:59:05.107003281 +0000 UTC m=+936.869637009" Sep 10 17:59:11.122765 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:11.122738 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcdh" Sep 10 17:59:17.779994 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.779961 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-79fc44874f-ptkwp"] Sep 10 17:59:17.797235 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.797210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.800258 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.800235 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 10 17:59:17.800403 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.800271 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 10 17:59:17.800938 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.800919 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 10 17:59:17.801047 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.800940 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9vsd4\"" Sep 10 17:59:17.803103 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.803084 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fc44874f-ptkwp"] Sep 10 17:59:17.875994 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.875965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-metrics-certs\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.876155 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.876000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rhp2\" (UniqueName: \"kubernetes.io/projected/515deb6c-7bca-4d69-abf9-54aaf57572a4-kube-api-access-7rhp2\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.876155 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.876108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-webhook-cert\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.955388 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.955355 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54966db754-4fgj6"] Sep 10 17:59:17.957659 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.957644 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:17.968164 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.968142 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54966db754-4fgj6"] Sep 10 17:59:17.976633 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.976599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-metrics-certs\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.976633 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.976638 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rhp2\" (UniqueName: \"kubernetes.io/projected/515deb6c-7bca-4d69-abf9-54aaf57572a4-kube-api-access-7rhp2\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.976798 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.976696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-webhook-cert\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.979109 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.979089 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-metrics-certs\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.979203 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.979133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-webhook-cert\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:17.987888 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:17.987864 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rhp2\" (UniqueName: \"kubernetes.io/projected/515deb6c-7bca-4d69-abf9-54aaf57572a4-kube-api-access-7rhp2\") pod \"maas-controller-79fc44874f-ptkwp\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:18.077241 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.077175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bbf65c1-7046-4f7d-b844-5a8848a528af-webhook-cert\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.077241 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.077234 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlzp5\" (UniqueName: \"kubernetes.io/projected/4bbf65c1-7046-4f7d-b844-5a8848a528af-kube-api-access-xlzp5\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.077402 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.077281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbf65c1-7046-4f7d-b844-5a8848a528af-metrics-certs\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.109162 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.109129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:18.178822 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.178597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bbf65c1-7046-4f7d-b844-5a8848a528af-webhook-cert\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.179026 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.179005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlzp5\" (UniqueName: \"kubernetes.io/projected/4bbf65c1-7046-4f7d-b844-5a8848a528af-kube-api-access-xlzp5\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.179105 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.179075 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbf65c1-7046-4f7d-b844-5a8848a528af-metrics-certs\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.181870 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.181839 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4bbf65c1-7046-4f7d-b844-5a8848a528af-webhook-cert\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.181964 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.181873 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4bbf65c1-7046-4f7d-b844-5a8848a528af-metrics-certs\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.187478 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.187458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlzp5\" (UniqueName: \"kubernetes.io/projected/4bbf65c1-7046-4f7d-b844-5a8848a528af-kube-api-access-xlzp5\") pod \"maas-controller-54966db754-4fgj6\" (UID: \"4bbf65c1-7046-4f7d-b844-5a8848a528af\") " pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.266998 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.266975 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:18.379715 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.379673 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-79fc44874f-ptkwp"] Sep 10 17:59:18.381302 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:59:18.381273 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515deb6c_7bca_4d69_abf9_54aaf57572a4.slice/crio-ea0bd64a834fb7db283c37812e030fafb87dfeb92f388a7d8396e9aec994d7d3 WatchSource:0}: Error finding container ea0bd64a834fb7db283c37812e030fafb87dfeb92f388a7d8396e9aec994d7d3: Status 404 returned error can't find the container with id ea0bd64a834fb7db283c37812e030fafb87dfeb92f388a7d8396e9aec994d7d3 Sep 10 17:59:18.532757 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:18.532733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54966db754-4fgj6"] Sep 10 17:59:18.534622 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:59:18.534600 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbf65c1_7046_4f7d_b844_5a8848a528af.slice/crio-478a43486bce44a047d0770f2620383168823af714ccb25f1220214d64dee953 WatchSource:0}: Error finding container 478a43486bce44a047d0770f2620383168823af714ccb25f1220214d64dee953: Status 404 returned error can't find the container with id 478a43486bce44a047d0770f2620383168823af714ccb25f1220214d64dee953 Sep 10 17:59:19.159447 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:19.159336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-ptkwp" event={"ID":"515deb6c-7bca-4d69-abf9-54aaf57572a4","Type":"ContainerStarted","Data":"ea0bd64a834fb7db283c37812e030fafb87dfeb92f388a7d8396e9aec994d7d3"} Sep 10 17:59:19.160850 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:19.160821 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54966db754-4fgj6" event={"ID":"4bbf65c1-7046-4f7d-b844-5a8848a528af","Type":"ContainerStarted","Data":"478a43486bce44a047d0770f2620383168823af714ccb25f1220214d64dee953"} Sep 10 17:59:21.172924 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:21.172840 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-ptkwp" event={"ID":"515deb6c-7bca-4d69-abf9-54aaf57572a4","Type":"ContainerStarted","Data":"26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492"} Sep 10 17:59:21.173350 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:21.172926 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:21.174621 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:21.174594 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54966db754-4fgj6" event={"ID":"4bbf65c1-7046-4f7d-b844-5a8848a528af","Type":"ContainerStarted","Data":"87fc7ffc85f70ba493d550503c58c77d3fe05f54c47c606c1e6debb05b387902"} Sep 10 17:59:21.174751 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:21.174654 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:21.189561 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:21.189505 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-79fc44874f-ptkwp" podStartSLOduration=1.7114932390000002 podStartE2EDuration="4.189481232s" totalImagesPullingTime="2.477987993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:21.189002715 +0000 UTC m=+952.951636444" watchObservedRunningTime="2026-09-10 17:59:21.189481232 +0000 UTC m=+952.952114961" Sep 10 17:59:21.205680 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:21.205630 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54966db754-4fgj6" podStartSLOduration=1.872478233 podStartE2EDuration="4.205612427s" totalImagesPullingTime="2.333134194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 17:59:21.204984938 +0000 UTC m=+952.967618666" watchObservedRunningTime="2026-09-10 17:59:21.205612427 +0000 UTC m=+952.968246156" Sep 10 17:59:32.182642 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.182593 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:32.183053 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.182839 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54966db754-4fgj6" Sep 10 17:59:32.240610 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.240574 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fc44874f-ptkwp"] Sep 10 17:59:32.240812 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.240749 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-79fc44874f-ptkwp" podUID="515deb6c-7bca-4d69-abf9-54aaf57572a4" containerName="manager" containerID="cri-o://26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492" gracePeriod=30 Sep 10 17:59:32.475234 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.475214 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:32.590467 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.590430 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rhp2\" (UniqueName: \"kubernetes.io/projected/515deb6c-7bca-4d69-abf9-54aaf57572a4-kube-api-access-7rhp2\") pod \"515deb6c-7bca-4d69-abf9-54aaf57572a4\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " Sep 10 17:59:32.590590 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.590532 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-webhook-cert\") pod \"515deb6c-7bca-4d69-abf9-54aaf57572a4\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " Sep 10 17:59:32.590641 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.590606 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-metrics-certs\") pod \"515deb6c-7bca-4d69-abf9-54aaf57572a4\" (UID: \"515deb6c-7bca-4d69-abf9-54aaf57572a4\") " Sep 10 17:59:32.592715 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.592679 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515deb6c-7bca-4d69-abf9-54aaf57572a4-kube-api-access-7rhp2" (OuterVolumeSpecName: "kube-api-access-7rhp2") pod "515deb6c-7bca-4d69-abf9-54aaf57572a4" (UID: "515deb6c-7bca-4d69-abf9-54aaf57572a4"). InnerVolumeSpecName "kube-api-access-7rhp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 17:59:32.592833 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.592677 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "515deb6c-7bca-4d69-abf9-54aaf57572a4" (UID: "515deb6c-7bca-4d69-abf9-54aaf57572a4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:59:32.592833 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.592726 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "515deb6c-7bca-4d69-abf9-54aaf57572a4" (UID: "515deb6c-7bca-4d69-abf9-54aaf57572a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 17:59:32.692088 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.692060 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-webhook-cert\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:59:32.692088 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.692084 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/515deb6c-7bca-4d69-abf9-54aaf57572a4-metrics-certs\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:59:32.692228 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:32.692099 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rhp2\" (UniqueName: \"kubernetes.io/projected/515deb6c-7bca-4d69-abf9-54aaf57572a4-kube-api-access-7rhp2\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Sep 10 17:59:33.228939 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.228903 2556 generic.go:356] "Generic (PLEG): container finished" podID="515deb6c-7bca-4d69-abf9-54aaf57572a4" containerID="26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492" exitCode=0 Sep 10 17:59:33.229290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.228961 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-79fc44874f-ptkwp" Sep 10 17:59:33.229290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.228990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-ptkwp" event={"ID":"515deb6c-7bca-4d69-abf9-54aaf57572a4","Type":"ContainerDied","Data":"26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492"} Sep 10 17:59:33.229290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.229044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-79fc44874f-ptkwp" event={"ID":"515deb6c-7bca-4d69-abf9-54aaf57572a4","Type":"ContainerDied","Data":"ea0bd64a834fb7db283c37812e030fafb87dfeb92f388a7d8396e9aec994d7d3"} Sep 10 17:59:33.229290 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.229068 2556 scope.go:117] "RemoveContainer" containerID="26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492" Sep 10 17:59:33.237001 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.236985 2556 scope.go:117] "RemoveContainer" containerID="26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492" Sep 10 17:59:33.237274 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:59:33.237258 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492\": container with ID starting with 26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492 not found: ID does not exist" containerID="26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492" Sep 10 17:59:33.237352 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.237280 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492"} err="failed to get container status \"26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492\": rpc error: code = NotFound desc = could not find container \"26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492\": container with ID starting with 26339c1cf67736b9c4b8c0a3deee8df3c4da10d6964ad74e5a05ae2610e1b492 not found: ID does not exist" Sep 10 17:59:33.244268 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.244248 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-79fc44874f-ptkwp"] Sep 10 17:59:33.247715 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:33.247695 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-79fc44874f-ptkwp"] Sep 10 17:59:34.703092 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:34.703058 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515deb6c-7bca-4d69-abf9-54aaf57572a4" path="/var/lib/kubelet/pods/515deb6c-7bca-4d69-abf9-54aaf57572a4/volumes" Sep 10 17:59:55.183560 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.183482 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958dd778-m8nld"] Sep 10 17:59:55.184014 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.183761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515deb6c-7bca-4d69-abf9-54aaf57572a4" containerName="manager" Sep 10 17:59:55.184014 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.183772 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="515deb6c-7bca-4d69-abf9-54aaf57572a4" containerName="manager" Sep 10 17:59:55.184014 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.183833 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="515deb6c-7bca-4d69-abf9-54aaf57572a4" containerName="manager" Sep 10 17:59:55.189401 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.189383 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.192611 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.192590 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Sep 10 17:59:55.192717 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.192600 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ctnmh\"" Sep 10 17:59:55.192717 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.192624 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Sep 10 17:59:55.200719 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.200697 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958dd778-m8nld"] Sep 10 17:59:55.270039 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.269998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-metrics-certs\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.270039 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.270046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxpdk\" (UniqueName: \"kubernetes.io/projected/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-kube-api-access-mxpdk\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.270245 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.270073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-maas-api-tls\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.270245 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.270171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-openshift-service-ca\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.370820 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.370790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-openshift-service-ca\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.370989 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.370832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-metrics-certs\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.370989 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.370856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxpdk\" (UniqueName: \"kubernetes.io/projected/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-kube-api-access-mxpdk\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.370989 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.370880 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-maas-api-tls\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.370989 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:59:55.370947 2556 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found Sep 10 17:59:55.371128 ip-10-0-133-48 kubenswrapper[2556]: E0910 17:59:55.371027 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-metrics-certs podName:1b4148b4-725f-4a9a-b3cf-40ba547f0afd nodeName:}" failed. No retries permitted until 2026-09-10 17:59:55.871006819 +0000 UTC m=+987.633640526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-metrics-certs") pod "maas-api-6b958dd778-m8nld" (UID: "1b4148b4-725f-4a9a-b3cf-40ba547f0afd") : secret "maas-api-metrics-tls" not found Sep 10 17:59:55.371567 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.371541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-openshift-service-ca\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.373284 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.373257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-maas-api-tls\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.380971 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.380951 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxpdk\" (UniqueName: \"kubernetes.io/projected/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-kube-api-access-mxpdk\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.669542 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.669507 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-s9wpc"] Sep 10 17:59:55.671531 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.671517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.674886 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.674863 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lfb4d\"" Sep 10 17:59:55.675166 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.675144 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 17:59:55.696268 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.696245 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-s9wpc"] Sep 10 17:59:55.773601 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.773575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c97e649-25df-4e91-9be6-ea69919e40b3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-s9wpc\" (UID: \"8c97e649-25df-4e91-9be6-ea69919e40b3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.773728 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.773697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6v8\" (UniqueName: \"kubernetes.io/projected/8c97e649-25df-4e91-9be6-ea69919e40b3-kube-api-access-hx6v8\") pod \"payload-processing-5b54b7fbb7-s9wpc\" (UID: \"8c97e649-25df-4e91-9be6-ea69919e40b3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.874589 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.874538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-metrics-certs\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.874748 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.874599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6v8\" (UniqueName: \"kubernetes.io/projected/8c97e649-25df-4e91-9be6-ea69919e40b3-kube-api-access-hx6v8\") pod \"payload-processing-5b54b7fbb7-s9wpc\" (UID: \"8c97e649-25df-4e91-9be6-ea69919e40b3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.874748 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.874640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c97e649-25df-4e91-9be6-ea69919e40b3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-s9wpc\" (UID: \"8c97e649-25df-4e91-9be6-ea69919e40b3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.875388 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.875364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8c97e649-25df-4e91-9be6-ea69919e40b3-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-s9wpc\" (UID: \"8c97e649-25df-4e91-9be6-ea69919e40b3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.877114 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.877087 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4148b4-725f-4a9a-b3cf-40ba547f0afd-metrics-certs\") pod \"maas-api-6b958dd778-m8nld\" (UID: \"1b4148b4-725f-4a9a-b3cf-40ba547f0afd\") " pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:55.883482 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.883458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6v8\" (UniqueName: \"kubernetes.io/projected/8c97e649-25df-4e91-9be6-ea69919e40b3-kube-api-access-hx6v8\") pod \"payload-processing-5b54b7fbb7-s9wpc\" (UID: \"8c97e649-25df-4e91-9be6-ea69919e40b3\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:55.981730 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:55.981665 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 17:59:56.098931 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:56.098902 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 17:59:56.251194 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:56.251171 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-s9wpc"] Sep 10 17:59:56.253698 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:59:56.253673 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c97e649_25df_4e91_9be6_ea69919e40b3.slice/crio-915fd6df3a994fa1514f722e94860be4971c6ac92e0acb834b144b1d742b5336 WatchSource:0}: Error finding container 915fd6df3a994fa1514f722e94860be4971c6ac92e0acb834b144b1d742b5336: Status 404 returned error can't find the container with id 915fd6df3a994fa1514f722e94860be4971c6ac92e0acb834b144b1d742b5336 Sep 10 17:59:56.329527 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:56.329475 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" event={"ID":"8c97e649-25df-4e91-9be6-ea69919e40b3","Type":"ContainerStarted","Data":"915fd6df3a994fa1514f722e94860be4971c6ac92e0acb834b144b1d742b5336"} Sep 10 17:59:56.370978 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:56.370933 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b958dd778-m8nld"] Sep 10 17:59:56.391088 ip-10-0-133-48 kubenswrapper[2556]: W0910 17:59:56.391054 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4148b4_725f_4a9a_b3cf_40ba547f0afd.slice/crio-6e08061368d624c82d43e2b99fa0b2ce434d1bccc6d341453a219239c8908e77 WatchSource:0}: Error finding container 6e08061368d624c82d43e2b99fa0b2ce434d1bccc6d341453a219239c8908e77: Status 404 returned error can't find the container with id 6e08061368d624c82d43e2b99fa0b2ce434d1bccc6d341453a219239c8908e77 Sep 10 17:59:57.338278 ip-10-0-133-48 kubenswrapper[2556]: I0910 17:59:57.338241 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" event={"ID":"1b4148b4-725f-4a9a-b3cf-40ba547f0afd","Type":"ContainerStarted","Data":"6e08061368d624c82d43e2b99fa0b2ce434d1bccc6d341453a219239c8908e77"} Sep 10 18:00:00.355129 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:00.355092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" event={"ID":"1b4148b4-725f-4a9a-b3cf-40ba547f0afd","Type":"ContainerStarted","Data":"ac8311b8ce3a86643b7fd55caca24bc33185bd924bf5910b7c17bb01c388f272"} Sep 10 18:00:00.356780 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:00.356758 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 18:00:00.359017 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:00.358977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" event={"ID":"8c97e649-25df-4e91-9be6-ea69919e40b3","Type":"ContainerStarted","Data":"20ce082ca259c3bcf373fe9c70f73584207a55de96460c1e9ed762ea39ab77e3"} Sep 10 18:00:00.359784 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:00.359767 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 18:00:00.376324 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:00.376254 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" podStartSLOduration=2.269407405 podStartE2EDuration="5.376235285s" totalImagesPullingTime="3.10682788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:00.373774716 +0000 UTC m=+992.136408446" watchObservedRunningTime="2026-09-10 18:00:00.376235285 +0000 UTC m=+992.138869015" Sep 10 18:00:00.390990 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:00.390946 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" podStartSLOduration=2.14566625 podStartE2EDuration="5.390931569s" totalImagesPullingTime="3.245265319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 17:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:00:00.390279187 +0000 UTC m=+992.152912916" watchObservedRunningTime="2026-09-10 18:00:00.390931569 +0000 UTC m=+992.153565297" Sep 10 18:00:05.384377 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:05.384339 2556 generic.go:356] "Generic (PLEG): container finished" podID="8fa59f79-b12e-420c-a003-90034472f95a" containerID="8562d7b6ec11f1ff8c41aab5fd7386595f1d85d62ef5d3cd3a39cd3bb4ec9f89" exitCode=0 Sep 10 18:00:05.384811 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:05.384394 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" event={"ID":"8fa59f79-b12e-420c-a003-90034472f95a","Type":"ContainerDied","Data":"8562d7b6ec11f1ff8c41aab5fd7386595f1d85d62ef5d3cd3a39cd3bb4ec9f89"} Sep 10 18:00:05.384811 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:05.384762 2556 scope.go:117] "RemoveContainer" containerID="8562d7b6ec11f1ff8c41aab5fd7386595f1d85d62ef5d3cd3a39cd3bb4ec9f89" Sep 10 18:00:05.385654 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:05.385627 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 18:00:05.385747 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:05.385708 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 18:00:05.385805 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:05.385748 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 18:00:06.390620 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:06.390591 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" event={"ID":"8fa59f79-b12e-420c-a003-90034472f95a","Type":"ContainerStarted","Data":"8654ee5f28b43dbe855ee5a215d4f40ebdb79f3f937ce89f34ff4bbb907892a3"} Sep 10 18:00:06.480544 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:06.480501 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 18:00:06.480739 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:06.480716 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-x84kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Sep 10 18:00:06.480832 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:06.480762 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" podUID="8fa59f79-b12e-420c-a003-90034472f95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Sep 10 18:00:07.379830 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:07.379798 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b958dd778-m8nld" Sep 10 18:00:07.480686 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:07.480646 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-x84kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Sep 10 18:00:07.481123 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:07.480715 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" podUID="8fa59f79-b12e-420c-a003-90034472f95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Sep 10 18:00:08.481918 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:08.481569 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-x84kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Sep 10 18:00:08.481918 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:08.481621 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" podUID="8fa59f79-b12e-420c-a003-90034472f95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Sep 10 18:00:09.480552 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:09.480516 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-x84kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Sep 10 18:00:09.480727 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:09.480572 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" podUID="8fa59f79-b12e-420c-a003-90034472f95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Sep 10 18:00:10.480581 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:10.480541 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-x84kb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body= Sep 10 18:00:10.480987 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:10.480609 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" podUID="8fa59f79-b12e-420c-a003-90034472f95a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" Sep 10 18:00:11.484190 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:11.484160 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 18:00:11.484636 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:11.484419 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 18:00:11.485127 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:11.485107 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-x84kb" Sep 10 18:00:12.371002 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:12.370970 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-s9wpc" Sep 10 18:00:42.110200 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.110164 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2"] Sep 10 18:00:42.115454 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.115434 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.117781 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.117759 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 18:00:42.118436 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.118420 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 18:00:42.118520 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.118479 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8kpr5\"" Sep 10 18:00:42.118569 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.118527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Sep 10 18:00:42.124121 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.124098 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2"] Sep 10 18:00:42.281226 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.281196 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7prc\" (UniqueName: \"kubernetes.io/projected/51b1071f-25c7-43ee-988c-7d9c3640eb1a-kube-api-access-t7prc\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.281408 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.281250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51b1071f-25c7-43ee-988c-7d9c3640eb1a-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.281408 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.281272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.281408 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.281372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.281408 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.281399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.281544 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.281437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.382614 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.382535 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7prc\" (UniqueName: \"kubernetes.io/projected/51b1071f-25c7-43ee-988c-7d9c3640eb1a-kube-api-access-t7prc\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.382614 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.382592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51b1071f-25c7-43ee-988c-7d9c3640eb1a-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.382853 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.382622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.382853 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.382645 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.382853 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.382660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.382853 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.382833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.383066 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.383018 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-home\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.383126 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.383107 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-model-cache\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.383171 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.383134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.384916 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.384894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51b1071f-25c7-43ee-988c-7d9c3640eb1a-dshm\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.385114 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.385094 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51b1071f-25c7-43ee-988c-7d9c3640eb1a-tls-certs\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.391372 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.391348 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7prc\" (UniqueName: \"kubernetes.io/projected/51b1071f-25c7-43ee-988c-7d9c3640eb1a-kube-api-access-t7prc\") pod \"e2e-distinct-simulated-kserve-6685d86975-ft5z2\" (UID: \"51b1071f-25c7-43ee-988c-7d9c3640eb1a\") " pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.425969 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.425939 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:42.694928 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:42.694898 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2"] Sep 10 18:00:42.697479 ip-10-0-133-48 kubenswrapper[2556]: W0910 18:00:42.697435 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b1071f_25c7_43ee_988c_7d9c3640eb1a.slice/crio-2b7289546ed995b1d683d2da45b537d3ee2d79e1ca44bc939b69e28cf31e740b WatchSource:0}: Error finding container 2b7289546ed995b1d683d2da45b537d3ee2d79e1ca44bc939b69e28cf31e740b: Status 404 returned error can't find the container with id 2b7289546ed995b1d683d2da45b537d3ee2d79e1ca44bc939b69e28cf31e740b Sep 10 18:00:43.560666 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:43.560617 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerStarted","Data":"2b7289546ed995b1d683d2da45b537d3ee2d79e1ca44bc939b69e28cf31e740b"} Sep 10 18:00:44.566497 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:44.566460 2556 generic.go:356] "Generic (PLEG): container finished" podID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerID="0ee955d1b000d6857bd409c2129503858206b34814c8d6ea1bc270d52f6a4d99" exitCode=0 Sep 10 18:00:44.566897 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:44.566546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerDied","Data":"0ee955d1b000d6857bd409c2129503858206b34814c8d6ea1bc270d52f6a4d99"} Sep 10 18:00:44.566897 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:44.566730 2556 scope.go:117] "RemoveContainer" containerID="0ee955d1b000d6857bd409c2129503858206b34814c8d6ea1bc270d52f6a4d99" Sep 10 18:00:45.573546 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:45.573512 2556 generic.go:356] "Generic (PLEG): container finished" podID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerID="b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26" exitCode=0 Sep 10 18:00:45.573905 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:45.573553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerDied","Data":"b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26"} Sep 10 18:00:45.573905 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:45.573599 2556 scope.go:117] "RemoveContainer" containerID="0ee955d1b000d6857bd409c2129503858206b34814c8d6ea1bc270d52f6a4d99" Sep 10 18:00:45.573905 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:45.573819 2556 scope.go:117] "RemoveContainer" containerID="b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26" Sep 10 18:00:45.574035 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:00:45.573989 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:00:46.579668 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:46.579642 2556 scope.go:117] "RemoveContainer" containerID="b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26" Sep 10 18:00:46.580042 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:00:46.579811 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:00:52.426940 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:52.426908 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:52.427448 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:52.426971 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:52.427448 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:52.426987 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:52.427448 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:52.426999 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:00:52.427448 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:00:52.427366 2556 scope.go:117] "RemoveContainer" containerID="b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26" Sep 10 18:00:52.427597 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:00:52.427539 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:01:03.698014 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:03.697985 2556 scope.go:117] "RemoveContainer" containerID="b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26" Sep 10 18:01:04.657544 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:04.657512 2556 generic.go:356] "Generic (PLEG): container finished" podID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerID="89c55d4c16685d19c39b450bb547ad71a000d32b869fb7c947c1855c7d9c1f15" exitCode=0 Sep 10 18:01:04.657699 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:04.657551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerDied","Data":"89c55d4c16685d19c39b450bb547ad71a000d32b869fb7c947c1855c7d9c1f15"} Sep 10 18:01:04.657699 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:04.657601 2556 scope.go:117] "RemoveContainer" containerID="b5c204cd7d5cf54b43f8168111bde880842ddde6143be5e5d9fe2052f0729c26" Sep 10 18:01:04.658015 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:04.657998 2556 scope.go:117] "RemoveContainer" containerID="89c55d4c16685d19c39b450bb547ad71a000d32b869fb7c947c1855c7d9c1f15" Sep 10 18:01:04.658233 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:04.658212 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:01:12.426482 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:12.426443 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:12.426876 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:12.426504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:12.426876 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:12.426521 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:12.426876 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:12.426535 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:12.426876 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:12.426869 2556 scope.go:117] "RemoveContainer" containerID="89c55d4c16685d19c39b450bb547ad71a000d32b869fb7c947c1855c7d9c1f15" Sep 10 18:01:12.427043 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:12.427025 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:01:24.703080 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:24.703014 2556 scope.go:117] "RemoveContainer" containerID="89c55d4c16685d19c39b450bb547ad71a000d32b869fb7c947c1855c7d9c1f15" Sep 10 18:01:25.752748 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:25.752712 2556 generic.go:356] "Generic (PLEG): container finished" podID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" exitCode=0 Sep 10 18:01:25.753165 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:25.752762 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerDied","Data":"4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce"} Sep 10 18:01:25.753165 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:25.752808 2556 scope.go:117] "RemoveContainer" containerID="89c55d4c16685d19c39b450bb547ad71a000d32b869fb7c947c1855c7d9c1f15" Sep 10 18:01:25.753242 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:25.753194 2556 scope.go:117] "RemoveContainer" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" Sep 10 18:01:25.753459 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:25.753435 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:01:32.427069 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:32.427020 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:32.427501 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:32.427090 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:32.427501 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:32.427108 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:32.427501 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:32.427122 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:01:32.427501 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:32.427472 2556 scope.go:117] "RemoveContainer" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" Sep 10 18:01:32.427659 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:32.427641 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:01:40.614369 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.614330 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x"] Sep 10 18:01:40.621114 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.621085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.623565 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.623539 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 18:01:40.628627 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.628604 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x"] Sep 10 18:01:40.687609 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.687519 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.687609 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.687595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.687859 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.687633 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b11522-4186-4cf4-91e8-3cb4a2b7361f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.687859 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.687669 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.687859 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.687715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.687859 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.687774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4fr7\" (UniqueName: \"kubernetes.io/projected/34b11522-4186-4cf4-91e8-3cb4a2b7361f-kube-api-access-n4fr7\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.788626 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.788576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.788795 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.788642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4fr7\" (UniqueName: \"kubernetes.io/projected/34b11522-4186-4cf4-91e8-3cb4a2b7361f-kube-api-access-n4fr7\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.788795 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.788736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.788795 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.788781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.788948 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.788820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b11522-4186-4cf4-91e8-3cb4a2b7361f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.788948 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.788849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.789095 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.789067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.789426 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.789406 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.789539 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.789444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.792126 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.792099 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b11522-4186-4cf4-91e8-3cb4a2b7361f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.792573 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.792542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b11522-4186-4cf4-91e8-3cb4a2b7361f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.796255 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.796229 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4fr7\" (UniqueName: \"kubernetes.io/projected/34b11522-4186-4cf4-91e8-3cb4a2b7361f-kube-api-access-n4fr7\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-dk58x\" (UID: \"34b11522-4186-4cf4-91e8-3cb4a2b7361f\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:40.931266 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:40.931176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:41.199687 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:41.199606 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x"] Sep 10 18:01:41.202592 ip-10-0-133-48 kubenswrapper[2556]: W0910 18:01:41.202560 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34b11522_4186_4cf4_91e8_3cb4a2b7361f.slice/crio-d0d7e034fcd7f430cde3405fbd772b5b6e4a1ad43dec877f0c9e2738e6987726 WatchSource:0}: Error finding container d0d7e034fcd7f430cde3405fbd772b5b6e4a1ad43dec877f0c9e2738e6987726: Status 404 returned error can't find the container with id d0d7e034fcd7f430cde3405fbd772b5b6e4a1ad43dec877f0c9e2738e6987726 Sep 10 18:01:41.821460 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:41.821426 2556 generic.go:356] "Generic (PLEG): container finished" podID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" containerID="0bd981f1c49cb0421ddff52c2418e77147b9ef582fea88078c7a9bd8ce318599" exitCode=0 Sep 10 18:01:41.821842 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:41.821505 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerDied","Data":"0bd981f1c49cb0421ddff52c2418e77147b9ef582fea88078c7a9bd8ce318599"} Sep 10 18:01:41.821842 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:41.821535 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerStarted","Data":"d0d7e034fcd7f430cde3405fbd772b5b6e4a1ad43dec877f0c9e2738e6987726"} Sep 10 18:01:41.821842 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:41.821719 2556 scope.go:117] "RemoveContainer" containerID="0bd981f1c49cb0421ddff52c2418e77147b9ef582fea88078c7a9bd8ce318599" Sep 10 18:01:42.827533 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:42.827496 2556 generic.go:356] "Generic (PLEG): container finished" podID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" exitCode=0 Sep 10 18:01:42.827982 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:42.827537 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerDied","Data":"729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488"} Sep 10 18:01:42.827982 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:42.827587 2556 scope.go:117] "RemoveContainer" containerID="0bd981f1c49cb0421ddff52c2418e77147b9ef582fea88078c7a9bd8ce318599" Sep 10 18:01:42.827982 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:42.827846 2556 scope.go:117] "RemoveContainer" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" Sep 10 18:01:42.828093 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:42.828076 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:01:43.834293 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:43.834267 2556 scope.go:117] "RemoveContainer" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" Sep 10 18:01:43.834758 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:43.834514 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:01:45.698558 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:45.698527 2556 scope.go:117] "RemoveContainer" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" Sep 10 18:01:45.698999 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:45.698775 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:01:50.932035 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:50.931999 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:50.932035 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:50.932043 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:50.932538 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:50.932055 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:50.932538 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:50.932065 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:01:50.932538 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:50.932428 2556 scope.go:117] "RemoveContainer" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" Sep 10 18:01:50.932632 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:50.932580 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:01:51.867791 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:51.867763 2556 scope.go:117] "RemoveContainer" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" Sep 10 18:01:51.867958 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:51.867932 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:01:57.698563 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:01:57.698531 2556 scope.go:117] "RemoveContainer" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" Sep 10 18:01:57.698934 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:01:57.698715 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:02:05.698321 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:05.698293 2556 scope.go:117] "RemoveContainer" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" Sep 10 18:02:06.938641 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:06.938605 2556 generic.go:356] "Generic (PLEG): container finished" podID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" containerID="41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62" exitCode=0 Sep 10 18:02:06.939029 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:06.938677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerDied","Data":"41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62"} Sep 10 18:02:06.939029 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:06.938737 2556 scope.go:117] "RemoveContainer" containerID="729e316b90b86ffa239b51a0042ea25e0ed82e056acacdb8734380f234e0f488" Sep 10 18:02:06.939138 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:06.939056 2556 scope.go:117] "RemoveContainer" containerID="41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62" Sep 10 18:02:06.939234 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:06.939214 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:02:10.931936 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:10.931901 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:10.932360 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:10.931950 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:10.932360 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:10.931965 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:10.932360 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:10.931974 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:10.932360 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:10.932342 2556 scope.go:117] "RemoveContainer" containerID="41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62" Sep 10 18:02:10.932511 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:10.932492 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:02:11.698237 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:11.698207 2556 scope.go:117] "RemoveContainer" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" Sep 10 18:02:11.966794 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:11.966766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerStarted","Data":"77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74"} Sep 10 18:02:11.984392 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:11.984345 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podStartSLOduration=87.673468874 podStartE2EDuration="1m29.984325232s" totalImagesPullingTime="2.310856358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 18:00:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:02:11.982469703 +0000 UTC m=+1123.745103431" watchObservedRunningTime="2026-09-10 18:02:11.984325232 +0000 UTC m=+1123.746958952" Sep 10 18:02:12.426130 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.426099 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:02:12.426305 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.426181 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:02:12.427500 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.427477 2556 prober.go:120] "Probe failed" probeType="Startup" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerName="main" probeResult="failure" output="Get \"https://10.134.0.33:8000/health\": dial tcp 10.134.0.33:8000: connect: connection refused" Sep 10 18:02:12.972193 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.972156 2556 generic.go:356] "Generic (PLEG): container finished" podID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" exitCode=0 Sep 10 18:02:12.972664 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.972196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerDied","Data":"77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74"} Sep 10 18:02:12.972664 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.972254 2556 scope.go:117] "RemoveContainer" containerID="4ad705e50cb1d3217374b1373dd082b37c30b70c1939ec3830d1dd0396bb01ce" Sep 10 18:02:12.972664 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:12.972526 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:02:12.972891 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:12.972730 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:02:13.978717 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:13.978688 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:02:13.979077 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:13.978873 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:02:22.426196 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:22.426155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:02:22.426663 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:22.426256 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:02:22.426705 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:22.426680 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:02:22.426883 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:22.426863 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:02:25.697840 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:25.697810 2556 scope.go:117] "RemoveContainer" containerID="41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62" Sep 10 18:02:25.698207 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:25.697967 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:02:35.698177 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:35.698150 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:02:35.698573 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:35.698307 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:02:38.699980 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:38.699944 2556 scope.go:117] "RemoveContainer" containerID="41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62" Sep 10 18:02:39.095442 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:39.095414 2556 generic.go:356] "Generic (PLEG): container finished" podID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" exitCode=0 Sep 10 18:02:39.095547 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:39.095491 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerDied","Data":"a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a"} Sep 10 18:02:39.095611 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:39.095546 2556 scope.go:117] "RemoveContainer" containerID="41349f9f93e32d259f8b9430a65d8671e762212201243ecbf9b56b7b40dcaf62" Sep 10 18:02:39.095868 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:39.095849 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:02:39.096041 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:39.096019 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:02:40.931793 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:40.931762 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:40.931793 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:40.931802 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:40.932288 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:40.931813 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:40.932288 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:40.931822 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:02:40.932288 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:40.932076 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:02:40.932288 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:40.932211 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:02:47.698172 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:47.698135 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:02:47.698569 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:47.698286 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:02:54.697811 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:02:54.697726 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:02:54.698379 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:02:54.697901 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:03:01.698425 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:01.698395 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:03:01.698794 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:01.698560 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:03:06.697721 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:06.697691 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:03:06.698094 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:06.697853 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:03:14.698464 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:14.698425 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:03:14.698986 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:14.698595 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:03:18.699766 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:18.699735 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:03:18.700165 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:18.699900 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:03:26.698036 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:26.697999 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:03:26.698629 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:26.698170 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:03:28.645526 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:28.645495 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 18:03:28.645899 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:28.645850 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zm6wj_bb1858c8-9d35-47e5-ad6c-3600ba1c2d27/ovn-acl-logging/0.log" Sep 10 18:03:31.698532 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:31.698505 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:03:31.698903 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:31.698750 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 18:03:32.323742 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:32.323709 2556 generic.go:356] "Generic (PLEG): container finished" podID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" exitCode=0 Sep 10 18:03:32.324022 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:32.323790 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerDied","Data":"70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631"} Sep 10 18:03:32.324022 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:32.323853 2556 scope.go:117] "RemoveContainer" containerID="a62ca8d2ed3684270a9ec01b5fd2fa0e9cc5dc7c61f65f785a0f223031b7250a" Sep 10 18:03:32.324233 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:32.324211 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:03:32.324437 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:32.324413 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:03:37.698027 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:37.697996 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:03:38.351923 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:38.351895 2556 generic.go:356] "Generic (PLEG): container finished" podID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" exitCode=0 Sep 10 18:03:38.352098 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:38.351967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" event={"ID":"51b1071f-25c7-43ee-988c-7d9c3640eb1a","Type":"ContainerDied","Data":"c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11"} Sep 10 18:03:38.352098 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:38.352026 2556 scope.go:117] "RemoveContainer" containerID="77881a9acf9e97309d331e48b5d71f45e445af5ec83522fca05dd825ad6c2b74" Sep 10 18:03:38.352385 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:38.352368 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:03:38.352575 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:38.352553 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:03:40.931325 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:40.931277 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:03:40.931714 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:40.931336 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:03:40.931714 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:40.931350 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:03:40.931714 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:40.931358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:03:40.931714 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:40.931651 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:03:40.931848 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:40.931797 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:03:42.426059 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:42.426026 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:03:42.426445 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:42.426082 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:03:42.426445 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:42.426098 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:03:42.426445 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:42.426111 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" Sep 10 18:03:42.426572 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:42.426455 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:03:42.426635 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:42.426616 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:03:52.704686 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:52.704657 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:03:52.705573 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:52.705531 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:03:56.698524 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:03:56.698484 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:03:56.698984 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:03:56.698701 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:04:06.697981 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:06.697944 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:04:06.698562 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:06.698200 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:04:11.698605 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:11.698574 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:04:11.698976 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:11.698755 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:04:20.698545 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:20.698514 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:04:20.698944 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:20.698672 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:04:25.698653 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:25.698615 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:04:25.699036 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:25.698766 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:04:32.697961 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:32.697920 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:04:32.698450 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:32.698127 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:04:37.698042 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:37.698009 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:04:37.698503 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:37.698177 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:04:46.697902 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:46.697868 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:04:46.698337 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:46.698045 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:04:48.704020 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:04:48.703993 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:04:48.704440 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:04:48.704147 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:00.698237 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:00.698206 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:05:00.698985 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:00.698931 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:05:01.698223 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:01.698195 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:05:02.718414 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:02.718376 2556 generic.go:356] "Generic (PLEG): container finished" podID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" exitCode=0 Sep 10 18:05:02.718832 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:02.718448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" event={"ID":"34b11522-4186-4cf4-91e8-3cb4a2b7361f","Type":"ContainerDied","Data":"3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0"} Sep 10 18:05:02.718832 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:02.718496 2556 scope.go:117] "RemoveContainer" containerID="70e905cb0de533e5f1f7b639687d541630649f2f359ac380bcb9cc8f85570631" Sep 10 18:05:02.718929 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:02.718834 2556 scope.go:117] "RemoveContainer" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" Sep 10 18:05:02.719027 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:02.719008 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:10.932008 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:10.931964 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:05:10.932008 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:10.932011 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:05:10.932008 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:10.932022 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:05:10.934129 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:10.932032 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" Sep 10 18:05:10.934129 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:10.932412 2556 scope.go:117] "RemoveContainer" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" Sep 10 18:05:10.934129 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:10.932576 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:11.698444 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:11.698408 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:05:11.698619 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:11.698588 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:05:11.759775 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:11.759741 2556 scope.go:117] "RemoveContainer" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" Sep 10 18:05:11.760010 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:11.759982 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:18.315634 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:18.315605 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c45c7_2e187b87-85e3-4e18-a258-eb95ac7dbe57/manager/0.log" Sep 10 18:05:18.460238 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:18.460206 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54966db754-4fgj6_4bbf65c1-7046-4f7d-b844-5a8848a528af/manager/0.log" Sep 10 18:05:19.051670 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:19.051641 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-qlzns_c9ba18d1-e301-4011-9c4c-9dba77aafbbe/copy-manifests/0.log" Sep 10 18:05:19.058031 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:19.057994 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-qlzns_c9ba18d1-e301-4011-9c4c-9dba77aafbbe/manager/0.log" Sep 10 18:05:19.397818 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:19.397719 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b958dd778-m8nld_1b4148b4-725f-4a9a-b3cf-40ba547f0afd/maas-api/0.log" Sep 10 18:05:19.507966 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:19.507941 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zbcdh_a8a38edf-ed27-464d-b94b-44cd1c4c8af1/postgres/0.log" Sep 10 18:05:20.759047 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:20.759016 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-zbx8k_cb23742d-6603-4ac5-b233-4248f1f3bc2f/manager/0.log" Sep 10 18:05:21.353569 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:21.353535 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b_47de2584-fc5d-4675-9e65-81a40904490c/istio-proxy/0.log" Sep 10 18:05:21.475698 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:21.475658 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lrz26_b5bf3705-c5e2-4ada-9324-f26bdede0a10/discovery/0.log" Sep 10 18:05:21.587919 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:21.587882 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d767bb89-54d2s_2ca543ea-75ec-4958-9642-c9b86b82d2ae/kube-auth-proxy/0.log" Sep 10 18:05:21.824182 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:21.824150 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/1.log" Sep 10 18:05:22.052069 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:22.052038 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s9wpc_8c97e649-25df-4e91-9be6-ea69919e40b3/payload-processing/0.log" Sep 10 18:05:22.625002 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:22.624970 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-6685d86975-ft5z2_51b1071f-25c7-43ee-988c-7d9c3640eb1a/main/5.log" Sep 10 18:05:23.209187 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:23.209159 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_34b11522-4186-4cf4-91e8-3cb4a2b7361f/main/5.log" Sep 10 18:05:24.698847 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:24.698802 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:05:24.699245 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:24.699076 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:05:26.698464 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:26.698432 2556 scope.go:117] "RemoveContainer" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" Sep 10 18:05:26.698850 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:26.698617 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:30.921146 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:30.921107 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-24jdb_4e23ec36-d3bb-4df9-9f81-bd2b06ab0c42/global-pull-secret-syncer/0.log" Sep 10 18:05:31.069512 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:31.069474 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q4trf_7f900183-c252-4234-97fc-2cbbacf276be/konnectivity-agent/0.log" Sep 10 18:05:31.143218 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:31.143185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-48.ec2.internal_13f9881a5f465bf70dd944de0203fca5/haproxy/0.log" Sep 10 18:05:35.963508 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:35.963474 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-zbx8k_cb23742d-6603-4ac5-b233-4248f1f3bc2f/manager/0.log" Sep 10 18:05:37.698335 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:37.698287 2556 scope.go:117] "RemoveContainer" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" Sep 10 18:05:37.698845 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:37.698539 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:37.799272 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:37.799241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-694dd7b5c7-rrd4r_cc10fbce-3f8b-48cd-825e-5d821c3d03da/metrics-server/0.log" Sep 10 18:05:37.928454 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:37.928423 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhlbc_8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932/node-exporter/0.log" Sep 10 18:05:37.947222 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:37.947195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhlbc_8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932/kube-rbac-proxy/0.log" Sep 10 18:05:37.966263 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:37.966177 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hhlbc_8f33aed3-5164-4cfe-b5cf-f2d0ce5b7932/init-textfile/0.log" Sep 10 18:05:38.703028 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:38.702991 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:05:38.705237 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:38.705199 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:05:41.155928 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.155889 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf"] Sep 10 18:05:41.158333 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.158285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.160544 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.160520 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cj7qw\"/\"kube-root-ca.crt\"" Sep 10 18:05:41.161452 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.161431 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cj7qw\"/\"default-dockercfg-tz6hl\"" Sep 10 18:05:41.161581 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.161454 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cj7qw\"/\"openshift-service-ca.crt\"" Sep 10 18:05:41.170081 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.170052 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf"] Sep 10 18:05:41.263889 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.263846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-podres\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.264078 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.263969 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jjs6\" (UniqueName: \"kubernetes.io/projected/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-kube-api-access-6jjs6\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.264078 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.264005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-sys\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.264078 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.264027 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-lib-modules\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.264227 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.264102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-proc\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.323122 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.323088 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f6f59f84b-4f4zp_ed3a80bb-d12d-4453-a491-ce0501ad31d9/console/0.log" Sep 10 18:05:41.365121 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jjs6\" (UniqueName: \"kubernetes.io/projected/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-kube-api-access-6jjs6\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365287 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-sys\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365287 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-lib-modules\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365287 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-proc\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365287 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-sys\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365287 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365256 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-podres\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365489 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365332 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-proc\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365489 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365403 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-lib-modules\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.365489 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.365416 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-podres\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.372252 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.372230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jjs6\" (UniqueName: \"kubernetes.io/projected/575b07c3-3a7a-4435-bf1e-5c31af06e3ca-kube-api-access-6jjs6\") pod \"perf-node-gather-daemonset-gpgqf\" (UID: \"575b07c3-3a7a-4435-bf1e-5c31af06e3ca\") " pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.468277 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.468187 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.738947 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.738868 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf"] Sep 10 18:05:41.742062 ip-10-0-133-48 kubenswrapper[2556]: W0910 18:05:41.742027 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod575b07c3_3a7a_4435_bf1e_5c31af06e3ca.slice/crio-4ff49188ed8a177c696836d4aeb1bbc86c31f6b98cac7193d8af29cc4903026a WatchSource:0}: Error finding container 4ff49188ed8a177c696836d4aeb1bbc86c31f6b98cac7193d8af29cc4903026a: Status 404 returned error can't find the container with id 4ff49188ed8a177c696836d4aeb1bbc86c31f6b98cac7193d8af29cc4903026a Sep 10 18:05:41.896304 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.896272 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" event={"ID":"575b07c3-3a7a-4435-bf1e-5c31af06e3ca","Type":"ContainerStarted","Data":"ffce6b0719f2a0eb2dcd8d40cc38f231660eff6764aa75d2998a18e0a948247d"} Sep 10 18:05:41.896483 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.896344 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" event={"ID":"575b07c3-3a7a-4435-bf1e-5c31af06e3ca","Type":"ContainerStarted","Data":"4ff49188ed8a177c696836d4aeb1bbc86c31f6b98cac7193d8af29cc4903026a"} Sep 10 18:05:41.896483 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.896373 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:41.912920 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:41.912868 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" podStartSLOduration=0.912851952 podStartE2EDuration="912.851952ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 18:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 18:05:41.91100518 +0000 UTC m=+1333.673638913" watchObservedRunningTime="2026-09-10 18:05:41.912851952 +0000 UTC m=+1333.675485681" Sep 10 18:05:43.104568 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:43.104529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rkbd7_e72f3c57-cd6d-4074-8578-b8bffdbfa84f/dns/0.log" Sep 10 18:05:43.123957 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:43.123928 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rkbd7_e72f3c57-cd6d-4074-8578-b8bffdbfa84f/kube-rbac-proxy/0.log" Sep 10 18:05:43.147780 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:43.147752 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-285vv_8ecd69d9-0430-480b-b42b-1df45691e6dd/dns-node-resolver/0.log" Sep 10 18:05:43.718740 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:43.718711 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-795d4d8598-d9x96_bca68580-beed-4e2e-a5fc-aaca49b02c8e/registry/0.log" Sep 10 18:05:43.735366 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:43.735306 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2s2ss_2980f6c2-7fa3-45b6-8b07-171d49df27a8/node-ca/0.log" Sep 10 18:05:44.668148 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:44.668118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b_47de2584-fc5d-4675-9e65-81a40904490c/istio-proxy/0.log" Sep 10 18:05:44.736142 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:44.736108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lrz26_b5bf3705-c5e2-4ada-9324-f26bdede0a10/discovery/0.log" Sep 10 18:05:44.754654 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:44.754622 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d767bb89-54d2s_2ca543ea-75ec-4958-9642-c9b86b82d2ae/kube-auth-proxy/0.log" Sep 10 18:05:44.802079 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:44.802047 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/1.log" Sep 10 18:05:44.802541 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:44.802513 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/0.log" Sep 10 18:05:44.841509 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:44.841478 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s9wpc_8c97e649-25df-4e91-9be6-ea69919e40b3/payload-processing/0.log" Sep 10 18:05:45.470648 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:45.470613 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2jhzs_89dca1b9-b3b0-41ad-b08b-ffc1ee7b8bee/serve-healthcheck-canary/0.log" Sep 10 18:05:46.109001 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:46.108968 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlkmv_ea0ad978-dc33-4bd3-800b-d3fdc34a85f0/kube-rbac-proxy/0.log" Sep 10 18:05:46.126535 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:46.126504 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlkmv_ea0ad978-dc33-4bd3-800b-d3fdc34a85f0/exporter/0.log" Sep 10 18:05:46.145180 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:46.145140 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vlkmv_ea0ad978-dc33-4bd3-800b-d3fdc34a85f0/extractor/0.log" Sep 10 18:05:47.911133 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:47.911107 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cj7qw/perf-node-gather-daemonset-gpgqf" Sep 10 18:05:48.259693 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:48.259662 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c45c7_2e187b87-85e3-4e18-a258-eb95ac7dbe57/manager/0.log" Sep 10 18:05:48.295929 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:48.295899 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54966db754-4fgj6_4bbf65c1-7046-4f7d-b844-5a8848a528af/manager/0.log" Sep 10 18:05:48.516188 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:48.516099 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-qlzns_c9ba18d1-e301-4011-9c4c-9dba77aafbbe/manager/0.log" Sep 10 18:05:48.537016 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:48.536984 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86cbcccc5-qlzns_c9ba18d1-e301-4011-9c4c-9dba77aafbbe/copy-manifests/0.log" Sep 10 18:05:48.699654 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:48.699626 2556 scope.go:117] "RemoveContainer" containerID="3a9c9ec80497eb37c9543a17463d89d1ae85c65bb5c879a01281b43b30194ab0" Sep 10 18:05:48.699834 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:48.699815 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-dk58x_llm(34b11522-4186-4cf4-91e8-3cb4a2b7361f)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-dk58x" podUID="34b11522-4186-4cf4-91e8-3cb4a2b7361f" Sep 10 18:05:51.853494 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:51.853454 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b_47de2584-fc5d-4675-9e65-81a40904490c/istio-proxy/0.log" Sep 10 18:05:51.912021 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:51.911982 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lrz26_b5bf3705-c5e2-4ada-9324-f26bdede0a10/discovery/0.log" Sep 10 18:05:51.925838 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:51.925811 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d767bb89-54d2s_2ca543ea-75ec-4958-9642-c9b86b82d2ae/kube-auth-proxy/0.log" Sep 10 18:05:51.961918 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:51.961861 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/1.log" Sep 10 18:05:51.962346 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:51.962305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/0.log" Sep 10 18:05:51.993379 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:51.993348 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s9wpc_8c97e649-25df-4e91-9be6-ea69919e40b3/payload-processing/0.log" Sep 10 18:05:52.698442 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:52.698408 2556 scope.go:117] "RemoveContainer" containerID="c0d0db7829d456c4b91f9e0a63ad6f3f4e541a94c19197998d66870d22ef3b11" Sep 10 18:05:52.698624 ip-10-0-133-48 kubenswrapper[2556]: E0910 18:05:52.698597 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-simulated-kserve-6685d86975-ft5z2_llm(51b1071f-25c7-43ee-988c-7d9c3640eb1a)\"" pod="llm/e2e-distinct-simulated-kserve-6685d86975-ft5z2" podUID="51b1071f-25c7-43ee-988c-7d9c3640eb1a" Sep 10 18:05:53.106508 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:53.106459 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7fx6b_47de2584-fc5d-4675-9e65-81a40904490c/istio-proxy/0.log" Sep 10 18:05:53.172052 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:53.172011 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-lrz26_b5bf3705-c5e2-4ada-9324-f26bdede0a10/discovery/0.log" Sep 10 18:05:53.192604 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:53.192574 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d767bb89-54d2s_2ca543ea-75ec-4958-9642-c9b86b82d2ae/kube-auth-proxy/0.log" Sep 10 18:05:53.236475 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:53.236439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/1.log" Sep 10 18:05:53.236941 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:53.236917 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-x84kb_8fa59f79-b12e-420c-a003-90034472f95a/istio-proxy/0.log" Sep 10 18:05:53.267619 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:53.267590 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-s9wpc_8c97e649-25df-4e91-9be6-ea69919e40b3/payload-processing/0.log" Sep 10 18:05:56.622827 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.622749 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/kube-multus-additional-cni-plugins/0.log" Sep 10 18:05:56.650630 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.650602 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/egress-router-binary-copy/0.log" Sep 10 18:05:56.675605 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.675575 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/cni-plugins/0.log" Sep 10 18:05:56.701729 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.701684 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/bond-cni-plugin/0.log" Sep 10 18:05:56.725877 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.725836 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/routeoverride-cni/0.log" Sep 10 18:05:56.748006 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.747972 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/whereabouts-cni-bincopy/0.log" Sep 10 18:05:56.771406 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:56.771376 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nm9xn_7c85c379-4698-4655-95b4-00bf684c0be3/whereabouts-cni/0.log" Sep 10 18:05:57.193674 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:57.193642 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gdkm5_ad3e8332-c705-42e4-971e-ed77dc7a9abb/kube-multus/0.log" Sep 10 18:05:57.264795 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:57.264759 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8pt67_fc6972a6-3eda-4e40-85e0-38453961b03b/network-metrics-daemon/0.log" Sep 10 18:05:57.290795 ip-10-0-133-48 kubenswrapper[2556]: I0910 18:05:57.290751 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8pt67_fc6972a6-3eda-4e40-85e0-38453961b03b/kube-rbac-proxy/0.log"