Nov 03 22:48:04.335592 ip-10-0-128-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 03 22:48:04.335607 ip-10-0-128-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 03 22:48:04.335616 ip-10-0-128-124 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 03 22:48:04.335966 ip-10-0-128-124 systemd[1]: Failed to start Kubernetes Kubelet. Nov 03 22:48:14.377102 ip-10-0-128-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 03 22:48:14.377125 ip-10-0-128-124 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eb31a8c9c1f24287b7cce9cf39dcfae7 -- Nov 03 22:50:24.170879 ip-10-0-128-124 systemd[1]: Starting Kubernetes Kubelet... Nov 03 22:50:24.577589 ip-10-0-128-124 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:50:24.577589 ip-10-0-128-124 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 22:50:24.577589 ip-10-0-128-124 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:50:24.577589 ip-10-0-128-124 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:50:24.581219 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581105 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.581219 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581219 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.581219 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581223 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581227 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581230 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581233 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581235 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581238 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581241 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581244 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581246 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581249 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581251 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581254 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581256 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581259 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581262 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581265 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581267 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581270 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581272 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581275 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.581314 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581277 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581283 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581286 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581288 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581293 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581296 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581298 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581301 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581304 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581306 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581309 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581311 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581313 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581317 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581320 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581323 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581326 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581329 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581332 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581334 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.581802 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581337 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581339 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581342 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581353 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581357 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581360 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581362 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581365 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581367 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581370 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581373 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581375 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581378 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581380 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581384 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581386 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581389 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581392 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581394 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.582274 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581397 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581399 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581402 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581405 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581407 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581411 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581414 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581417 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581419 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581422 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581427 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581430 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581433 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581436 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581439 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581441 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581444 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581446 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581449 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581453 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.582760 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581456 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581458 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581461 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581463 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581465 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581468 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581470 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581473 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581476 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581478 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581481 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581483 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581486 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581489 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581492 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581494 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581497 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581501 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581507 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.583247 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581510 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581512 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581515 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581518 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581521 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.581523 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582408 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582416 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582420 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582423 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582426 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582428 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582431 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582434 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582437 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582440 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582444 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582447 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582450 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.583734 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582453 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582456 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582459 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582461 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582464 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582467 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582469 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582472 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582475 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582477 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582480 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582484 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582488 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582491 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582494 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582497 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582499 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582502 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582505 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.584217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582507 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582510 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582512 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582515 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582518 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582520 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582523 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582525 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582528 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582531 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582534 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582536 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582539 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582542 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582545 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582548 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582551 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582553 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582556 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582559 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.584685 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582561 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582563 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582581 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582584 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582587 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582590 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582593 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582595 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582598 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582600 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582603 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582605 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582608 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582610 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582613 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582615 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582618 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582620 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582623 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.585162 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582625 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582628 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582631 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582634 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582637 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582639 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582642 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582644 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582649 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582652 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582655 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582657 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582661 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582663 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582666 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582669 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582671 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582674 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582677 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582679 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.585668 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582682 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582685 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582687 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582690 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582692 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582695 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582697 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582700 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582702 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582705 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582707 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582711 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582713 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582718 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.582721 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583278 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583286 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583289 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583293 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.586160 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583296 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583298 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583301 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583303 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583306 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583308 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583311 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583314 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583316 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583319 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583321 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583324 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583326 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583329 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583332 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583334 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583336 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583339 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583342 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.586622 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583344 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583347 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583349 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583352 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583354 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583357 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583359 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583363 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583365 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583370 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583373 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583376 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583379 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583382 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583384 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583386 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583389 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583391 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583394 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.587072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583396 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583399 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583401 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583404 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583406 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583409 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583411 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583413 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583416 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583418 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583421 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583423 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583426 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583428 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583431 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583433 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583435 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583438 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583440 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583443 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.587539 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583446 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583449 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583451 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583457 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583460 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583463 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583465 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583468 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583471 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583474 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583476 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583478 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583481 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583484 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583486 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583488 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583491 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583493 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583496 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583498 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.588035 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583501 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583504 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583506 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583509 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583511 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583514 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583516 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583519 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583521 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583523 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583526 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583528 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583534 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583537 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583539 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583542 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583545 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583547 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583550 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583552 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.588501 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583555 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583557 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583560 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.583564 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583668 2578 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583676 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583682 2578 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583688 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583693 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583696 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583701 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583705 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583708 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583711 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583715 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583718 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583722 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583725 2578 flags.go:64] FLAG: --cgroup-root="" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583728 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583731 2578 flags.go:64] FLAG: --client-ca-file="" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583734 2578 flags.go:64] FLAG: --cloud-provider="external" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583738 2578 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583744 2578 flags.go:64] FLAG: --cluster-domain="" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583747 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 22:50:24.589000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583752 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583755 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583759 2578 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583763 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583766 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583769 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583773 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583776 2578 flags.go:64] FLAG: --contention-profiling="false" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583779 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583782 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583785 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583788 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583793 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583796 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583799 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583802 2578 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583805 2578 flags.go:64] FLAG: --enable-server="true" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583808 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583812 2578 flags.go:64] FLAG: --event-burst="100" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583815 2578 flags.go:64] FLAG: --event-qps="50" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583818 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583821 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583824 2578 flags.go:64] FLAG: --eviction-hard="" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583828 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 22:50:24.589582 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583831 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583834 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583837 2578 flags.go:64] FLAG: --eviction-soft="" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583840 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583843 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583846 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583849 2578 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583854 2578 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583858 2578 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583861 2578 flags.go:64] FLAG: --feature-gates="" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583865 2578 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583869 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583872 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583875 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583878 2578 flags.go:64] FLAG: --healthz-port="10248" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583882 2578 flags.go:64] FLAG: --help="false" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583885 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583888 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583891 2578 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583894 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583897 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583901 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583903 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 22:50:24.590226 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583906 2578 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583909 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583912 2578 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583915 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583918 2578 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583922 2578 flags.go:64] FLAG: --kube-reserved="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583925 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583927 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583931 2578 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583933 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583936 2578 flags.go:64] FLAG: --lock-file="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583939 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583942 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583945 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583951 2578 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583954 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583961 2578 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583967 2578 flags.go:64] FLAG: --logging-format="text" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583969 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583973 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583976 2578 flags.go:64] FLAG: --manifest-url="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583979 2578 flags.go:64] FLAG: --manifest-url-header="" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583984 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583987 2578 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583991 2578 flags.go:64] FLAG: --max-pods="110" Nov 03 22:50:24.590810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583994 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.583998 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584002 2578 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584004 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584007 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584010 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584013 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584021 2578 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584024 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584027 2578 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584030 2578 flags.go:64] FLAG: --pod-cidr="" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584033 2578 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584036 2578 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584039 2578 flags.go:64] FLAG: --pods-per-core="0" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584042 2578 flags.go:64] FLAG: --port="10250" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584045 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584048 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0c34f86ef1b6093a7" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584051 2578 flags.go:64] FLAG: --qos-reserved="" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584054 2578 flags.go:64] FLAG: --read-only-port="10255" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584057 2578 flags.go:64] FLAG: --register-node="true" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584060 2578 flags.go:64] FLAG: --register-with-taints="" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584064 2578 flags.go:64] FLAG: --registry-burst="10" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584067 2578 flags.go:64] FLAG: --registry-qps="5" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584071 2578 flags.go:64] FLAG: --reserved-cpus="" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584075 2578 flags.go:64] FLAG: --reserved-memory="" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584078 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 22:50:24.591434 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584082 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584085 2578 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584088 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584091 2578 flags.go:64] FLAG: --runonce="false" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584094 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584097 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584101 2578 flags.go:64] FLAG: --seccomp-default="false" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584104 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584107 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584110 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584113 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584116 2578 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584119 2578 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584122 2578 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584125 2578 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584128 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584130 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584133 2578 flags.go:64] FLAG: --system-cgroups="" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584136 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584141 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584144 2578 flags.go:64] FLAG: --tls-cert-file="" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584147 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584151 2578 flags.go:64] FLAG: --tls-min-version="" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584154 2578 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584157 2578 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 22:50:24.592055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584160 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584163 2578 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584166 2578 flags.go:64] FLAG: --v="2" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584170 2578 flags.go:64] FLAG: --version="false" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584175 2578 flags.go:64] FLAG: --vmodule="" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584180 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584184 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584317 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584322 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584325 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584328 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584331 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584333 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584336 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584339 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584342 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584344 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584347 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584350 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584352 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584354 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.592701 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584357 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584359 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584362 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584364 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584367 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584369 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584372 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584374 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584376 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584379 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584381 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584384 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584386 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584389 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584392 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584395 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584399 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584402 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584404 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584407 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.593203 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584409 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584412 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584414 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584417 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584419 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584422 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584425 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584427 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584430 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584432 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584435 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584439 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584443 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584446 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584448 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584451 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584454 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584456 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584460 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.593758 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584462 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584465 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584467 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584470 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584472 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584475 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584478 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584480 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584484 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584487 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584490 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584493 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584496 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584498 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584501 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584503 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584506 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584508 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584511 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.594208 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584513 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584516 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584519 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584522 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584524 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584527 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584530 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584535 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584538 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584540 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584543 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584545 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584548 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584550 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584553 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584555 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584558 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584560 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584563 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.594700 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584565 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584582 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584586 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584590 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584593 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584595 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584598 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584600 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584603 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584605 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584608 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584610 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584613 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584615 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584618 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.584644 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:50:24.595163 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584681 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584686 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584689 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584692 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584695 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584698 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584700 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584703 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584706 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584708 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584710 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584713 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584716 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584719 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584721 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584723 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584726 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584728 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584732 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.595544 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584735 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584738 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584741 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584743 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584746 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584749 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584751 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584754 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584758 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584762 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584764 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584767 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584769 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584772 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584775 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584777 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584780 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584782 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584784 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.596017 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584787 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584789 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584792 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584794 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584796 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584799 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584801 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584804 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584807 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584809 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584812 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584814 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584818 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584821 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584823 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584826 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584828 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584831 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584833 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584836 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.596461 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584839 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584841 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584843 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584846 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584848 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584851 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584853 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584857 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584859 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584862 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584864 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584867 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584869 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584871 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584874 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584876 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584879 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584881 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584883 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.597072 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584890 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584893 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584896 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584898 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584900 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584905 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584907 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584910 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584912 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584915 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584917 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584920 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584922 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584925 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584927 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584930 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584932 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584934 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584937 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584939 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.597528 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584941 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584944 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584947 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584952 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584956 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584959 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584961 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584964 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.584966 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.592754 2578 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.592772 2578 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.592787 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.592792 2578 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592854 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592860 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592863 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592866 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592869 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592872 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.598155 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592874 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592877 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592879 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592882 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592885 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592887 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592890 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592892 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592895 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592898 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592900 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592902 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592905 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592907 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592909 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592912 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592914 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592917 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592920 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.598636 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592922 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592925 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592929 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592933 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592943 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592946 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592949 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592952 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592954 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592957 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592960 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592962 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592965 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592967 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592969 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592972 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592974 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592977 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592980 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.599143 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592982 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592985 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592988 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592991 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592993 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592996 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.592998 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593001 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593003 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593006 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593010 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593013 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593016 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593018 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593021 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593023 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593026 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593029 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593037 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.599631 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593040 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593042 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593045 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593047 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593050 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593053 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593055 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593058 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593060 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593063 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593065 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593068 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593070 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593073 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593075 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593078 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593080 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593082 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593085 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.600454 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593087 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593090 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593092 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593095 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593097 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593100 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593102 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593105 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593107 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593110 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593112 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593115 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593117 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593127 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593129 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593132 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593135 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593137 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593140 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593142 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.601390 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593145 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593147 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593150 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593152 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.593179 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593388 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593393 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593396 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593399 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593401 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593404 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593407 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593409 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593412 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593414 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593417 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.601903 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593419 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593422 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593424 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593427 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593429 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593432 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593435 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593437 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593440 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593442 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593451 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593454 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593457 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593459 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593462 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593465 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593467 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593470 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593474 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.602387 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593478 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593480 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593484 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593486 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593489 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593491 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593494 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593496 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593499 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593501 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593503 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593506 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593509 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593511 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593513 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593516 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593518 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593520 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593523 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593525 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.603140 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593528 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593530 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593533 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593536 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593546 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593549 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593553 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593556 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593558 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593561 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593564 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593580 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593582 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593585 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593588 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593590 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593592 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593595 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593597 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593599 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.603872 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593602 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593604 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593607 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593609 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593612 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593621 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593624 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593626 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593629 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593631 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593634 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593636 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593639 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593641 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593643 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593646 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593648 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593657 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593659 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.604597 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593662 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593664 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593667 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593669 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593672 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593674 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593677 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593679 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593682 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593684 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593687 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593689 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593691 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593694 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593696 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593699 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.605068 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593701 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.593726 2578 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593764 2578 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593768 2578 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593771 2578 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593774 2578 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593777 2578 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593780 2578 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593782 2578 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593785 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593787 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593790 2578 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593792 2578 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593795 2578 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593797 2578 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593805 2578 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:50:24.605446 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593808 2578 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593811 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593813 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593815 2578 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593818 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593820 2578 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593823 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593825 2578 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593828 2578 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593830 2578 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593832 2578 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593835 2578 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593837 2578 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593840 2578 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593842 2578 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593845 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593847 2578 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593849 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593852 2578 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:50:24.605846 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593854 2578 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593857 2578 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593859 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593862 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593864 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593868 2578 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593871 2578 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593873 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593876 2578 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593878 2578 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593881 2578 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593883 2578 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593886 2578 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593893 2578 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593896 2578 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593899 2578 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593901 2578 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593903 2578 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593906 2578 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593908 2578 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:50:24.606298 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593910 2578 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593913 2578 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593915 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593918 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593920 2578 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593922 2578 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593925 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593927 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593930 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593932 2578 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593934 2578 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593937 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593939 2578 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593942 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593944 2578 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593947 2578 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593949 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593953 2578 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593956 2578 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593959 2578 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:50:24.606848 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593961 2578 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593964 2578 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593967 2578 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593969 2578 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593971 2578 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593974 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593982 2578 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593986 2578 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593990 2578 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593993 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593996 2578 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.593998 2578 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594001 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594003 2578 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594006 2578 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594008 2578 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594011 2578 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594013 2578 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594015 2578 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:50:24.607302 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594018 2578 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594020 2578 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594023 2578 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594025 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594028 2578 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594030 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594034 2578 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594037 2578 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594039 2578 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594042 2578 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594046 2578 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594048 2578 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594052 2578 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:24.594055 2578 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.594118 2578 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.596640 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.597794 2578 server.go:1014] "Starting client certificate rotation" Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.597908 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 22:50:24.607767 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.597955 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 22:50:24.608201 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.600478 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:50:24.608201 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.603817 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:50:24.613720 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.613703 2578 log.go:25] "Validated CRI v1 runtime API" Nov 03 22:50:24.618256 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.618239 2578 log.go:25] "Validated CRI v1 image API" Nov 03 22:50:24.619141 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.619119 2578 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 22:50:24.626346 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.626322 2578 fs.go:135] Filesystem UUIDs: map[444f2e5b-8705-4259-9f80-10315ed28b9a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b38531d3-574c-4593-ac4f-7db85308c23b:/dev/nvme0n1p3] Nov 03 22:50:24.626401 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.626347 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 03 22:50:24.631031 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.630923 2578 manager.go:217] Machine: {Timestamp:2026-11-03 22:50:24.630421389 +0000 UTC m=+0.364616396 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104998 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b70781e8e900832b388fce379a0ce SystemUUID:ec2b7078-1e8e-9008-32b3-88fce379a0ce BootID:eb31a8c9-c1f2-4287-b7cc-e9cf39dcfae7 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dc:3f:5a:45 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dc:3f:5a:45 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:fc:85:fd:b9:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 22:50:24.631704 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.631693 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 22:50:24.631840 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.631827 2578 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 22:50:24.634347 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.634331 2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 22:50:24.635443 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.635418 2578 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 22:50:24.635612 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.635446 2578 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-124.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 22:50:24.636365 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.636354 2578 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 22:50:24.636398 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.636367 2578 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 22:50:24.636398 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.636381 2578 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:50:24.636398 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.636394 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:50:24.637601 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.637591 2578 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 22:50:24.642310 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642294 2578 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 22:50:24.642449 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642440 2578 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 22:50:24.642482 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642475 2578 kubelet.go:493] "Attempting to sync node with API server" Nov 03 22:50:24.642510 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642485 2578 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 22:50:24.642510 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642497 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 22:50:24.642510 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642506 2578 kubelet.go:405] "Adding apiserver pod source" Nov 03 22:50:24.642598 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.642516 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 22:50:24.643014 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.643001 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:50:24.645729 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.645711 2578 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 22:50:24.647281 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.647251 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x9548" Nov 03 22:50:24.652969 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.652952 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655488 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x9548" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655588 2578 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655637 2578 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655930 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655948 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655958 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655967 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655984 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 22:50:24.656016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.655993 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 22:50:24.657072 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.657055 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 22:50:24.657125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.657095 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 22:50:24.657125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.657107 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 22:50:24.657125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.657113 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 22:50:24.657125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.657122 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 22:50:24.657361 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.657133 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 22:50:24.658101 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.658090 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 22:50:24.658101 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.658101 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 22:50:24.659800 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.659761 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 03 22:50:24.659897 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.659781 2578 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-124.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 03 22:50:24.662552 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.662535 2578 server.go:1263] "Started kubelet" Nov 03 22:50:24.662646 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.662618 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-124.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 03 22:50:24.662646 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.662614 2578 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 22:50:24.662754 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.662644 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 22:50:24.663366 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.662951 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 22:50:24.663478 ip-10-0-128-124 systemd[1]: Started Kubernetes Kubelet. Nov 03 22:50:24.665254 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.664678 2578 server.go:317] "Adding debug handlers to kubelet server" Nov 03 22:50:24.667876 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.667859 2578 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 22:50:24.668316 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.668296 2578 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 03 22:50:24.673320 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.673299 2578 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 22:50:24.673405 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.673318 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 22:50:24.673507 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.673485 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:24.674197 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674174 2578 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 22:50:24.674197 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674193 2578 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 22:50:24.674337 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674236 2578 factory.go:55] Registering systemd factory Nov 03 22:50:24.674337 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674252 2578 factory.go:223] Registration of the systemd container factory successfully Nov 03 22:50:24.674337 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674313 2578 reconstruct.go:97] "Volume reconstruction finished" Nov 03 22:50:24.674337 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674323 2578 reconciler.go:29] "Reconciler: start to sync state" Nov 03 22:50:24.674532 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674496 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 22:50:24.674611 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674565 2578 factory.go:153] Registering CRI-O factory Nov 03 22:50:24.674675 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674612 2578 factory.go:223] Registration of the crio container factory successfully Nov 03 22:50:24.674729 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674671 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 22:50:24.674729 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674704 2578 factory.go:103] Registering Raw factory Nov 03 22:50:24.674729 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.674719 2578 manager.go:1199] Started watching for new ooms in manager Nov 03 22:50:24.675731 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.675712 2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:24.675825 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.675800 2578 manager.go:319] Starting recovery of all containers Nov 03 22:50:24.677136 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.677111 2578 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-124.us-east-2.compute.internal\" not found" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.688165 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.688130 2578 manager.go:324] Recovery completed Nov 03 22:50:24.690219 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.690191 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Nov 03 22:50:24.693765 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.693720 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.695587 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.695555 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.695662 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.695601 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.695662 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.695617 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.696207 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696184 2578 cpu_manager.go:226] "Starting" policy="none" Nov 03 22:50:24.696207 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696196 2578 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 22:50:24.696207 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696199 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.696352 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696217 2578 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 22:50:24.696961 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696947 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.697012 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696975 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.697012 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.696990 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.698632 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.698617 2578 policy_none.go:50] "Start" Nov 03 22:50:24.698676 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.698639 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 22:50:24.698676 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.698661 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 22:50:24.700880 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.700868 2578 policy_none.go:44] "Start" Nov 03 22:50:24.742498 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.742276 2578 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 22:50:24.746553 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.746539 2578 manager.go:341] "Starting Device Plugin manager" Nov 03 22:50:24.747330 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.747313 2578 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 22:50:24.747387 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.747332 2578 server.go:87] "Starting device plugin registration server" Nov 03 22:50:24.747605 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.747587 2578 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 22:50:24.747705 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.747607 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 22:50:24.747831 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.747703 2578 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 22:50:24.747831 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.747789 2578 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 22:50:24.747831 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.747798 2578 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 22:50:24.748326 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.748303 2578 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 22:50:24.748419 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.748356 2578 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:24.843765 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.843685 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 22:50:24.845778 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.845116 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 22:50:24.845778 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.845139 2578 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 22:50:24.845778 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.845165 2578 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 22:50:24.845778 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.845203 2578 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 03 22:50:24.847973 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.847956 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.848412 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.848398 2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:24.848924 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.848904 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.849006 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.848943 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.849006 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.848955 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.849006 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.848985 2578 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.856857 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.856838 2578 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.856948 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.856864 2578 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-124.us-east-2.compute.internal\": node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:24.874115 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.874087 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:24.946303 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.946255 2578 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal"] Nov 03 22:50:24.946460 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.946343 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.947383 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.947368 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.947443 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.947399 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.947443 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.947411 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.949711 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.949698 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.949869 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.949854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.949903 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.949886 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.950491 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.950473 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.950584 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.950507 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.950584 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.950517 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.950584 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.950475 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.950684 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.950596 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.950684 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.950610 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.952624 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.952606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.952729 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.952629 2578 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:50:24.953408 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.953391 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:50:24.953480 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.953420 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:50:24.953480 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.953433 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:50:24.974774 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.974735 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:24.975138 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.975115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.975236 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.975146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.975236 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:24.975165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/933c853ec2aff1af9a557fa27b9770d1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"933c853ec2aff1af9a557fa27b9770d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.977185 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.977156 2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:24.979706 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:24.979690 2578 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.075086 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.075043 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.076204 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.076182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.076281 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.076212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.076281 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.076229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/933c853ec2aff1af9a557fa27b9770d1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"933c853ec2aff1af9a557fa27b9770d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.076281 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.076261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/933c853ec2aff1af9a557fa27b9770d1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"933c853ec2aff1af9a557fa27b9770d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.076281 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.076262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.076281 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.076261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.175782 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.175704 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.276191 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.276154 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.280412 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.280381 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.282549 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.282527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.376251 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.376212 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.476743 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.476676 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.577219 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.577165 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.597424 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.597394 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 03 22:50:25.597945 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.597547 2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 22:50:25.597945 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.597603 2578 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 03 22:50:25.661844 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.661796 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 22:45:25 +0000 UTC" deadline="2028-04-25 07:11:24.935952404 +0000 UTC" Nov 03 22:50:25.661844 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.661839 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12920h20m59.274117171s" Nov 03 22:50:25.677636 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:25.677608 2578 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:50:25.769890 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.769806 2578 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:25.773851 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.773830 2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.785319 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.785297 2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:50:25.786672 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.786657 2578 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:50:25.796404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.796384 2578 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:50:25.915945 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:25.915914 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933c853ec2aff1af9a557fa27b9770d1.slice/crio-f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36 WatchSource:0}: Error finding container f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36: Status 404 returned error can't find the container with id f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36 Nov 03 22:50:25.921617 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.921601 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 22:50:25.983028 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:25.983000 2578 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:26.272847 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:26.272821 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e67d0a09c726730f95619671f6855aa.slice/crio-2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900 WatchSource:0}: Error finding container 2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900: Status 404 returned error can't find the container with id 2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900 Nov 03 22:50:27.872899 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.872864 2578 apiserver.go:52] "Watching apiserver" Nov 03 22:50:27.883527 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.883497 2578 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 22:50:27.885133 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.884224 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-tkqg4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt","openshift-image-registry/node-ca-6wjjx","openshift-multus/multus-additional-cni-plugins-9nzlc","openshift-network-diagnostics/network-check-target-nmwkz","openshift-multus/multus-9zcf4","openshift-ovn-kubernetes/ovnkube-node-f7rrr","kube-system/global-pull-secret-syncer-8bw5x","openshift-cluster-node-tuning-operator/tuned-lfpp5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal","openshift-dns/node-resolver-c4mbq","openshift-multus/network-metrics-daemon-wwlzx","openshift-network-operator/iptables-alerter-nk2hp"] Nov 03 22:50:27.887066 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.887042 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.890176 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.890153 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:27.890280 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:27.890240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:27.891639 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.891619 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 22:50:27.892333 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.892317 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:27.893089 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.893071 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xz7vt\"" Nov 03 22:50:27.893560 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.893534 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 22:50:27.893651 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.893574 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 22:50:27.893747 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.893687 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.894575 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.894553 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 22:50:27.894682 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.894566 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.894745 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.894710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.897385 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.897368 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:27.897478 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:27.897438 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:27.900474 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.900455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.903146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.903130 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 03 22:50:27.903440 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.903423 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.906439 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.906416 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:27.908464 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.908444 2578 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:27.908840 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.908823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:27.911259 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.911242 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:27.913477 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-socket-dir-parent\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.913584 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-lib-modules\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.913584 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-tmp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.913584 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj2xx\" (UniqueName: \"kubernetes.io/projected/1ff675c3-2019-462d-a8de-19897c17fe0a-kube-api-access-cj2xx\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:27.913776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysconfig\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.913776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:27.913776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.913776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-cni-binary-copy\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.913776 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:27.913740 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:27.913776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:27.914039 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-system-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914039 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-multus-daemon-config\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914039 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913951 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-kubernetes\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.914039 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.913996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-conf\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.914039 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a61a276-7283-4fac-8fe0-5ad917832ed7-host\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:27.914245 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-k8s-cni-cncf-io\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914245 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-multus\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914245 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-hostroot\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914399 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-sys\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.914399 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-host\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.914399 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67cf6892-73a4-43fb-9126-b8226bb5406d-agent-certs\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:27.914399 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-etc-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.914399 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.914641 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-systemd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.914641 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-log-socket\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.914641 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914541 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.914641 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-bin\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.914858 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.914858 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a61a276-7283-4fac-8fe0-5ad917832ed7-serviceca\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:27.914858 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914751 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-bin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914858 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-kubelet\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.914858 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mkqv\" (UniqueName: \"kubernetes.io/projected/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-kube-api-access-6mkqv\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.915052 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:27.915052 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.914977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-run\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915052 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-netns\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915052 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-kubelet\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915183 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915183 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-multus-certs\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915183 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-var-lib-kubelet\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915183 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-systemd-units\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915183 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915183 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-tuned\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-slash\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-var-lib-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27625f5-b27a-4797-8137-286db96afd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt9tp\" (UniqueName: \"kubernetes.io/projected/7d76008d-f4a0-4f61-bad9-8362f553da69-kube-api-access-nt9tp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lglsv\" (UniqueName: \"kubernetes.io/projected/14d6f850-0120-4b49-9428-46913ac8566b-kube-api-access-lglsv\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-node-log\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-env-overrides\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915379 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv7kc\" (UniqueName: \"kubernetes.io/projected/d27625f5-b27a-4797-8137-286db96afd2b-kube-api-access-sv7kc\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skql9\" (UniqueName: \"kubernetes.io/projected/4a61a276-7283-4fac-8fe0-5ad917832ed7-kube-api-access-skql9\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67cf6892-73a4-43fb-9126-b8226bb5406d-konnectivity-ca\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:27.915438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-conf-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-netns\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-ovn\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-config\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-script-lib\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cnibin\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-cnibin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-etc-kubernetes\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-systemd\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-system-cni-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915823 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-modprobe-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:27.915882 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.915874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-netd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:27.916480 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.916464 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:27.917212 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.917178 2578 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 22:50:27.935369 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.935346 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kljbs" Nov 03 22:50:27.942879 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.942447 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kljbs" Nov 03 22:50:27.992498 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.992465 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 22:50:27.992498 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.992466 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.993423 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993401 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 22:50:27.993522 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993431 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.993522 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993453 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 22:50:27.993522 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993458 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.993991 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993852 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 22:50:27.993991 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993882 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.993991 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.993907 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.994196 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.994118 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.994196 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.994121 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995533 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4m98w\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995544 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995535 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995583 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-fpn8c\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995596 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995612 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7xqrp\"" Nov 03 22:50:27.995645 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995639 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 22:50:27.995990 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995692 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.995990 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995779 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 22:50:27.995990 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995813 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.995990 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995814 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qt84f\"" Nov 03 22:50:27.995990 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995829 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 22:50:27.995990 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.995872 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qb72\"" Nov 03 22:50:27.997194 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.997175 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 22:50:27.997303 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.997219 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55tt4\"" Nov 03 22:50:27.997303 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.997223 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 22:50:27.997303 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.997181 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lq2j\"" Nov 03 22:50:27.997303 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:27.997257 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-6ln97\"" Nov 03 22:50:28.005076 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.005055 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 22:50:28.016260 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-netns\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016266 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-ovn\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-config\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-script-lib\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016333 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-socket-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-netns\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-sys-fs\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-ovn\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.016404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016407 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeb53852-5e0f-4152-a623-e7e3126a15d8-host-slash\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cnibin\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-cnibin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-etc-kubernetes\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-systemd\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-system-cni-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.016871 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-modprobe-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016895 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-netd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-etc-kubernetes\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-netd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cnibin\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016975 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-systemd\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-socket-dir-parent\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-lib-modules\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.016999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-cnibin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-system-cni-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-tmp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017094 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-lib-modules\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f978bf-c043-4c0c-b895-b3ad7011c9b5-hosts-file\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017098 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-modprobe-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-socket-dir-parent\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2xx\" (UniqueName: \"kubernetes.io/projected/1ff675c3-2019-462d-a8de-19897c17fe0a-kube-api-access-cj2xx\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysconfig\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017255 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysconfig\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-cni-binary-copy\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-system-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-multus-daemon-config\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-kubernetes\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-conf\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a61a276-7283-4fac-8fe0-5ad917832ed7-host\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-k8s-cni-cncf-io\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-k8s-cni-cncf-io\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-multus\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-hostroot\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-sys\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-conf\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.017776 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-hostroot\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017721 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-multus\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-host\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-sys\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.017774 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67cf6892-73a4-43fb-9126-b8226bb5406d-agent-certs\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017811 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-etc-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.017861 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:50:28.517822083 +0000 UTC m=+3.022929083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-etc-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-systemd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-log-socket\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-host\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.017984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-kubernetes\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-bin\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.018542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a61a276-7283-4fac-8fe0-5ad917832ed7-host\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018140 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-multus-daemon-config\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018182 2578 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-system-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018411 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-cni-binary-copy\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-registration-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-kubelet-config\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-systemd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-bin\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a61a276-7283-4fac-8fe0-5ad917832ed7-serviceca\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbt5q\" (UniqueName: \"kubernetes.io/projected/22f978bf-c043-4c0c-b895-b3ad7011c9b5-kube-api-access-tbt5q\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-log-socket\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-bin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.019362 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-kubelet\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqv\" (UniqueName: \"kubernetes.io/projected/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-kube-api-access-6mkqv\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.018989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-run\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-558nw\" (UniqueName: \"kubernetes.io/projected/eeb53852-5e0f-4152-a623-e7e3126a15d8-kube-api-access-558nw\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-dbus\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a61a276-7283-4fac-8fe0-5ad917832ed7-serviceca\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-netns\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-bin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-kubelet\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019484 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-run\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-netns\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-kubelet\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-kubelet\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.020153 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeb53852-5e0f-4152-a623-e7e3126a15d8-iptables-alerter-script\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-multus-certs\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-var-lib-kubelet\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-systemd-units\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-device-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.019984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f978bf-c043-4c0c-b895-b3ad7011c9b5-tmp-dir\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-tuned\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020070 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-slash\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-var-lib-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27625f5-b27a-4797-8137-286db96afd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9tp\" (UniqueName: \"kubernetes.io/projected/7d76008d-f4a0-4f61-bad9-8362f553da69-kube-api-access-nt9tp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020186 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lglsv\" (UniqueName: \"kubernetes.io/projected/14d6f850-0120-4b49-9428-46913ac8566b-kube-api-access-lglsv\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-node-log\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-env-overrides\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv7kc\" (UniqueName: \"kubernetes.io/projected/d27625f5-b27a-4797-8137-286db96afd2b-kube-api-access-sv7kc\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzxz\" (UniqueName: \"kubernetes.io/projected/1b5f0856-7192-47d0-9590-8b4fd79add4b-kube-api-access-vfzxz\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020407 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skql9\" (UniqueName: \"kubernetes.io/projected/4a61a276-7283-4fac-8fe0-5ad917832ed7-kube-api-access-skql9\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67cf6892-73a4-43fb-9126-b8226bb5406d-konnectivity-ca\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-conf-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020532 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-conf-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020618 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-var-lib-kubelet\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-multus-certs\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.020848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-systemd-units\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.021799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.021382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-script-lib\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.022321 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.021806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-slash\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.022321 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.021921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-config\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.022321 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.022016 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-node-log\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.022321 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.022222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-var-lib-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.022321 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.022222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67cf6892-73a4-43fb-9126-b8226bb5406d-agent-certs\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:28.022321 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.022310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-env-overrides\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.023089 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.023010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67cf6892-73a4-43fb-9126-b8226bb5406d-konnectivity-ca\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:28.024743 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.024463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-tmp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.024743 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.024508 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27625f5-b27a-4797-8137-286db96afd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.025210 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.025185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-tuned\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.025356 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.025233 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:28.025356 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.025255 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:28.025356 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.025269 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:28.025356 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.025331 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:28.525309798 +0000 UTC m=+3.030416812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:28.027457 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.027365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2xx\" (UniqueName: \"kubernetes.io/projected/1ff675c3-2019-462d-a8de-19897c17fe0a-kube-api-access-cj2xx\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:28.029623 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.029597 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkqv\" (UniqueName: \"kubernetes.io/projected/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-kube-api-access-6mkqv\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.038446 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.034294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv7kc\" (UniqueName: \"kubernetes.io/projected/d27625f5-b27a-4797-8137-286db96afd2b-kube-api-access-sv7kc\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.038446 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.037829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lglsv\" (UniqueName: \"kubernetes.io/projected/14d6f850-0120-4b49-9428-46913ac8566b-kube-api-access-lglsv\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.038446 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.038359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skql9\" (UniqueName: \"kubernetes.io/projected/4a61a276-7283-4fac-8fe0-5ad917832ed7-kube-api-access-skql9\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.040287 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.040263 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9tp\" (UniqueName: \"kubernetes.io/projected/7d76008d-f4a0-4f61-bad9-8362f553da69-kube-api-access-nt9tp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.080039 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.079937 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"1e67d0a09c726730f95619671f6855aa","Type":"ContainerStarted","Data":"2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900"} Nov 03 22:50:28.081241 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.081203 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"933c853ec2aff1af9a557fa27b9770d1","Type":"ContainerStarted","Data":"f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36"} Nov 03 22:50:28.121769 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-socket-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.121769 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-sys-fs\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeb53852-5e0f-4152-a623-e7e3126a15d8-host-slash\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121845 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f978bf-c043-4c0c-b895-b3ad7011c9b5-hosts-file\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-registration-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-socket-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f978bf-c043-4c0c-b895-b3ad7011c9b5-hosts-file\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.122013 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121993 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-kubelet-config\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-registration-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-sys-fs\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.122058 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.121943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-kubelet-config\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeb53852-5e0f-4152-a623-e7e3126a15d8-host-slash\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.122134 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:50:28.622110329 +0000 UTC m=+3.127217334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5q\" (UniqueName: \"kubernetes.io/projected/22f978bf-c043-4c0c-b895-b3ad7011c9b5-kube-api-access-tbt5q\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-558nw\" (UniqueName: \"kubernetes.io/projected/eeb53852-5e0f-4152-a623-e7e3126a15d8-kube-api-access-558nw\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-dbus\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeb53852-5e0f-4152-a623-e7e3126a15d8-iptables-alerter-script\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-device-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f978bf-c043-4c0c-b895-b3ad7011c9b5-tmp-dir\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.122416 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzxz\" (UniqueName: \"kubernetes.io/projected/1b5f0856-7192-47d0-9590-8b4fd79add4b-kube-api-access-vfzxz\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.123084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.123084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-device-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.123084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-dbus\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.123084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f978bf-c043-4c0c-b895-b3ad7011c9b5-tmp-dir\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.123084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.122991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeb53852-5e0f-4152-a623-e7e3126a15d8-iptables-alerter-script\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.132841 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.132791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzxz\" (UniqueName: \"kubernetes.io/projected/1b5f0856-7192-47d0-9590-8b4fd79add4b-kube-api-access-vfzxz\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.133413 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.133391 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt5q\" (UniqueName: \"kubernetes.io/projected/22f978bf-c043-4c0c-b895-b3ad7011c9b5-kube-api-access-tbt5q\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.133527 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.133433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-558nw\" (UniqueName: \"kubernetes.io/projected/eeb53852-5e0f-4152-a623-e7e3126a15d8-kube-api-access-558nw\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.213273 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.213241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:50:28.218018 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.217689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:28.227513 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:28.227482 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a61a276_7283_4fac_8fe0_5ad917832ed7.slice/crio-832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c WatchSource:0}: Error finding container 832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c: Status 404 returned error can't find the container with id 832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c Nov 03 22:50:28.228806 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:28.228764 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27625f5_b27a_4797_8137_286db96afd2b.slice/crio-0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538 WatchSource:0}: Error finding container 0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538: Status 404 returned error can't find the container with id 0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538 Nov 03 22:50:28.237214 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.237194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zcf4" Nov 03 22:50:28.237311 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.237281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:50:28.239360 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.239338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:50:28.240963 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.240944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:28.252589 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.252495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:50:28.255641 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.255519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:50:28.255728 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:28.255645 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d76008d_f4a0_4f61_bad9_8362f553da69.slice/crio-edd94c24a00bb75705d91c7682bb1d92aae2e949a70c47d4406dc48f7e707442 WatchSource:0}: Error finding container edd94c24a00bb75705d91c7682bb1d92aae2e949a70c47d4406dc48f7e707442: Status 404 returned error can't find the container with id edd94c24a00bb75705d91c7682bb1d92aae2e949a70c47d4406dc48f7e707442 Nov 03 22:50:28.261309 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.261261 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:50:28.274645 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:28.274610 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f978bf_c043_4c0c_b895_b3ad7011c9b5.slice/crio-980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7 WatchSource:0}: Error finding container 980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7: Status 404 returned error can't find the container with id 980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7 Nov 03 22:50:28.275333 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:50:28.275300 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5f0856_7192_47d0_9590_8b4fd79add4b.slice/crio-454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd WatchSource:0}: Error finding container 454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd: Status 404 returned error can't find the container with id 454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd Nov 03 22:50:28.305681 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.305633 2578 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:50:28.526084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.525986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:28.526084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.526084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:28.526335 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.526229 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:28.526335 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.526288 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:50:29.52626592 +0000 UTC m=+4.031372915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:28.526672 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.526632 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:28.526672 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.526652 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:28.526896 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.526681 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:28.526896 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.526722 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:29.526705643 +0000 UTC m=+4.031812637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:28.627446 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.627402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:28.627589 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.627545 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:28.627653 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:28.627619 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:50:29.627600671 +0000 UTC m=+4.132707713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:28.945839 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.945727 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 22:45:27 +0000 UTC" deadline="2028-07-29 05:28:55.75866154 +0000 UTC" Nov 03 22:50:28.945839 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:28.945787 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15198h38m26.812878594s" Nov 03 22:50:29.075803 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.074782 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:29.075803 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.075143 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:29.075803 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.075554 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:29.075803 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.075682 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:29.094931 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.094840 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" event={"ID":"7d76008d-f4a0-4f61-bad9-8362f553da69","Type":"ContainerStarted","Data":"edd94c24a00bb75705d91c7682bb1d92aae2e949a70c47d4406dc48f7e707442"} Nov 03 22:50:29.098033 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.098000 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6wjjx" event={"ID":"4a61a276-7283-4fac-8fe0-5ad917832ed7","Type":"ContainerStarted","Data":"832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c"} Nov 03 22:50:29.101885 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.101853 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"933c853ec2aff1af9a557fa27b9770d1","Type":"ContainerStarted","Data":"e2fd187b145b685174968ea3c65fd036a8af8301835c60d47660bd8aa1434bca"} Nov 03 22:50:29.107465 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.107378 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nk2hp" event={"ID":"eeb53852-5e0f-4152-a623-e7e3126a15d8","Type":"ContainerStarted","Data":"fbf58cea2e777a9e1c98c2fccc0cbeddc5832f7ec39af8dff9a0fd533d933606"} Nov 03 22:50:29.111610 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.111526 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tkqg4" event={"ID":"67cf6892-73a4-43fb-9126-b8226bb5406d","Type":"ContainerStarted","Data":"67fb3cbcfd96c3aaccc5bbe341ea34b6302a9d0bfc68cb8da9ce3434ba7ee3c0"} Nov 03 22:50:29.122994 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.122894 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zcf4" event={"ID":"14d6f850-0120-4b49-9428-46913ac8566b","Type":"ContainerStarted","Data":"b0e5c3065548bbceb14a06e103d95e70ac9bed23d031e0762d19e0151732d858"} Nov 03 22:50:29.130615 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.130497 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538"} Nov 03 22:50:29.145199 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.144078 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" event={"ID":"1b5f0856-7192-47d0-9590-8b4fd79add4b","Type":"ContainerStarted","Data":"454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd"} Nov 03 22:50:29.150530 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.150492 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4mbq" event={"ID":"22f978bf-c043-4c0c-b895-b3ad7011c9b5","Type":"ContainerStarted","Data":"980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7"} Nov 03 22:50:29.152609 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.152582 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerStarted","Data":"1fade03ecacc45e2d89ece436905aad2debe2c44042f9a346f564aa1fd50e0c2"} Nov 03 22:50:29.535393 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.535351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:29.535568 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.535420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:29.535639 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.535583 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:29.535639 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.535607 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:29.535639 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.535620 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:29.535794 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.535703 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:31.53568325 +0000 UTC m=+6.040790257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:29.536187 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.536144 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:29.536294 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.536202 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:50:31.536184942 +0000 UTC m=+6.041291941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:29.636690 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.636502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:29.636690 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.636642 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:29.636901 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:29.636726 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:50:31.636707227 +0000 UTC m=+6.141814231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:29.946031 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.945945 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 22:45:27 +0000 UTC" deadline="2028-04-01 04:12:01.793667293 +0000 UTC" Nov 03 22:50:29.946031 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:29.946007 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12341h21m31.847664756s" Nov 03 22:50:30.078109 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:30.077578 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:30.078109 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:30.077724 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:31.075482 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.075457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:31.075875 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.075579 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:31.075875 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.075611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:31.075875 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.075712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:31.168059 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.167277 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerStarted","Data":"9f774a7f314e11ca3535457a8c0d74e39c37a2671680c8b3d6d8a7b958065cb2"} Nov 03 22:50:31.172323 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.172296 2578 generic.go:356] "Generic (PLEG): container finished" podID="1e67d0a09c726730f95619671f6855aa" containerID="ae805e32a3831232de8b1ce88b4b6e8c8312e51979954b8642f97b07fff2ce64" exitCode=0 Nov 03 22:50:31.172438 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.172344 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"1e67d0a09c726730f95619671f6855aa","Type":"ContainerDied","Data":"ae805e32a3831232de8b1ce88b4b6e8c8312e51979954b8642f97b07fff2ce64"} Nov 03 22:50:31.189828 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.189034 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" podStartSLOduration=4.189013458 podStartE2EDuration="4.189013458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:29.117048919 +0000 UTC m=+3.622155924" watchObservedRunningTime="2026-11-03 22:50:31.189013458 +0000 UTC m=+5.694120465" Nov 03 22:50:31.554014 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.553922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:31.554014 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.553994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:31.554286 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.554174 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:31.554286 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.554194 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:31.554286 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.554209 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:31.554286 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.554267 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:35.554250647 +0000 UTC m=+10.059357651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:31.554712 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.554693 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:31.554814 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.554753 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:50:35.554734066 +0000 UTC m=+10.059841062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:31.654949 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:31.654343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:31.654949 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.654518 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:31.654949 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:31.654583 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:50:35.654565779 +0000 UTC m=+10.159672775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:32.077843 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.077810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:32.078245 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:32.077946 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:32.180598 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.180512 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"1e67d0a09c726730f95619671f6855aa","Type":"ContainerStarted","Data":"6e763a0d2722cef91103fe7f7aee866c96caa812d2a047cef7888bf171a7181d"} Nov 03 22:50:32.192249 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.191993 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="9f774a7f314e11ca3535457a8c0d74e39c37a2671680c8b3d6d8a7b958065cb2" exitCode=0 Nov 03 22:50:32.192249 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.192122 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerDied","Data":"9f774a7f314e11ca3535457a8c0d74e39c37a2671680c8b3d6d8a7b958065cb2"} Nov 03 22:50:32.202511 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.202482 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tkqg4" event={"ID":"67cf6892-73a4-43fb-9126-b8226bb5406d","Type":"ContainerStarted","Data":"071d8f8a1f2602a79915661ba35e9c000304230e63fdfbadd78a4ea4adbe5b3f"} Nov 03 22:50:32.224705 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.224635 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" podStartSLOduration=5.224621441 podStartE2EDuration="5.224621441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:32.206344608 +0000 UTC m=+6.711451612" watchObservedRunningTime="2026-11-03 22:50:32.224621441 +0000 UTC m=+6.729728446" Nov 03 22:50:32.247323 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:32.247271 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tkqg4" podStartSLOduration=2.782488566 podStartE2EDuration="6.247255683s" totalImagesPullingTime="3.464767117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:32.225098957 +0000 UTC m=+6.730205961" watchObservedRunningTime="2026-11-03 22:50:32.247255683 +0000 UTC m=+6.752362686" Nov 03 22:50:33.076202 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:33.075197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:33.076202 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:33.075236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:33.076202 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:33.075327 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:33.076202 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:33.075809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:34.079640 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:34.079604 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:34.080137 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:34.079748 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:34.219921 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:34.219878 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6wjjx" event={"ID":"4a61a276-7283-4fac-8fe0-5ad917832ed7","Type":"ContainerStarted","Data":"87ee339744f81510d0203d834766681fa83581725da72c22083728879fc7bbdc"} Nov 03 22:50:34.222519 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:34.222489 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" event={"ID":"1b5f0856-7192-47d0-9590-8b4fd79add4b","Type":"ContainerStarted","Data":"7578f41f8434ee5caa87666302eeb3810c7547f9023a4143d2ec50d7d288d19f"} Nov 03 22:50:35.076164 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.075426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:35.076164 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.075548 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:35.076164 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.075959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:35.076164 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.076070 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:35.304712 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.304008 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:35.305579 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.305370 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:35.321293 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.320942 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6wjjx" podStartSLOduration=4.475675307 podStartE2EDuration="9.32092265s" totalImagesPullingTime="4.845247343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:34.235360116 +0000 UTC m=+8.740467120" watchObservedRunningTime="2026-11-03 22:50:35.32092265 +0000 UTC m=+9.826029655" Nov 03 22:50:35.594376 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.594309 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:35.594376 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.594385 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:35.594618 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.594549 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:35.594618 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.594573 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:35.594618 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.594587 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:35.594760 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.594679 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:43.594640359 +0000 UTC m=+18.099747364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:35.595150 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.595117 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:35.595211 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.595178 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:50:43.595162275 +0000 UTC m=+18.100269279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:35.695203 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.695166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:35.695400 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.695381 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:35.695456 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:35.695451 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:50:43.695432574 +0000 UTC m=+18.200539571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:35.722181 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.721792 2578 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 22:50:35.984506 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.984366 2578 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T22:50:35.721820296Z","UUID":"fb9ac4ed-cd4d-459d-b51a-28c937258dc4","Handler":null,"Name":"","Endpoint":""} Nov 03 22:50:35.990772 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.990735 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 22:50:35.990772 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:35.990781 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 22:50:36.080012 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:36.079988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:36.080178 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:36.080101 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:36.230873 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:36.230842 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zcf4" event={"ID":"14d6f850-0120-4b49-9428-46913ac8566b","Type":"ContainerStarted","Data":"3688b13a820fc7dce3dc37c430840af18ba6dd70679c047cced471124e5d24e6"} Nov 03 22:50:36.234799 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:36.234092 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" event={"ID":"1b5f0856-7192-47d0-9590-8b4fd79add4b","Type":"ContainerStarted","Data":"0dabea504e8f553379097f594ff7673174a3126976e2c2e635ecd3d938354212"} Nov 03 22:50:37.075472 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.075258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:37.076041 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.075313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:37.076041 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:37.075556 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:37.076041 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:37.075697 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:37.238868 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.238785 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" event={"ID":"1b5f0856-7192-47d0-9590-8b4fd79add4b","Type":"ContainerStarted","Data":"8ba97797db446a5ea48e87268981ab7f067fe2900a32e328e6fa944097547686"} Nov 03 22:50:37.243096 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.243062 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c4mbq" event={"ID":"22f978bf-c043-4c0c-b895-b3ad7011c9b5","Type":"ContainerStarted","Data":"e05d82d8df8b11c15e33f8b2949e2de98a76a75e3400b0cfbc1e999d77c76f8a"} Nov 03 22:50:37.247400 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.247372 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="6d965d6c5aeba2c074296d4757cc0c0465286b55a2e0b8ef20ee25e9fb775cc7" exitCode=0 Nov 03 22:50:37.247564 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.247535 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerDied","Data":"6d965d6c5aeba2c074296d4757cc0c0465286b55a2e0b8ef20ee25e9fb775cc7"} Nov 03 22:50:37.260482 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.260435 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-9zcf4" podStartSLOduration=4.051943435 podStartE2EDuration="11.260422171s" totalImagesPullingTime="7.208478736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:36.24992105 +0000 UTC m=+10.755028056" watchObservedRunningTime="2026-11-03 22:50:37.260422171 +0000 UTC m=+11.765529175" Nov 03 22:50:37.261017 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.260988 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" podStartSLOduration=2.974984173 podStartE2EDuration="11.260978892s" totalImagesPullingTime="8.285994719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:37.259997538 +0000 UTC m=+11.765104543" watchObservedRunningTime="2026-11-03 22:50:37.260978892 +0000 UTC m=+11.766085900" Nov 03 22:50:37.297413 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:37.297354 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-c4mbq" podStartSLOduration=3.308274269 podStartE2EDuration="11.297335274s" totalImagesPullingTime="7.989061005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:37.29676536 +0000 UTC m=+11.801872364" watchObservedRunningTime="2026-11-03 22:50:37.297335274 +0000 UTC m=+11.802442278" Nov 03 22:50:38.074622 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:38.074588 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:38.074822 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:38.074747 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:38.251494 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:38.251447 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nk2hp" event={"ID":"eeb53852-5e0f-4152-a623-e7e3126a15d8","Type":"ContainerStarted","Data":"520afd99a123bf762a2ce8fe419b6057087423ed36984074ab48f280a72c55ca"} Nov 03 22:50:38.268049 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:38.267999 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nk2hp" podStartSLOduration=3.832179896 podStartE2EDuration="12.267984073s" totalImagesPullingTime="8.435804177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:38.267907568 +0000 UTC m=+12.773014574" watchObservedRunningTime="2026-11-03 22:50:38.267984073 +0000 UTC m=+12.773091078" Nov 03 22:50:39.075032 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:39.074997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:39.075032 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:39.075023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:39.075227 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:39.075112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:39.075227 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:39.075205 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:39.255716 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:39.255675 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="41ffda33034f4cc6782a219787208abca584d6c4d70cf64226f6f452c026361d" exitCode=0 Nov 03 22:50:39.256407 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:39.255720 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerDied","Data":"41ffda33034f4cc6782a219787208abca584d6c4d70cf64226f6f452c026361d"} Nov 03 22:50:39.257204 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:39.257180 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" event={"ID":"7d76008d-f4a0-4f61-bad9-8362f553da69","Type":"ContainerStarted","Data":"0c50afc0e98905cac9daba3baee02c9a58afa93423680c39a96c0b776efd3e56"} Nov 03 22:50:39.297941 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:39.297890 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" podStartSLOduration=2.765211535 podStartE2EDuration="13.297877824s" totalImagesPullingTime="10.532666289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:39.297409528 +0000 UTC m=+13.802516532" watchObservedRunningTime="2026-11-03 22:50:39.297877824 +0000 UTC m=+13.802984828" Nov 03 22:50:40.074791 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:40.074755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:40.074962 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:40.074894 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:41.075446 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:41.075224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:41.075947 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:41.075311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:41.075947 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:41.075542 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:41.075947 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:41.075647 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:41.264773 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:41.264733 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="cc15c25da2e2de972f9755be8bc427ca4e85723580e19bffb226e40c13f29969" exitCode=0 Nov 03 22:50:41.264927 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:41.264815 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerDied","Data":"cc15c25da2e2de972f9755be8bc427ca4e85723580e19bffb226e40c13f29969"} Nov 03 22:50:42.075349 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:42.075309 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:42.075529 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:42.075465 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:43.075110 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.075075 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:43.075235 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.075196 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:43.075581 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.075561 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:43.075984 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.075684 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:43.271198 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.271172 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="160c0080d3dc4bdca268561269bb25048d4e54133682f4f836bf3b43b64d9c19" exitCode=0 Nov 03 22:50:43.271298 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.271236 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerDied","Data":"160c0080d3dc4bdca268561269bb25048d4e54133682f4f836bf3b43b64d9c19"} Nov 03 22:50:43.659062 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.658868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:43.659194 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.659094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:43.659194 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.659020 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:43.659194 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.659175 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:43.659194 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.659185 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:43.659194 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.659195 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:43.659365 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.659241 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:50:59.65922818 +0000 UTC m=+34.164335175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:43.659365 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.659254 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:50:59.659248268 +0000 UTC m=+34.164355249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:43.759930 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:43.759886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:43.760080 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.760059 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:43.760142 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:43.760132 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:50:59.760114379 +0000 UTC m=+34.265221382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:44.074752 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.074725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:44.074868 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:44.074824 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:44.276646 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.276610 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"c31429f5de81ad39b4bbf7e63585736d037a622c1d3c39310f2a4e6a30ff7824"} Nov 03 22:50:44.277240 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.276709 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"71481e2976b285a7f0c96eb52f89a818a4efc58f270f5c6ce5ec10dd06ea4254"} Nov 03 22:50:44.277240 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.276743 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"547a025a318f65d2889fa9728a6f83487436cf123ac6588a0006b63027d73b69"} Nov 03 22:50:44.277240 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.276770 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"416bd9f75551addc401c35b9cad0c6e941f12f530dcd68c00c2b48d6ea7bc9f6"} Nov 03 22:50:44.277240 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.276805 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"e8ecea1346c5629943e629af94fa2db5540f7788fa3577c4a218d43b2ecb1f05"} Nov 03 22:50:44.277240 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.276832 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"8043aae7dec16ca4ca4277c0e12bbf8212d768e5831634f0c08b0f989e783558"} Nov 03 22:50:44.279748 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.279721 2578 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="2380178a24b80f069b7d5e7e984a28c2418bdd76d4c46ddd2135ff6de45a56e1" exitCode=0 Nov 03 22:50:44.279862 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:44.279758 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerDied","Data":"2380178a24b80f069b7d5e7e984a28c2418bdd76d4c46ddd2135ff6de45a56e1"} Nov 03 22:50:45.074740 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:45.074710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:45.074740 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:45.074743 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:45.074910 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:45.074825 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:45.074910 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:45.074886 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:45.285020 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:45.284988 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" event={"ID":"8a9a75f9-9976-4d50-af9e-cc680ff1e36f","Type":"ContainerStarted","Data":"141264a1b7735d38064adbc527e91c89b0a1a37eb1c552fecbd6fa89d0a0fb39"} Nov 03 22:50:45.309429 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:45.309383 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9nzlc" podStartSLOduration=8.115354199 podStartE2EDuration="19.309370112s" totalImagesPullingTime="11.194015913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:45.308847688 +0000 UTC m=+19.813954706" watchObservedRunningTime="2026-11-03 22:50:45.309370112 +0000 UTC m=+19.814477115" Nov 03 22:50:46.075296 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:46.075271 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:46.075439 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:46.075353 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:46.289878 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:46.289841 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"c005e9d7ee8c09be06ebbcf699bc1bdd1753251a88f5df7b198e09487483dcbf"} Nov 03 22:50:47.074614 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:47.074574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:47.074614 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:47.074619 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:47.074819 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:47.074719 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:47.074861 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:47.074838 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:48.074677 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.074480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:48.075146 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:48.074781 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:48.298472 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.298434 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" event={"ID":"d27625f5-b27a-4797-8137-286db96afd2b","Type":"ContainerStarted","Data":"b945ec74c2a73e62a2cf87e238fe7e717f52d333c45e007047e67a7911b0a483"} Nov 03 22:50:48.298722 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.298688 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:48.298836 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.298755 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:48.315878 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.315854 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:48.315999 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.315949 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:48.327899 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:48.327821 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" podStartSLOduration=7.303954203 podStartE2EDuration="22.32780964s" totalImagesPullingTime="15.023855437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:50:48.327371575 +0000 UTC m=+22.832478579" watchObservedRunningTime="2026-11-03 22:50:48.32780964 +0000 UTC m=+22.832916644" Nov 03 22:50:49.076301 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.075475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:49.076301 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:49.075637 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:49.076301 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.075765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:49.076301 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:49.075868 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:49.300835 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.300808 2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:50:49.531041 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.530965 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8bw5x"] Nov 03 22:50:49.531206 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.531093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:49.531206 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:49.531191 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:49.534368 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.534340 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmwkz"] Nov 03 22:50:49.534513 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.534456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:49.534562 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:49.534549 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:49.534980 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.534959 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wwlzx"] Nov 03 22:50:49.535086 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:49.535046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:49.535153 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:49.535121 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:50.302823 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:50.302796 2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:50:51.075284 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.075248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:51.075284 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.075276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:51.075525 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.075284 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:51.075525 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:51.075348 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:51.075525 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:51.075446 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:51.075525 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:51.075493 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:51.345596 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.345510 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:51.346030 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.345653 2578 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:50:51.346352 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.346327 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:50:51.817701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:51.817599 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:50:53.075158 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:53.075119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:53.075615 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:53.075193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:53.075615 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:53.075288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:53.075615 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:53.075292 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:53.075615 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:53.075362 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:53.075615 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:53.075431 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:54.959883 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:54.959853 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4mbq_22f978bf-c043-4c0c-b895-b3ad7011c9b5/dns-node-resolver/0.log" Nov 03 22:50:55.074491 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:55.074454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:55.074702 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:55.074453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:55.074702 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:55.074564 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:55.074702 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:55.074689 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:55.074829 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:55.074693 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:55.074829 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:55.074790 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:55.942832 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:55.942798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6wjjx_4a61a276-7283-4fac-8fe0-5ad917832ed7/node-ca/0.log" Nov 03 22:50:57.074498 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:57.074460 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:57.074945 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:57.074521 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:57.074945 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:57.074547 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:57.074945 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:57.074618 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:57.074945 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:57.074723 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:57.074945 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:57.074788 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:59.075231 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:59.075190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:59.075231 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:59.075231 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:59.075688 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:59.075236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:59.075688 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.075307 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:50:59.075688 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.075379 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:50:59.075688 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.075478 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:50:59.659734 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:59.659699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:50:59.659934 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:59.659756 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:50:59.659934 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.659887 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:59.659934 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.659923 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 22:50:59.660085 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.659949 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 22:50:59.660085 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.659962 2578 projected.go:196] Error preparing data for projected volume kube-api-access-nqvqn for pod openshift-network-diagnostics/network-check-target-nmwkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:59.660085 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.659937 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs podName:1ff675c3-2019-462d-a8de-19897c17fe0a nodeName:}" failed. No retries permitted until 2026-11-03 22:51:31.659924441 +0000 UTC m=+66.165031437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs") pod "network-metrics-daemon-wwlzx" (UID: "1ff675c3-2019-462d-a8de-19897c17fe0a") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 22:50:59.660085 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.660023 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn podName:630261b5-f7ea-45e3-b243-5b6503684d93 nodeName:}" failed. No retries permitted until 2026-11-03 22:51:31.660005577 +0000 UTC m=+66.165112565 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqvqn" (UniqueName: "kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn") pod "network-check-target-nmwkz" (UID: "630261b5-f7ea-45e3-b243-5b6503684d93") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 22:50:59.760782 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:50:59.760728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:50:59.763176 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.763144 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 22:50:59.763451 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:50:59.763440 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret podName:e57657f7-583c-49a4-8b97-c8e7980a95ae nodeName:}" failed. No retries permitted until 2026-11-03 22:51:31.763423863 +0000 UTC m=+66.268530858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret") pod "global-pull-secret-syncer-8bw5x" (UID: "e57657f7-583c-49a4-8b97-c8e7980a95ae") : object "kube-system"/"original-pull-secret" not registered Nov 03 22:51:01.075191 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:01.075151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:01.075191 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:01.075175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:01.075643 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:01.075267 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:01.075643 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:01.075303 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:01.075643 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:01.075376 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:01.075643 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:01.075449 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:03.075095 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:03.075055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:03.075528 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:03.075166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:03.075528 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:03.075256 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:03.075528 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:03.075164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:03.075528 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:03.075162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:03.075528 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:03.075321 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:05.074868 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:05.074829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:05.075367 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:05.074881 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:05.075367 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:05.074830 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:05.075367 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:05.074976 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:05.075367 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:05.075087 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:05.075367 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:05.075146 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:07.074425 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:07.074392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:07.074825 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:07.074442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:07.074825 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:07.074496 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:07.074825 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:07.074442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:07.074825 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:07.074553 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:07.074825 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:07.074606 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:09.075102 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:09.075065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:09.075102 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:09.075085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:09.075635 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:09.075175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:09.075635 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:09.075181 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:09.075635 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:09.075235 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:09.075635 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:09.075316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:11.074950 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:11.074909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:11.075442 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:11.075023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:11.075442 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:11.075034 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:11.075442 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:11.075055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:11.075442 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:11.075144 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:11.075442 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:11.075211 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:13.074786 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.074751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:13.074786 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.074777 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:13.075212 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:13.074853 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmwkz" podUID="630261b5-f7ea-45e3-b243-5b6503684d93" Nov 03 22:51:13.075212 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.074906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:13.075212 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:13.074977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bw5x" podUID="e57657f7-583c-49a4-8b97-c8e7980a95ae" Nov 03 22:51:13.075212 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:13.075046 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wwlzx" podUID="1ff675c3-2019-462d-a8de-19897c17fe0a" Nov 03 22:51:13.318917 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.318895 2578 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeReady" Nov 03 22:51:13.319057 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.319014 2578 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 22:51:13.367105 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.367074 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pqd56"] Nov 03 22:51:13.370015 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.369993 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x7d6c"] Nov 03 22:51:13.370157 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.370137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.372935 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.372915 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.377571 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.377270 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 22:51:13.377571 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.377397 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 22:51:13.377571 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.377408 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fq4pb\"" Nov 03 22:51:13.380330 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.380218 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 22:51:13.380330 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.380232 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 22:51:13.380330 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.380297 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 22:51:13.380330 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.380317 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 22:51:13.381385 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.381349 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqd56"] Nov 03 22:51:13.382003 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.381977 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x7d6c"] Nov 03 22:51:13.453161 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d29ed8-adf3-4a5c-802c-a503b37eca31-crio-socket\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.453309 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-tmp-dir\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.453309 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d29ed8-adf3-4a5c-802c-a503b37eca31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.453309 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-metrics-tls\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.453408 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d29ed8-adf3-4a5c-802c-a503b37eca31-data-volume\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.453408 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqcz\" (UniqueName: \"kubernetes.io/projected/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-kube-api-access-5kqcz\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.453408 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jc95\" (UniqueName: \"kubernetes.io/projected/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-api-access-5jc95\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.453495 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.453527 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.453502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-config-volume\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.457293 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.457267 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f6b445b9-5k5ll"] Nov 03 22:51:13.460098 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.460082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.464819 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.464799 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d72xp"] Nov 03 22:51:13.467486 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.467469 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.474269 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.474245 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f6b445b9-5k5ll"] Nov 03 22:51:13.477715 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477693 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 03 22:51:13.477715 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477712 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 03 22:51:13.477877 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477747 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 22:51:13.477877 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477755 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 03 22:51:13.477877 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477792 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 03 22:51:13.477877 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477800 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 03 22:51:13.477877 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477803 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 22:51:13.477877 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477863 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-w6v9t\"" Nov 03 22:51:13.478102 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.477914 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 03 22:51:13.479024 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.479006 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 22:51:13.479165 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.479154 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gxknx\"" Nov 03 22:51:13.479233 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.479219 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 03 22:51:13.479270 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.479223 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvtdb\"" Nov 03 22:51:13.490270 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.490250 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d72xp"] Nov 03 22:51:13.554604 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.554795 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554613 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.554795 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-config-volume\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.554795 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554648 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.554892 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d29ed8-adf3-4a5c-802c-a503b37eca31-crio-socket\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.554927 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-tmp-dir\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.554927 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1693791d-6029-4385-a82b-20e084c7626c-cert\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.555007 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.555007 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.555007 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d29ed8-adf3-4a5c-802c-a503b37eca31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.555007 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.554995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-metrics-tls\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.555155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d29ed8-adf3-4a5c-802c-a503b37eca31-crio-socket\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.555155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.555155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8fd\" (UniqueName: \"kubernetes.io/projected/1693791d-6029-4385-a82b-20e084c7626c-kube-api-access-wv8fd\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.555155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.555275 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d29ed8-adf3-4a5c-802c-a503b37eca31-data-volume\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.555275 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqcz\" (UniqueName: \"kubernetes.io/projected/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-kube-api-access-5kqcz\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.555275 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jc95\" (UniqueName: \"kubernetes.io/projected/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-api-access-5jc95\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.555275 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.555384 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-tmp-dir\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.555464 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-config-volume\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.555502 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.555558 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.555516 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d29ed8-adf3-4a5c-802c-a503b37eca31-data-volume\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.559016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.558992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-metrics-tls\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.559125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.558992 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d29ed8-adf3-4a5c-802c-a503b37eca31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.570791 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.570734 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqcz\" (UniqueName: \"kubernetes.io/projected/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-kube-api-access-5kqcz\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.574016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.573986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jc95\" (UniqueName: \"kubernetes.io/projected/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-api-access-5jc95\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.656136 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1693791d-6029-4385-a82b-20e084c7626c-cert\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8fd\" (UniqueName: \"kubernetes.io/projected/1693791d-6029-4385-a82b-20e084c7626c-kube-api-access-wv8fd\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.656339 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656692 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656355 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.656763 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.656734 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.657609 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.657528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.657792 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.657768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.657960 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.657926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.661326 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.659289 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.661326 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.659354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1693791d-6029-4385-a82b-20e084c7626c-cert\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.662229 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.662208 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.664565 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.664535 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8fd\" (UniqueName: \"kubernetes.io/projected/1693791d-6029-4385-a82b-20e084c7626c-kube-api-access-wv8fd\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.664754 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.664716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.686609 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.686581 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:13.693854 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.693836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:13.770947 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.770920 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:13.778118 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.778096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:13.975386 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.975355 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqd56"] Nov 03 22:51:13.978022 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:13.977999 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x7d6c"] Nov 03 22:51:13.980998 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:13.980968 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d29ed8_adf3_4a5c_802c_a503b37eca31.slice/crio-95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485 WatchSource:0}: Error finding container 95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485: Status 404 returned error can't find the container with id 95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485 Nov 03 22:51:14.053369 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.053345 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d72xp"] Nov 03 22:51:14.056497 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.056473 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f6b445b9-5k5ll"] Nov 03 22:51:14.056596 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:14.056534 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1693791d_6029_4385_a82b_20e084c7626c.slice/crio-4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34 WatchSource:0}: Error finding container 4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34: Status 404 returned error can't find the container with id 4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34 Nov 03 22:51:14.062391 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:14.062368 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0afaa38_0893_4ead_87aa_db622d95c401.slice/crio-c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a WatchSource:0}: Error finding container c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a: Status 404 returned error can't find the container with id c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a Nov 03 22:51:14.356099 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.356063 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7d6c" event={"ID":"34d29ed8-adf3-4a5c-802c-a503b37eca31","Type":"ContainerStarted","Data":"706d3d8a0fc8901937aa728c77622b4a664632d78bdf7dc67d5905b9eeb39a12"} Nov 03 22:51:14.356540 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.356119 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7d6c" event={"ID":"34d29ed8-adf3-4a5c-802c-a503b37eca31","Type":"ContainerStarted","Data":"95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485"} Nov 03 22:51:14.357251 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.357228 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d72xp" event={"ID":"1693791d-6029-4385-a82b-20e084c7626c","Type":"ContainerStarted","Data":"4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34"} Nov 03 22:51:14.358241 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.358218 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqd56" event={"ID":"8b9ab7e1-0444-433c-bf66-e5d004aa40c7","Type":"ContainerStarted","Data":"2b6f329248ef4f225a523e64875dc629bedac06f4d97d13ee25145680855aa5d"} Nov 03 22:51:14.359374 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:14.359357 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6b445b9-5k5ll" event={"ID":"b0afaa38-0893-4ead-87aa-db622d95c401","Type":"ContainerStarted","Data":"c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a"} Nov 03 22:51:15.074974 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.074936 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:15.075376 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.075358 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:15.075839 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.075818 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:15.081633 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081598 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 22:51:15.081765 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081647 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 22:51:15.081824 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081770 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 22:51:15.081885 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081838 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-k9x8r\"" Nov 03 22:51:15.081936 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081889 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dgw9c\"" Nov 03 22:51:15.081978 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081935 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l7l8c\"" Nov 03 22:51:15.082024 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.081979 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 22:51:15.233723 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.233695 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4mbq_22f978bf-c043-4c0c-b895-b3ad7011c9b5/dns-node-resolver/0.log" Nov 03 22:51:15.364749 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:15.364642 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7d6c" event={"ID":"34d29ed8-adf3-4a5c-802c-a503b37eca31","Type":"ContainerStarted","Data":"f878d511826f11c9c4b87702409963b1a031aa8f3ceb8a0c9848b65338f63a38"} Nov 03 22:51:16.428563 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:16.428513 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6wjjx_4a61a276-7283-4fac-8fe0-5ad917832ed7/node-ca/0.log" Nov 03 22:51:17.372794 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:17.372758 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqd56" event={"ID":"8b9ab7e1-0444-433c-bf66-e5d004aa40c7","Type":"ContainerStarted","Data":"274cf3bf17141418663a2dd682fc55b638e0a51bff4fd9f94f4b8d2e8a502c1f"} Nov 03 22:51:17.372998 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:17.372863 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqd56" event={"ID":"8b9ab7e1-0444-433c-bf66-e5d004aa40c7","Type":"ContainerStarted","Data":"e4a7b68c41d24f217d8765539db84d767857f030b15f5c7c7eb269b9e1dab420"} Nov 03 22:51:17.373104 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:17.373072 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:17.376796 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:17.376768 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x7d6c" event={"ID":"34d29ed8-adf3-4a5c-802c-a503b37eca31","Type":"ContainerStarted","Data":"f421d0f18fc43fb2685a3e32a97829937bf19a5f6d97259404be2925b50212e5"} Nov 03 22:51:17.394441 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:17.394374 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-pqd56" podStartSLOduration=2.020692259 podStartE2EDuration="4.394355271s" totalImagesPullingTime="2.373663012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:17.393212358 +0000 UTC m=+51.898319373" watchObservedRunningTime="2026-11-03 22:51:17.394355271 +0000 UTC m=+51.899462280" Nov 03 22:51:18.381812 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:18.381778 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d72xp" event={"ID":"1693791d-6029-4385-a82b-20e084c7626c","Type":"ContainerStarted","Data":"066fc8795f369af6df99c6d10a9da9f7d7474f8a4310d8d2e38b947c621003ac"} Nov 03 22:51:18.383393 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:18.383370 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6b445b9-5k5ll" event={"ID":"b0afaa38-0893-4ead-87aa-db622d95c401","Type":"ContainerStarted","Data":"e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce"} Nov 03 22:51:18.398702 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:18.398635 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d72xp" podStartSLOduration=1.8978722430000001 podStartE2EDuration="5.398621325s" totalImagesPullingTime="3.500749082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:18.39687102 +0000 UTC m=+52.901978024" watchObservedRunningTime="2026-11-03 22:51:18.398621325 +0000 UTC m=+52.903728326" Nov 03 22:51:18.398978 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:18.398958 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x7d6c" podStartSLOduration=2.574491922 podStartE2EDuration="5.39895366s" totalImagesPullingTime="2.824461738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:17.412941498 +0000 UTC m=+51.918048503" watchObservedRunningTime="2026-11-03 22:51:18.39895366 +0000 UTC m=+52.904060664" Nov 03 22:51:18.413062 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:18.413011 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-54f6b445b9-5k5ll" podStartSLOduration=1.824225588 podStartE2EDuration="5.412998806s" totalImagesPullingTime="3.588773218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:18.412629955 +0000 UTC m=+52.917736959" watchObservedRunningTime="2026-11-03 22:51:18.412998806 +0000 UTC m=+52.918105807" Nov 03 22:51:20.449934 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.449897 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb"] Nov 03 22:51:20.453257 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.453238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.460543 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.460512 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 22:51:20.460678 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.460621 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 22:51:20.460678 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.460643 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 03 22:51:20.460777 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.460701 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 03 22:51:20.460777 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.460715 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jbwjx\"" Nov 03 22:51:20.461987 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.461968 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 22:51:20.475037 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.475010 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb"] Nov 03 22:51:20.485278 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.485249 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b6stm"] Nov 03 22:51:20.488826 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.488803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.560750 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.560710 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 22:51:20.560750 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.560734 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbgw4\"" Nov 03 22:51:20.561136 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.560800 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 22:51:20.561136 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.560814 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 22:51:20.613252 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911290aa-0ddf-43ed-a72b-c5a96b98217b-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.613456 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.613456 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.613575 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-tls\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613575 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-wtmp\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613575 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6cdw\" (UniqueName: \"kubernetes.io/projected/911290aa-0ddf-43ed-a72b-c5a96b98217b-kube-api-access-d6cdw\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.613575 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-sys\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613761 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613761 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613691 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613761 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-metrics-client-ca\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613891 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-root\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613891 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljg9\" (UniqueName: \"kubernetes.io/projected/b158d189-1bc5-4434-a09d-960b03d52bde-kube-api-access-qljg9\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.613891 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.613865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-textfile\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714600 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.714600 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-tls\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714600 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-wtmp\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cdw\" (UniqueName: \"kubernetes.io/projected/911290aa-0ddf-43ed-a72b-c5a96b98217b-kube-api-access-d6cdw\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-sys\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714695 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-sys\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714772 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-metrics-client-ca\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.714864 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-wtmp\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715209 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-root\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715209 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljg9\" (UniqueName: \"kubernetes.io/projected/b158d189-1bc5-4434-a09d-960b03d52bde-kube-api-access-qljg9\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715209 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.714978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-textfile\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715209 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-root\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715209 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715020 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911290aa-0ddf-43ed-a72b-c5a96b98217b-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.715701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.715701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-textfile\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-metrics-client-ca\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715701 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.715960 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.715925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911290aa-0ddf-43ed-a72b-c5a96b98217b-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.717262 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.717243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-tls\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.717749 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.717720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.717840 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.717751 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.717992 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.717971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.722830 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.722809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cdw\" (UniqueName: \"kubernetes.io/projected/911290aa-0ddf-43ed-a72b-c5a96b98217b-kube-api-access-d6cdw\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.723365 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.723343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljg9\" (UniqueName: \"kubernetes.io/projected/b158d189-1bc5-4434-a09d-960b03d52bde-kube-api-access-qljg9\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.769189 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.769157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:20.805169 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:20.805062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:20.816885 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:20.816859 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb158d189_1bc5_4434_a09d_960b03d52bde.slice/crio-867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c WatchSource:0}: Error finding container 867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c: Status 404 returned error can't find the container with id 867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c Nov 03 22:51:21.046229 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.046160 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb"] Nov 03 22:51:21.049239 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:21.049213 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911290aa_0ddf_43ed_a72b_c5a96b98217b.slice/crio-57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21 WatchSource:0}: Error finding container 57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21: Status 404 returned error can't find the container with id 57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21 Nov 03 22:51:21.396205 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.396155 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6stm" event={"ID":"b158d189-1bc5-4434-a09d-960b03d52bde","Type":"ContainerStarted","Data":"867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c"} Nov 03 22:51:21.398821 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.398788 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" event={"ID":"911290aa-0ddf-43ed-a72b-c5a96b98217b","Type":"ContainerStarted","Data":"30cd7b9025e6a82703c8277ec0f6d6219c2bb26e96aa63eb64a4b749181f6635"} Nov 03 22:51:21.398975 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.398854 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" event={"ID":"911290aa-0ddf-43ed-a72b-c5a96b98217b","Type":"ContainerStarted","Data":"cac489f0b5d7d14f7d4ef51cc8eb295539c3260379675cbb774994464302d9ab"} Nov 03 22:51:21.398975 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.398875 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" event={"ID":"911290aa-0ddf-43ed-a72b-c5a96b98217b","Type":"ContainerStarted","Data":"57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21"} Nov 03 22:51:21.546055 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.546021 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:51:21.549498 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.549481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.553700 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.553641 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 03 22:51:21.553700 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.553697 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 03 22:51:21.553895 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.553706 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 03 22:51:21.553895 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.553697 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 03 22:51:21.553895 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.553758 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 03 22:51:21.554790 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.554773 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 03 22:51:21.554902 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.554796 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 03 22:51:21.554902 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.554867 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 03 22:51:21.554902 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.554872 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqxw6\"" Nov 03 22:51:21.555026 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.554906 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 03 22:51:21.565026 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.564997 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:51:21.623210 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623210 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623428 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623428 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623428 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623428 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623428 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623596 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623448 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623596 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623596 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623596 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623596 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.623785 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.623647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724489 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724405 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724489 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724489 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724595 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: E1103 22:51:21.724685 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle podName:6d83112e-5266-4d93-a60f-8a6681f30568 nodeName:}" failed. No retries permitted until 2026-11-03 22:51:22.224643934 +0000 UTC m=+56.729750931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568") : configmap references non-existent config key: ca-bundle.crt Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.724771 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.725200 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.725200 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724850 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.725200 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.724936 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.725674 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.725388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.728414 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.728121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.728414 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.728186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.728590 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.728480 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.728590 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.728548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.728721 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.728601 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.729146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.729125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.729146 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.729135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.730303 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.730277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.730810 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.730790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.740803 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.740777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:21.829296 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:21.829269 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:22.227991 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.227947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:22.228769 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.228746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:22.473759 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.473724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:22.552259 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.550985 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56d7b45d9c-69m9m"] Nov 03 22:51:22.565527 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.565495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.565762 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.565742 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56d7b45d9c-69m9m"] Nov 03 22:51:22.570155 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.570131 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 03 22:51:22.570313 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.570195 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 03 22:51:22.570313 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.570291 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 03 22:51:22.570439 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.570425 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fhu3u1v53clad\"" Nov 03 22:51:22.570542 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.570530 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fnkfl\"" Nov 03 22:51:22.571643 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.571602 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 03 22:51:22.571841 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.571648 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 03 22:51:22.631949 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.631913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3676875-09f3-484d-8300-3a3c6e9da22b-tmp\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.631949 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.631952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632137 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.631986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-grpc-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632137 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.632053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3676875-09f3-484d-8300-3a3c6e9da22b-metrics-client-ca\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632137 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.632086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632137 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.632128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632388 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.632150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632388 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.632191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlssz\" (UniqueName: \"kubernetes.io/projected/c3676875-09f3-484d-8300-3a3c6e9da22b-kube-api-access-vlssz\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.632769 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.632315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.733691 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.733833 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.733833 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.733833 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlssz\" (UniqueName: \"kubernetes.io/projected/c3676875-09f3-484d-8300-3a3c6e9da22b-kube-api-access-vlssz\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.733833 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.734022 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3676875-09f3-484d-8300-3a3c6e9da22b-tmp\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.734022 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.734022 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-grpc-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.734022 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.733974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3676875-09f3-484d-8300-3a3c6e9da22b-metrics-client-ca\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.734725 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.734691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3676875-09f3-484d-8300-3a3c6e9da22b-tmp\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.736165 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.736096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3676875-09f3-484d-8300-3a3c6e9da22b-metrics-client-ca\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.737844 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.737814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.737971 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.737855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.738051 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.738032 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-grpc-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.738188 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.738167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.739697 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.739262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.739697 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.739678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.742178 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.742150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlssz\" (UniqueName: \"kubernetes.io/projected/c3676875-09f3-484d-8300-3a3c6e9da22b-kube-api-access-vlssz\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:22.770221 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.770180 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:51:22.772275 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:22.772242 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d83112e_5266_4d93_a60f_8a6681f30568.slice/crio-b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650 WatchSource:0}: Error finding container b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650: Status 404 returned error can't find the container with id b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650 Nov 03 22:51:22.892042 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:22.891980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:23.179410 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.179370 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56d7b45d9c-69m9m"] Nov 03 22:51:23.182436 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:23.182402 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3676875_09f3_484d_8300_3a3c6e9da22b.slice/crio-ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74 WatchSource:0}: Error finding container ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74: Status 404 returned error can't find the container with id ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74 Nov 03 22:51:23.410319 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.410217 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74"} Nov 03 22:51:23.413475 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.413390 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6stm" event={"ID":"b158d189-1bc5-4434-a09d-960b03d52bde","Type":"ContainerStarted","Data":"cc5885a7f27cd2aa94d2898892bdd995f118332481ab6fef1fa85f8eeeeee0de"} Nov 03 22:51:23.415334 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.415303 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650"} Nov 03 22:51:23.418743 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.418716 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" event={"ID":"911290aa-0ddf-43ed-a72b-c5a96b98217b","Type":"ContainerStarted","Data":"bd08d09a0390ee01fbf595b1a5c8e066e42d2a3d417189e0d759c5c19cc600e0"} Nov 03 22:51:23.451635 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.451354 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" podStartSLOduration=1.9568225510000001 podStartE2EDuration="3.451334193s" totalImagesPullingTime="1.494511642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:23.450361874 +0000 UTC m=+57.955468879" watchObservedRunningTime="2026-11-03 22:51:23.451334193 +0000 UTC m=+57.956441198" Nov 03 22:51:23.772068 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.771983 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:23.772509 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.772145 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:23.778556 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.778532 2578 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:23.883144 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.883106 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d558bb4-8f6q2"] Nov 03 22:51:23.886307 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.886283 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.895717 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.895676 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 03 22:51:23.896967 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.896940 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d558bb4-8f6q2"] Nov 03 22:51:23.946805 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.946774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.946938 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.946819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.946938 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.946835 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.947046 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.946974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.947046 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.947008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.947132 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.947047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.947178 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.947129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:23.947285 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:23.947189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048168 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048168 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048168 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048386 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048386 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048386 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048386 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048505 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.048995 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.048957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.049266 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.049247 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.049381 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.049363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.049551 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.049529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.050185 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.050138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.051194 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.051174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.051368 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.051348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.058815 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.058794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.200548 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.200508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:24.424164 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.424128 2578 generic.go:356] "Generic (PLEG): container finished" podID="b158d189-1bc5-4434-a09d-960b03d52bde" containerID="cc5885a7f27cd2aa94d2898892bdd995f118332481ab6fef1fa85f8eeeeee0de" exitCode=0 Nov 03 22:51:24.424323 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.424224 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6stm" event={"ID":"b158d189-1bc5-4434-a09d-960b03d52bde","Type":"ContainerDied","Data":"cc5885a7f27cd2aa94d2898892bdd995f118332481ab6fef1fa85f8eeeeee0de"} Nov 03 22:51:24.426088 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.426061 2578 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745" exitCode=0 Nov 03 22:51:24.426261 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.426109 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745"} Nov 03 22:51:24.431079 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.430915 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:24.487847 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.487465 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d558bb4-8f6q2"] Nov 03 22:51:24.490943 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:24.490912 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00873659_d5eb_4f6e_861e_d96090a8e3a2.slice/crio-32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812 WatchSource:0}: Error finding container 32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812: Status 404 returned error can't find the container with id 32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812 Nov 03 22:51:24.959265 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.959234 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-676d8c84bc-qzgxz"] Nov 03 22:51:24.962601 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.962580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:24.972520 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.972498 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 22:51:24.974996 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.974947 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 03 22:51:24.978291 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.978266 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-676d8c84bc-qzgxz"] Nov 03 22:51:24.991923 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.991893 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 03 22:51:24.992562 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.992543 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dds9k\"" Nov 03 22:51:24.992712 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.992695 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 03 22:51:24.993125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:24.993109 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9fo8ckkovhg49\"" Nov 03 22:51:25.057529 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-client-certs\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.057529 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-tls\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.057763 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.057763 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59f436cf-187c-4753-b7b7-54da03201b6f-audit-log\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.057763 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-client-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.057928 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lfq\" (UniqueName: \"kubernetes.io/projected/59f436cf-187c-4753-b7b7-54da03201b6f-kube-api-access-c4lfq\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.057928 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.057801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-metrics-server-audit-profiles\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159131 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-client-certs\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159246 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-tls\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159299 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159386 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59f436cf-187c-4753-b7b7-54da03201b6f-audit-log\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159458 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-client-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159502 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lfq\" (UniqueName: \"kubernetes.io/projected/59f436cf-187c-4753-b7b7-54da03201b6f-kube-api-access-c4lfq\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.159545 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.159517 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-metrics-server-audit-profiles\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.160084 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.160011 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.160302 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.160193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59f436cf-187c-4753-b7b7-54da03201b6f-audit-log\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.160365 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.160319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-metrics-server-audit-profiles\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.161867 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.161848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-tls\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.162134 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.162109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-client-certs\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.162221 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.162146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-client-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.171125 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.171099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lfq\" (UniqueName: \"kubernetes.io/projected/59f436cf-187c-4753-b7b7-54da03201b6f-kube-api-access-c4lfq\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.280100 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.280066 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:25.433780 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.433744 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"2bd31f1d2b96b65e147dccecb6e87c081d5f3a1ee7c6947d4649855600a34c76"} Nov 03 22:51:25.433975 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.433831 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"656ba4472d55e27dd08eaacee791deda552be15620519b8a49613dd166d5f2cb"} Nov 03 22:51:25.433975 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.433866 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"dd308ed37c5789e78982272a3d4a40f27519e047e23e0acf4e68d58e75fc86e6"} Nov 03 22:51:25.435957 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.435919 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d558bb4-8f6q2" event={"ID":"00873659-d5eb-4f6e-861e-d96090a8e3a2","Type":"ContainerStarted","Data":"cb3cc09939abea02101f7b7d928ca1feefeeeb95779b53840339f20fb33f3e0e"} Nov 03 22:51:25.436076 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.435977 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d558bb4-8f6q2" event={"ID":"00873659-d5eb-4f6e-861e-d96090a8e3a2","Type":"ContainerStarted","Data":"32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812"} Nov 03 22:51:25.438549 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.438524 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6stm" event={"ID":"b158d189-1bc5-4434-a09d-960b03d52bde","Type":"ContainerStarted","Data":"4a9247ce2924bd95dbb3ef7d03a122284a10ba4b879f5dc96dfb8a7472e06114"} Nov 03 22:51:25.438706 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.438583 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6stm" event={"ID":"b158d189-1bc5-4434-a09d-960b03d52bde","Type":"ContainerStarted","Data":"097c853f1fe40f42a702644a141f669471207b82b42cdf7202edd5668b256657"} Nov 03 22:51:25.458276 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.458211 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7d558bb4-8f6q2" podStartSLOduration=2.458192879 podStartE2EDuration="2.458192879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:25.457983503 +0000 UTC m=+59.963090512" watchObservedRunningTime="2026-11-03 22:51:25.458192879 +0000 UTC m=+59.963299880" Nov 03 22:51:25.478301 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.478217 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b6stm" podStartSLOduration=2.874607362 podStartE2EDuration="5.478202409s" totalImagesPullingTime="2.507766273s" totalInitContainerRuntime="95.828774ms" isStatefulPod=true podCreationTimestamp="2026-11-03 22:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:25.47701457 +0000 UTC m=+59.982121586" watchObservedRunningTime="2026-11-03 22:51:25.478202409 +0000 UTC m=+59.983309412" Nov 03 22:51:25.569000 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:25.568975 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-676d8c84bc-qzgxz"] Nov 03 22:51:25.571184 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:25.571158 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f436cf_187c_4753_b7b7_54da03201b6f.slice/crio-3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723 WatchSource:0}: Error finding container 3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723: Status 404 returned error can't find the container with id 3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723 Nov 03 22:51:26.449792 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:26.449751 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" event={"ID":"59f436cf-187c-4753-b7b7-54da03201b6f","Type":"ContainerStarted","Data":"3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723"} Nov 03 22:51:26.453450 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:26.453345 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751"} Nov 03 22:51:27.386087 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.386053 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:27.461404 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.461359 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4"} Nov 03 22:51:27.461866 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.461476 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c"} Nov 03 22:51:27.461866 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.461524 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc"} Nov 03 22:51:27.461866 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.461567 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d"} Nov 03 22:51:27.461866 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.461607 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerStarted","Data":"0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8"} Nov 03 22:51:27.464883 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.464850 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"3133d6351dd5e675faa21fed38af541e87a41b5dd9d34a4838287f47ff858576"} Nov 03 22:51:27.465007 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.464930 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"f4d8153298ebec019d694c4cc555b081b78ef9090e9ccffd55a6dad310db1a21"} Nov 03 22:51:27.465007 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.464972 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" event={"ID":"c3676875-09f3-484d-8300-3a3c6e9da22b","Type":"ContainerStarted","Data":"853327a37cc5696d090f4bf05e39da0f714e158f970f530cb32d91e8c903bf1e"} Nov 03 22:51:27.465171 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.465127 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:27.466813 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.466790 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" event={"ID":"59f436cf-187c-4753-b7b7-54da03201b6f","Type":"ContainerStarted","Data":"47cee6daf184fb6bb2efb4b867f921bf622deda2bc1157ec82e91ad3c3e76cc0"} Nov 03 22:51:27.487700 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.487590 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.449473553 podStartE2EDuration="6.487576104s" totalImagesPullingTime="3.025275317s" totalInitContainerRuntime="12.827234ms" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:27.486057416 +0000 UTC m=+61.991164423" watchObservedRunningTime="2026-11-03 22:51:27.487576104 +0000 UTC m=+61.992683109" Nov 03 22:51:27.507928 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.507879 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" podStartSLOduration=1.8589312489999998 podStartE2EDuration="3.507865049s" totalImagesPullingTime="1.6489338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:27.506024444 +0000 UTC m=+62.011131461" watchObservedRunningTime="2026-11-03 22:51:27.507865049 +0000 UTC m=+62.012972109" Nov 03 22:51:27.532835 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:27.532777 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" podStartSLOduration=2.355876006 podStartE2EDuration="5.53276293s" totalImagesPullingTime="3.176886924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:27.531961219 +0000 UTC m=+62.037068223" watchObservedRunningTime="2026-11-03 22:51:27.53276293 +0000 UTC m=+62.037869934" Nov 03 22:51:30.471148 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.471108 2578 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d558bb4-8f6q2"] Nov 03 22:51:30.499070 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.499036 2578 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6db9cd76d9-fkj8n"] Nov 03 22:51:30.502376 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.502346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.511510 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.511480 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db9cd76d9-fkj8n"] Nov 03 22:51:30.605263 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605221 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605263 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605529 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605529 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605529 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605529 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605735 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.605735 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.605591 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.706543 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.706543 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.706822 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.706822 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.706822 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.706822 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707016 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.706959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707512 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.707111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707512 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.707458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707712 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.707530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707712 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.707550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.707811 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.707742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.709145 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.709129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.709639 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.709622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.715279 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.715253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:30.813873 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:30.813794 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:31.089991 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.089957 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6db9cd76d9-fkj8n"] Nov 03 22:51:31.093050 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:31.093015 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917104af_56ea_402a_a489_677a81bbad80.slice/crio-d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335 WatchSource:0}: Error finding container d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335: Status 404 returned error can't find the container with id d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335 Nov 03 22:51:31.484442 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.484352 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db9cd76d9-fkj8n" event={"ID":"917104af-56ea-402a-a489-677a81bbad80","Type":"ContainerStarted","Data":"2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010"} Nov 03 22:51:31.484442 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.484408 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db9cd76d9-fkj8n" event={"ID":"917104af-56ea-402a-a489-677a81bbad80","Type":"ContainerStarted","Data":"d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335"} Nov 03 22:51:31.503758 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.503703 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6db9cd76d9-fkj8n" podStartSLOduration=1.5036859900000001 podStartE2EDuration="1.50368599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:31.501804104 +0000 UTC m=+66.006911119" watchObservedRunningTime="2026-11-03 22:51:31.50368599 +0000 UTC m=+66.008793057" Nov 03 22:51:31.716337 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.716296 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:31.716501 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.716361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:31.719440 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.719418 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 22:51:31.719567 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.719551 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 22:51:31.728942 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.728921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:31.729203 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.729188 2578 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 22:51:31.739621 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.739565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:31.816942 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.816908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:31.820047 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.820031 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 22:51:31.830388 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.830354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:31.895739 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.895704 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-k9x8r\"" Nov 03 22:51:31.902885 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.902863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:31.904679 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.904647 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l7l8c\"" Nov 03 22:51:31.912108 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.912034 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:31.914695 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.914674 2578 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dgw9c\"" Nov 03 22:51:31.922484 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:31.922458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:32.182858 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:32.182833 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmwkz"] Nov 03 22:51:32.185180 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:32.185147 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630261b5_f7ea_45e3_b243_5b6503684d93.slice/crio-98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469 WatchSource:0}: Error finding container 98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469: Status 404 returned error can't find the container with id 98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469 Nov 03 22:51:32.213387 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:32.213241 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8bw5x"] Nov 03 22:51:32.215830 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:32.215805 2578 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wwlzx"] Nov 03 22:51:32.216217 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:32.216191 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57657f7_583c_49a4_8b97_c8e7980a95ae.slice/crio-67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855 WatchSource:0}: Error finding container 67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855: Status 404 returned error can't find the container with id 67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855 Nov 03 22:51:32.218717 ip-10-0-128-124 kubenswrapper[2578]: W1103 22:51:32.218610 2578 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff675c3_2019_462d_a8de_19897c17fe0a.slice/crio-f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099 WatchSource:0}: Error finding container f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099: Status 404 returned error can't find the container with id f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099 Nov 03 22:51:32.489396 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:32.489362 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmwkz" event={"ID":"630261b5-f7ea-45e3-b243-5b6503684d93","Type":"ContainerStarted","Data":"98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469"} Nov 03 22:51:32.490461 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:32.490437 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wwlzx" event={"ID":"1ff675c3-2019-462d-a8de-19897c17fe0a","Type":"ContainerStarted","Data":"f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099"} Nov 03 22:51:32.491594 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:32.491570 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8bw5x" event={"ID":"e57657f7-583c-49a4-8b97-c8e7980a95ae","Type":"ContainerStarted","Data":"67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855"} Nov 03 22:51:33.480552 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:33.479553 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:34.201491 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:34.201439 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:34.503571 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:34.503476 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wwlzx" event={"ID":"1ff675c3-2019-462d-a8de-19897c17fe0a","Type":"ContainerStarted","Data":"78d8822af728cb55bf2907db1c8f71dd4197eb59544d907d4a8b8f2252e7e030"} Nov 03 22:51:34.503571 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:34.503549 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wwlzx" event={"ID":"1ff675c3-2019-462d-a8de-19897c17fe0a","Type":"ContainerStarted","Data":"f22360d8f22b8a12fe024b363cea708991c6ad305136569e3f6a49a33afa1ea4"} Nov 03 22:51:34.522458 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:34.522397 2578 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wwlzx" podStartSLOduration=67.150800731 podStartE2EDuration="1m8.522382497s" totalImagesPullingTime="1.371581766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:50:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:51:34.519932878 +0000 UTC m=+69.025039895" watchObservedRunningTime="2026-11-03 22:51:34.522382497 +0000 UTC m=+69.027489497" Nov 03 22:51:36.513035 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:36.512996 2578 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmwkz" event={"ID":"630261b5-f7ea-45e3-b243-5b6503684d93","Type":"ContainerStarted","Data":"576b5d5b094666044f6d3a8015322e5f55b20e437866b8627057f7bf8c10a484"} Nov 03 22:51:36.513530 ip-10-0-128-124 kubenswrapper[2578]: I1103 22:51:36.513117 2578 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:38.153387 ip-10-0-128-124 systemd[1]: Stopping Kubernetes Kubelet... Nov 03 22:51:38.174095 ip-10-0-128-124 systemd[1]: kubelet.service: Deactivated successfully. Nov 03 22:51:38.174257 ip-10-0-128-124 systemd[1]: Stopped Kubernetes Kubelet. Nov 03 22:51:38.174307 ip-10-0-128-124 systemd[1]: kubelet.service: Consumed 4.385s CPU time. Nov 03 22:51:38.188449 ip-10-0-128-124 systemd[1]: Starting Kubernetes Kubelet... Nov 03 22:51:38.252112 ip-10-0-128-124 kubenswrapper[6394]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:51:38.252112 ip-10-0-128-124 kubenswrapper[6394]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 22:51:38.252112 ip-10-0-128-124 kubenswrapper[6394]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:51:38.252112 ip-10-0-128-124 kubenswrapper[6394]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 22:51:38.254160 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254075 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.254160 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254160 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254165 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254168 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254171 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254174 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254177 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254180 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254183 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254185 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254188 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254191 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254194 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254196 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254199 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254201 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254204 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254206 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254209 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254211 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254214 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.254228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254217 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254219 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254221 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254224 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254227 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254235 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254239 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254241 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254244 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254246 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254249 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254251 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254255 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254260 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254264 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254267 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254270 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254273 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254276 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.254767 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254278 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254281 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254284 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254286 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254289 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254292 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254295 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254298 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254300 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254303 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254305 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254308 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254311 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254313 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254316 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254318 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254321 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254324 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254326 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.255262 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254329 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254331 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254334 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254336 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254339 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254341 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254343 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254346 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254348 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254351 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254353 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254355 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254358 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254361 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254363 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254367 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254370 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254380 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254385 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254387 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.255765 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254391 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254393 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254396 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254399 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254401 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254405 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254407 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254410 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254412 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254415 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254417 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254420 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254422 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254425 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254427 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254430 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254432 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254435 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254438 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254440 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.256270 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254443 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254445 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254454 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254457 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254459 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254462 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.254466 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255245 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255252 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255256 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255260 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255262 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255265 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255269 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255272 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255275 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255277 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255280 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255283 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.256783 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255285 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255288 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255291 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255293 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255296 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255298 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255300 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255303 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255305 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255308 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255310 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255313 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255315 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255319 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255321 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255324 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255327 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255329 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255332 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255334 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.257269 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255337 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255339 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255342 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255344 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255347 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255349 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255352 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255355 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255358 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255361 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255364 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255366 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255369 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255371 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255374 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255376 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255379 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255386 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255388 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.257788 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255393 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255398 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255401 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255403 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255406 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255409 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255411 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255414 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255417 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255419 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255422 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255424 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255427 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255429 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255431 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255434 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255436 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255439 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255441 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255443 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.258312 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255446 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255451 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255454 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255457 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255460 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255462 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255465 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255467 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255470 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255472 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255475 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255477 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255479 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255482 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255484 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255488 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255492 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255494 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255497 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.258829 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255500 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255502 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255504 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255507 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255509 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255512 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255514 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255516 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255519 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255521 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255524 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255528 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255531 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255533 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255535 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.255542 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256071 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256078 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256080 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.259311 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256083 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256086 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256088 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256091 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256094 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256096 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256099 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256101 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256104 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256107 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256109 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256112 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256114 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256117 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256120 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256122 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256125 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256127 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256130 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256133 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.259786 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256135 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256137 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256140 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256143 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256145 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256148 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256150 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256153 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256158 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256161 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256163 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256166 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256168 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256171 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256173 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256176 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256178 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256181 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256183 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.260300 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256186 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256188 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256190 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256193 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256195 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256198 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256201 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256204 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256206 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256209 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256211 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256213 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256216 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256218 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256221 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256223 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256226 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256228 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256231 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256233 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.261013 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256236 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256240 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256243 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256246 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256252 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256254 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256257 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256260 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256263 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256265 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256268 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256270 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256273 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256276 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256280 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256283 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256286 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256289 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256292 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.261698 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256294 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256297 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256299 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256302 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256305 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256307 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256309 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256312 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256314 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256317 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256319 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256322 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256324 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256327 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256331 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256333 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256336 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256340 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256342 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256345 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.262173 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256347 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256350 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256354 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256359 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.256362 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256452 6394 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256460 6394 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256466 6394 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256470 6394 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256475 6394 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256478 6394 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256482 6394 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256486 6394 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256489 6394 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256492 6394 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256496 6394 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256499 6394 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256502 6394 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256504 6394 flags.go:64] FLAG: --cgroup-root="" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256507 6394 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256510 6394 flags.go:64] FLAG: --client-ca-file="" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256513 6394 flags.go:64] FLAG: --cloud-provider="external" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256516 6394 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 22:51:38.262706 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256523 6394 flags.go:64] FLAG: --cluster-domain="" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256526 6394 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256529 6394 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256532 6394 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256536 6394 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256540 6394 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256544 6394 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256548 6394 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256551 6394 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256554 6394 flags.go:64] FLAG: --contention-profiling="false" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256557 6394 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256560 6394 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256563 6394 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256566 6394 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256570 6394 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256572 6394 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256575 6394 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256578 6394 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256581 6394 flags.go:64] FLAG: --enable-server="true" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256584 6394 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256588 6394 flags.go:64] FLAG: --event-burst="100" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256591 6394 flags.go:64] FLAG: --event-qps="50" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256594 6394 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256597 6394 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 22:51:38.263269 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256600 6394 flags.go:64] FLAG: --eviction-hard="" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256604 6394 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256607 6394 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256610 6394 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256613 6394 flags.go:64] FLAG: --eviction-soft="" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256616 6394 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256618 6394 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256621 6394 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256624 6394 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256627 6394 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256630 6394 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256633 6394 flags.go:64] FLAG: --feature-gates="" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256640 6394 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256643 6394 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256647 6394 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256650 6394 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256672 6394 flags.go:64] FLAG: --healthz-port="10248" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256677 6394 flags.go:64] FLAG: --help="false" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256682 6394 flags.go:64] FLAG: --hostname-override="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256686 6394 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256691 6394 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256696 6394 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256701 6394 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 22:51:38.263929 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256705 6394 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256708 6394 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256711 6394 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256714 6394 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256717 6394 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256720 6394 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256723 6394 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256726 6394 flags.go:64] FLAG: --kube-reserved="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256728 6394 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256731 6394 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256734 6394 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256737 6394 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256740 6394 flags.go:64] FLAG: --lock-file="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256743 6394 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256746 6394 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256749 6394 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256754 6394 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256757 6394 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256760 6394 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256763 6394 flags.go:64] FLAG: --logging-format="text" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256766 6394 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256769 6394 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256772 6394 flags.go:64] FLAG: --manifest-url="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256776 6394 flags.go:64] FLAG: --manifest-url-header="" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256781 6394 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 22:51:38.264512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256784 6394 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256788 6394 flags.go:64] FLAG: --max-pods="110" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256791 6394 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256794 6394 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256797 6394 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256800 6394 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256803 6394 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256806 6394 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256808 6394 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256815 6394 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256818 6394 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256821 6394 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256824 6394 flags.go:64] FLAG: --pod-cidr="" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256827 6394 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256830 6394 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256834 6394 flags.go:64] FLAG: --pods-per-core="0" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256837 6394 flags.go:64] FLAG: --port="10250" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256840 6394 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256843 6394 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0c34f86ef1b6093a7" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256846 6394 flags.go:64] FLAG: --qos-reserved="" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256849 6394 flags.go:64] FLAG: --read-only-port="10255" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256852 6394 flags.go:64] FLAG: --register-node="true" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256854 6394 flags.go:64] FLAG: --register-with-taints="" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256858 6394 flags.go:64] FLAG: --registry-burst="10" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256861 6394 flags.go:64] FLAG: --registry-qps="5" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256864 6394 flags.go:64] FLAG: --reserved-cpus="" Nov 03 22:51:38.265153 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256867 6394 flags.go:64] FLAG: --reserved-memory="" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256870 6394 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256873 6394 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256876 6394 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256880 6394 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256883 6394 flags.go:64] FLAG: --runonce="false" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256886 6394 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256890 6394 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256893 6394 flags.go:64] FLAG: --seccomp-default="false" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256896 6394 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256898 6394 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256901 6394 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256904 6394 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256907 6394 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256910 6394 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256913 6394 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256916 6394 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256919 6394 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256922 6394 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256924 6394 flags.go:64] FLAG: --system-cgroups="" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256927 6394 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256934 6394 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256936 6394 flags.go:64] FLAG: --tls-cert-file="" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256939 6394 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256943 6394 flags.go:64] FLAG: --tls-min-version="" Nov 03 22:51:38.265837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256946 6394 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256949 6394 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256952 6394 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256955 6394 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256957 6394 flags.go:64] FLAG: --v="2" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256962 6394 flags.go:64] FLAG: --version="false" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256966 6394 flags.go:64] FLAG: --vmodule="" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256970 6394 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.256973 6394 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257107 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257112 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257117 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257120 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257123 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257125 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257128 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257131 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257134 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257136 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257139 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257141 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.266462 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257144 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257148 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257152 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257154 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257157 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257160 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257164 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257169 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257172 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257175 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257178 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257180 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257183 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257185 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257187 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257190 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257193 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257195 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257198 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.267011 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257200 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257202 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257205 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257209 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257212 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257214 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257217 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257219 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257222 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257224 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257227 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257229 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257232 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257234 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257237 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257239 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257241 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257244 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257246 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.267643 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257249 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257253 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257255 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257258 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257260 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257263 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257265 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257268 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257270 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257273 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257276 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257279 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257281 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257284 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257286 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257289 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257292 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257294 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257297 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257300 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.268228 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257302 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257304 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257307 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257309 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257312 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257315 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257317 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257319 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257322 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257324 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257326 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257329 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257331 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257335 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257338 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257340 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257342 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257345 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257347 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257350 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.269180 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257353 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257355 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257357 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257360 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257362 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257365 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257367 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257370 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257372 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257374 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257377 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257379 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257382 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257384 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257386 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257389 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.270122 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.257414 6394 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257450 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257456 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257459 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257462 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257464 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257467 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257469 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257472 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257475 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257478 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257481 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257483 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257486 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257489 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257491 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257494 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257496 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257499 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257501 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.270691 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257504 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257506 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257509 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257511 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257514 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257516 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257519 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257521 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257523 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257525 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257528 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257530 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257533 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257536 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257538 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257541 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257543 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257545 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257548 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.271322 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257550 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257554 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257559 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257562 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257564 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257567 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257571 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257575 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257578 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257580 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257583 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257586 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257589 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257591 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257594 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257596 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257599 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257602 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257604 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.271909 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257607 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257609 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257612 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257614 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257617 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257619 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257621 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257624 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257627 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257631 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257633 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257635 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257638 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257641 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257643 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257647 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257649 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257652 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257670 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.272390 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257675 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257679 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257683 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257686 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257691 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257695 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257698 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257700 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257703 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257706 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257708 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257711 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257714 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257716 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257718 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257721 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257724 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257726 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257729 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257731 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.272875 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257734 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257737 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257741 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257744 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257746 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257750 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257752 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257755 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257759 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.257761 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.262886 6394 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.262901 6394 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.262919 6394 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.262924 6394 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.262981 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.262986 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.262989 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.262992 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.262994 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.262997 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.273369 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263001 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263003 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263006 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263008 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263011 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263014 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263016 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263019 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263022 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263024 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263027 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263030 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263032 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263035 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263038 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263040 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263043 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263045 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263048 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.273980 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263050 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263053 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263056 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263059 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263062 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263064 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263067 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263070 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263072 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263075 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263077 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263080 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263082 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263085 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263087 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263090 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263092 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263094 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263097 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263099 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.274457 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263102 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263105 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263107 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263110 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263112 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263115 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263118 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263120 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263123 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263127 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263130 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263133 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263136 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263139 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263141 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263144 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263147 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263150 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263152 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.274959 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263156 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263159 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263162 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263166 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263168 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263171 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263173 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263176 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263178 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263181 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263183 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263186 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263188 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263191 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263194 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263197 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263199 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263202 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263204 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.275620 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263207 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263209 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263211 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263214 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263216 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263219 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263221 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263223 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263226 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263228 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263231 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263234 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263236 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263239 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263241 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263244 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263246 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263249 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263251 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263254 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.276341 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263256 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263259 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263261 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.263289 6394 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263428 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263435 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263438 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263440 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263443 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263447 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263450 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263452 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263455 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263458 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263461 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263463 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.276847 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263466 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263468 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263471 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263473 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263476 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263478 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263481 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263484 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263486 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263488 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263491 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263493 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263496 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263498 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263501 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263503 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263506 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263508 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263510 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.277272 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263513 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263516 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263518 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263520 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263523 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263525 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263528 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263531 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263534 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263536 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263538 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263541 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263543 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263546 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263548 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263551 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263553 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263556 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263558 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263561 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.277754 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263563 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263566 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263568 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263570 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263573 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263576 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263580 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263583 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263585 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263588 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263590 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263592 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263595 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263597 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263600 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263602 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263605 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263607 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263609 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.278248 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263612 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263615 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263617 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263620 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263623 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263625 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263627 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263630 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263632 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263635 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263637 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263640 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263643 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263645 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263647 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263650 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263652 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263673 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263676 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263679 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.278728 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263681 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263684 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263686 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263689 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263692 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263694 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263697 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263699 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263702 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263704 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263708 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263711 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263715 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263718 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263722 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.279213 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263724 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.263748 6394 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263796 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263801 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263804 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263807 6394 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263810 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263813 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263817 6394 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263819 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263822 6394 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263825 6394 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263828 6394 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263830 6394 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263834 6394 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 22:51:38.279573 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263838 6394 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263841 6394 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263844 6394 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263847 6394 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263849 6394 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263852 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263854 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263856 6394 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263859 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263874 6394 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263878 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263881 6394 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263884 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263887 6394 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263890 6394 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263892 6394 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263895 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263898 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263901 6394 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263903 6394 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 22:51:38.280036 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263905 6394 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263908 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263910 6394 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263913 6394 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263915 6394 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263918 6394 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263920 6394 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263923 6394 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263925 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263927 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263930 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263933 6394 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263935 6394 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263938 6394 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263941 6394 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263944 6394 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263947 6394 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263950 6394 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263952 6394 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263954 6394 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 22:51:38.280527 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263957 6394 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263959 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263962 6394 feature_gate.go:386] unrecognized feature gate: Example Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263964 6394 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263967 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263969 6394 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263971 6394 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263974 6394 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263976 6394 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263979 6394 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263982 6394 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263985 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263987 6394 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263989 6394 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263992 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263994 6394 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263997 6394 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.263999 6394 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264002 6394 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264005 6394 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 22:51:38.281143 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264007 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264011 6394 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264014 6394 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264017 6394 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264023 6394 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264026 6394 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264029 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264031 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264034 6394 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264036 6394 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264039 6394 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264042 6394 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264044 6394 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264047 6394 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264049 6394 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264052 6394 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264054 6394 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264057 6394 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264060 6394 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 22:51:38.281689 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264062 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264065 6394 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264067 6394 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264070 6394 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264073 6394 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264076 6394 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264078 6394 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264081 6394 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264083 6394 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264086 6394 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264089 6394 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264091 6394 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264093 6394 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:51:38.264097 6394 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.264148 6394 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265093 6394 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265141 6394 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265323 6394 server.go:1014] "Starting client certificate rotation" Nov 03 22:51:38.282165 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265461 6394 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265522 6394 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 22:45:25 +0000 UTC" deadline="2028-06-04 02:04:03.128136822 +0000 UTC" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265549 6394 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13875h12m24.86258937s" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.265800 6394 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.266835 6394 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.267982 6394 log.go:25] "Validated CRI v1 runtime API" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.270356 6394 log.go:25] "Validated CRI v1 image API" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.271141 6394 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 22:51:38.282608 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.273308 6394 fs.go:135] Filesystem UUIDs: map[444f2e5b-8705-4259-9f80-10315ed28b9a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b38531d3-574c-4593-ac4f-7db85308c23b:/dev/nvme0n1p3] Nov 03 22:51:38.282896 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.273329 6394 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1fade03ecacc45e2d89ece436905aad2debe2c44042f9a346f564aa1fd50e0c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1fade03ecacc45e2d89ece436905aad2debe2c44042f9a346f564aa1fd50e0c2/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2b6f329248ef4f225a523e64875dc629bedac06f4d97d13ee25145680855aa5d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2b6f329248ef4f225a523e64875dc629bedac06f4d97d13ee25145680855aa5d/userdata/shm major:0 minor:208 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812/userdata/shm major:0 minor:321 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd/userdata/shm major:0 minor:95 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21/userdata/shm major:0 minor:269 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855/userdata/shm major:0 minor:435 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/67fb3cbcfd96c3aaccc5bbe341ea34b6302a9d0bfc68cb8da9ce3434ba7ee3c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/67fb3cbcfd96c3aaccc5bbe341ea34b6302a9d0bfc68cb8da9ce3434ba7ee3c0/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c/userdata/shm major:0 minor:271 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485/userdata/shm major:0 minor:210 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469/userdata/shm major:0 minor:433 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0e5c3065548bbceb14a06e103d95e70ac9bed23d031e0762d19e0151732d858/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0e5c3065548bbceb14a06e103d95e70ac9bed23d031e0762d19e0151732d858/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650/userdata/shm major:0 minor:298 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74/userdata/shm major:0 minor:314 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335/userdata/shm major:0 minor:420 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099/userdata/shm major:0 minor:437 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbf58cea2e777a9e1c98c2fccc0cbeddc5832f7ec39af8dff9a0fd533d933606/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbf58cea2e777a9e1c98c2fccc0cbeddc5832f7ec39af8dff9a0fd533d933606/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~projected/kube-api-access-64dz9:{mountpoint:/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~projected/kube-api-access-64dz9 major:0 minor:320 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/14d6f850-0120-4b49-9428-46913ac8566b/volumes/kubernetes.io~projected/kube-api-access-lglsv:{mountpoint:/var/lib/kubelet/pods/14d6f850-0120-4b49-9428-46913ac8566b/volumes/kubernetes.io~projected/kube-api-access-lglsv major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1693791d-6029-4385-a82b-20e084c7626c/volumes/kubernetes.io~projected/kube-api-access-wv8fd:{mountpoint:/var/lib/kubelet/pods/1693791d-6029-4385-a82b-20e084c7626c/volumes/kubernetes.io~projected/kube-api-access-wv8fd major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1693791d-6029-4385-a82b-20e084c7626c/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/1693791d-6029-4385-a82b-20e084c7626c/volumes/kubernetes.io~secret/cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b5f0856-7192-47d0-9590-8b4fd79add4b/volumes/kubernetes.io~projected/kube-api-access-vfzxz:{mountpoint:/var/lib/kubelet/pods/1b5f0856-7192-47d0-9590-8b4fd79add4b/volumes/kubernetes.io~projected/kube-api-access-vfzxz major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff675c3-2019-462d-a8de-19897c17fe0a/volumes/kubernetes.io~projected/kube-api-access-cj2xx:{mountpoint:/var/lib/kubelet/pods/1ff675c3-2019-462d-a8de-19897c17fe0a/volumes/kubernetes.io~projected/kube-api-access-cj2xx major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff675c3-2019-462d-a8de-19897c17fe0a/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/1ff675c3-2019-462d-a8de-19897c17fe0a/volumes/kubernetes.io~secret/metrics-certs major:0 minor:426 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/22f978bf-c043-4c0c-b895-b3ad7011c9b5/volumes/kubernetes.io~projected/kube-api-access-tbt5q:{mountpoint:/var/lib/kubelet/pods/22f978bf-c043-4c0c-b895-b3ad7011c9b5/volumes/kubernetes.io~projected/kube-api-access-tbt5q major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34d29ed8-adf3-4a5c-802c-a503b37eca31/volumes/kubernetes.io~projected/kube-api-access-5jc95:{mountpoint:/var/lib/kubelet/pods/34d29ed8-adf3-4a5c-802c-a503b37eca31/volumes/kubernetes.io~projected/kube-api-access-5jc95 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34d29ed8-adf3-4a5c-802c-a503b37eca31/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/34d29ed8-adf3-4a5c-802c-a503b37eca31/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a61a276-7283-4fac-8fe0-5ad917832ed7/volumes/kubernetes.io~projected/kube-api-access-skql9:{mountpoint:/var/lib/kubelet/pods/4a61a276-7283-4fac-8fe0-5ad917832ed7/volumes/kubernetes.io~projected/kube-api-access-skql9 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~projected/kube-api-access-c4lfq:{mountpoint:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~projected/kube-api-access-c4lfq major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:344 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/630261b5-f7ea-45e3-b243-5b6503684d93/volumes/kubernetes.io~projected/kube-api-access-nqvqn:{mountpoint:/var/lib/kubelet/pods/630261b5-f7ea-45e3-b243-5b6503684d93/volumes/kubernetes.io~projected/kube-api-access-nqvqn major:0 minor:431 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/67cf6892-73a4-43fb-9126-b8226bb5406d/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/67cf6892-73a4-43fb-9126-b8226bb5406d/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/alertmanager/9 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/config-reloader/6 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~empty-dir/config-out major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~projected/kube-api-access-6ht5d:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~projected/kube-api-access-6ht5d major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~projected/tls-assets major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/config-volume major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/web-config major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~projected/kube-api-access-nt9tp:{mountpoint:/var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~projected/kube-api-access-nt9tp major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8a9a75f9-9976-4d50-af9e-cc680ff1e36f/volumes/kubernetes.io~projected/kube-api-access-6mkqv:{mountpoint:/var/lib/kubelet/pods/8a9a75f9-9976-4d50-af9e-cc680ff1e36f/volumes/kubernetes.io~projected/kube-api-access-6mkqv major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b9ab7e1-0444-433c-bf66-e5d004aa40c7/volumes/kubernetes.io~projected/kube-api-access-5kqcz:{mountpoint:/var/lib/kubelet/pods/8b9ab7e1-0444-433c-bf66-e5d004aa40c7/volumes/kubernetes.io~projected/kube-api-access-5kqcz major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8b9ab7e1-0444-433c-bf66-e5d004aa40c7/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/8b9ab7e1-0444-433c-bf66-e5d004aa40c7/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~projected/kube-api-access-d6cdw:{mountpoint:/var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~projected/kube-api-access-d6cdw major:0 minor:267 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:266 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:264 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~projected/kube-api-access-qwplj:{mountpoint:/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~projected/kube-api-access-qwplj major:0 minor:419 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:413 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:418 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~projected/kube-api-access-6kddw:{mountpoint:/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~projected/kube-api-access-6kddw major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~projected/kube-api-access-qljg9:{mountpoint:/var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~projected/kube-api-access-qljg9 major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:265 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:259 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~projected/kube-api-access-vlssz:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~projected/kube-api-access-vlssz major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:307 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:308 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:302 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:309 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volumes/kubernetes.io~projected/kube-api-access-sv7kc:{mountpoint:/var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volumes/kubernetes.io~projected/kube-api-access-sv7kc major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e57657f7-583c-49a4-8b97-c8e7980a95ae/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/e57657f7-583c-49a4-8b97-c8e7980a95ae/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:432 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eeb53852-5e0f-4152-a623-e7e3126a15d8/volumes/kubernetes.io~projected/kube-api-access-558nw:{mountpoint:/var/lib/kubelet/pods/eeb53852-5e0f-4152-a623-e7e3126a15d8/volumes/kubernetes.io~projected/kube-api-access-558nw major:0 minor:67 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/86bac6ed14109110d5719fd9cc827af5ed26b8bace9026a8825107863f72f273/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/6762256743dbf1d9be624e20c3591407dfd540b283eb7e967791426d4d023e6c/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/0277548cf55e7f152ce52374bb1658ff8f7b25397a89beee76d1c9548bbc3b26/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/eae575c5dec0da6d83f8b881a213a87e0b6329b0016baecbbeb7a3b0ee5e7788/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/195b7215a9de080563c8418bc177c119ef95108d10e003e4adef4871724ffce2/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/06e624b724ff140fec6b2dbb56c435b0a7dfce40773d17b42960422bd6034907/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/941a059943027a28bdd59652254242a3b764dae355678d771966ab63779aace9/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/b30d67f16ded7772f4a9999c19598dbca943bc7c2e7a44545fa03ba28fec21e4/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/0c93c250d4ec258a9c08d3e270c64361cb4f2ffc5ed5c8f4b7753e2889d10e58/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/0145a33b30a3fc3f7e894996f6eb3f31cec4bfbea8d0922063b7b307bcc4e2e1/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/8eda7a64d05f664fa7990fb9bcfce569bf1d036b0e90b0169b4719c8789a800a/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/265b9a4167c02709b419e7e410e8a50247071e7e8e6560253c0cdc7cabb33de2/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/fbc2662519fe660f6a6473dd67729da14dc914605a3417034255c0a6b662874e/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/e32c9804b1fb6649d1ae6fe84f36611452beaa69d456a7cc70b9f1161d7c795a/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-163:{mountpoint:/var/lib/containers/storage/overlay/bbbe79d3e2b3968401bdf65b1b42b80298e0dedf3f839ec29cdd5a06a7d6bd77/merged major:0 minor:163 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/55ab978366bbe338e5a39078d1eed9efbf25ebbef125a4dc63c55125ae7e61ad/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/231ff50d1a9dd51aaf7a0af408be1e91e1f4017ba997f1cd31b54400d1995c75/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/a56256f09d21c2bfce12defd1c8ce3748725643725232d6e3e1f4818004aeb44/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/52e972dc6646d02fe22cd2ac27f3a114bc8128a77a4e2614a99284792d11ab06/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/c8f5770f850f43f9b62b34a43d72705dd4f7a09d744fa3b3728fa346b60b1f9a/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/dbcd1f909d58db87f4398c26aec0d49b72bb2fa38f1df4035b60e1a1f6bd3151/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-216:{mountpoint:/var/lib/containers/storage/overlay/a091f7f89bf9bef02845c0b5b74aa98f6cec72b764e8381334c860d21f6e5a80/merged major:0 minor:216 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/684fa95615ef1907fdd9fec25369ffc729127e2643ad2833a243f2860dc4860d/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/347a0dd41a9a880ed92b468af0481e23d40e927988d5a224153dcb5d87cfeadb/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/6115be499ea8f1e601bdbc994a0b3c2870ec9aa670e224b5ea11a68c6f96ad55/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-227:{mountpoint:/var/lib/containers/storage/overlay/86e1839d80af96a457f90be963657c5363c9525ef7f530d2d556e36ed9ed381b/merged major:0 minor:227 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/bf927a3c55f23962e1c33aac50f40ab1878bcb83ea44e88a526d27f64076a8b0/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-232:{mountpoint:/var/lib/containers/storage/overlay/c55732291d06f5f0c0bd1596a8663220e5cf3043614933074b90f2a9aafd62ff/merged major:0 minor:232 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/01cad1049697e133e93f8f30c3c9505fdb0d6e48ae266504081a648d0283cc34/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-243:{mountpoint:/var/lib/containers/storage/overlay/8bffc33cf17f78b334a5a456c48dce86bca770007b4a62122c4030cc9bbdc728/merged major:0 minor:243 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/633e3ec5438c9d1786743be2b9dc2ebb808c38ed7304fb63b6ab366502a8be65/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/588999da6b886e4b08e064f494f6b6c9f93b9c56350681deae0999b8fb795cd0/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/773c388b0798172ee69d6f48c0240b7142859d6816331ed80509da8698894c70/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/f63b13f64e5e2153dae0da78c8c58e743c7ca6f94ef995a88e5a4987f64476d3/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/c29a3bdd09b93a660fba9f40b1bcc97d50822a467e2263637dac1f3adf48b256/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-279:{mountpoint:/var/lib/containers/storage/overlay/d237bd8ab6a899b5836c96fd1bf5956f5af9314195af72fce1d2b523df7031d1/merged major:0 minor:279 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/ac109500eaa17345d5247bd5b80465ec7d0f8e68b7374da14bff7663682b7a02/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/8f095447e991b39dee98903b05af9dee6b7fb0781fbac1c61c75a6507037bf2d/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/99d912de7fc7024ebbc5525bf44cc3d3217194a8b386a46c4856937d69bf2728/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/8289a5a82b97fc285a16f3b4f538ae79c57b7f25e23f46a39a5d8933c15a86db/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-325:{mountpoint:/var/lib/containers/storage/overlay/5480285bbd6034088bcde300dd94cb1f807cb9809a0080d85c361329e0a67530/merged major:0 minor:325 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/599f29f22e3cf63e3184a9f672b7bac37b763607bdc7c359a8854a9cb5600784/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/a5d7f55a463abb287d18f56980c59736a091575afc5ffa1caa386f16864b364e/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/75abf7219630262883a900dd430c0aa191644616bd8a1fbcab75e891b1e25866/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-347:{mountpoint:/var/lib/containers/storage/overlay/a69655ed01b7b21238c6fcd66deac0c97aa4c43b18155b8a684edda01d36d1a4/merged major:0 minor:347 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/be603cf66a140707539ecff2384933371db4b770f31376d15588d63ff691e590/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/e573def04d6523134d5fd3bd9c48a65e2f62020b41a4171051a25acbef5ed969/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/afcdaf1c04d5a85117b92c83fdbf179b4eb2e5b55a9e502c23dcc79243f4b400/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/9e26db7386e147f0d998ed2070c33e2ffd594f2c0a8f48a261fc8050b5c78d01/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/ce3fdf4094631a6bbff362f47dc80ceb6dbc6440f8564879cfff2a491d52dcff/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/cb71e9e86e35c460e58997d6991fcb91cdcc1813a7ffa647e5dcf150f35499e2/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-383:{mountpoint:/var/lib/containers/storage/overlay/84385919f0b4a5a15dbbe213480cfd0a6f5b6b29be3960b97c1dc8af62f39d97/merged major:0 minor:383 fsType:overlay blockSize:0} overlay_0-388:{mountpoint:/var/lib/containers/storage/overlay/cdeaaed53994c3aba7bcad6511aeba6405f5a68053273a8493953a7aeb17ef7e/merged major:0 minor:388 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/6b08653d18021fc6259b299e4d4f00f49802045049938033a81440a934eaa6b4/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-398:{mountpoint:/var/lib/containers/storage/overlay/9735f8bda0e2b58127090df649d60bf5dbc1229ba0f1541552518b7032e5ea7e/merged major:0 minor:398 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/12b9e67e83e26395454863ff7a7307cb644d1f1fffa1773aa8fa0ef35ce2f30d/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-408:{mountpoint:/var/lib/containers/storage/overlay/992a8e56738e9635f75ea990b9525fca4c149fd9d06c7467bc8db7387847d029/merged major:0 minor:408 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/8f134128dfd791d8f28aee390ddbf96ffb9f5eecdb4bc0db49ac30f9ecd943c9/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/4743849d1079b9a0496748bb4c62880c600d1bdaf63f9b278af123f96016d27a/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-439:{mountpoint:/var/lib/containers/storage/overlay/9dcf9f1afbee1f07db0f59bd977995bb51e94747b81678b9183388c6026bc30f/merged major:0 minor:439 fsType:overlay blockSize:0} overlay_0-441:{mountpoint:/var/lib/containers/storage/overlay/fd9d8daccffebc7bd279fab51ce79d714192cda0a4546029adb62f0234e60679/merged major:0 minor:441 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/5e42293e13de3391d845e0c78065d36c866ee0370cc84a7d07ff62d0cb789246/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-445:{mountpoint:/var/lib/containers/storage/overlay/10ba3b99d04da8658a48acbb7414115c0a90433ba6e8542cbee8e67cf1d0795a/merged major:0 minor:445 fsType:overlay blockSize:0} overlay_0-447:{mountpoint:/var/lib/containers/storage/overlay/5d9ad61e17edd58da5a96ad17c4f68c03a458a01d503d3c2f801ba77a5bcd1b5/merged major:0 minor:447 fsType:overlay blockSize:0} overlay_0-453:{mountpoint:/var/lib/containers/storage/overlay/4a8607be8bcc31bb272219892e9e8098e444c8ce8ad4dc16d4e21bd494e40e25/merged major:0 minor:453 fsType:overlay blockSize:0} overlay_0-458:{mountpoint:/var/lib/containers/storage/overlay/05ec35ffe5ebb103acfe773a2b26fb6477d2dbd073add831e08e8426d88c4f4a/merged major:0 minor:458 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/920d0d546c19c9cc7410e22e2245a30973e322f1d5a25e1b844c754f5a182703/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/13a3338de6af9f453156628aed8ee4e985848b5972d4c50b7e6011bf1ee23b9b/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/6d8e915d91f3d58f1e15c33584a76e813aa6b3d97adcd0080d258b676a7b0b90/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/c5649185c559fd4026f7168de8241d347a91f569658b2ab770b005e86deebf44/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/63b9420db643766b124dea9213afeaf5738185c9022a76916e257aedc4e1e316/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-81:{mountpoint:/var/lib/containers/storage/overlay/8a27299689f9b18ae4bbe6a68d37b4104705d87d69204d7e64f3343dfeb898b6/merged major:0 minor:81 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/26ad0243e16b1c0982cdff4b25d951ad8ccca6961d8e0383de2650c9c3fde827/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5d48cfda5a159824c50186445969c18d4d0eb73bce7348d960e2ba683ab9f47e/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/cc3700b236ddfab2325c8f2ac42e1f18e1b85faa1306c6d0d6693d952eddfb48/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-97:{mountpoint:/var/lib/containers/storage/overlay/69a0c85e6f89982c1c5bd7fda67a2daafe1a658533ab6134555e8ca32e5a35b9/merged major:0 minor:97 fsType:overlay blockSize:0}] Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.282116 6394 manager.go:217] Machine: {Timestamp:2026-11-03 22:51:38.281643903 +0000 UTC m=+0.058613102 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3151109 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b70781e8e900832b388fce379a0ce SystemUUID:ec2b7078-1e8e-9008-32b3-88fce379a0ce BootID:eb31a8c9-c1f2-4287-b7cc-e9cf39dcfae7 Filesystems:[{Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:302 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~projected/kube-api-access-qljg9 DeviceMajor:0 DeviceMinor:268 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-445 DeviceMajor:0 DeviceMinor:445 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~projected/kube-api-access-nt9tp DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:295 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:306 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~projected/kube-api-access-qwplj DeviceMajor:0 DeviceMinor:419 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:265 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f57f9ed6abb4ead49fce266d4d3460d2d7abae24e84f370d1cc9f252d0046099/userdata/shm DeviceMajor:0 DeviceMinor:437 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-441 DeviceMajor:0 DeviceMinor:441 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/14d6f850-0120-4b49-9428-46913ac8566b/volumes/kubernetes.io~projected/kube-api-access-lglsv DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1693791d-6029-4385-a82b-20e084c7626c/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~projected/kube-api-access-c4lfq DeviceMajor:0 DeviceMinor:346 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8a9a75f9-9976-4d50-af9e-cc680ff1e36f/volumes/kubernetes.io~projected/kube-api-access-6mkqv DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:310 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-408 DeviceMajor:0 DeviceMinor:408 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e57657f7-583c-49a4-8b97-c8e7980a95ae/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:432 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/34d29ed8-adf3-4a5c-802c-a503b37eca31/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-232 DeviceMajor:0 DeviceMinor:232 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-447 DeviceMajor:0 DeviceMinor:447 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volumes/kubernetes.io~projected/kube-api-access-sv7kc DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/22f978bf-c043-4c0c-b895-b3ad7011c9b5/volumes/kubernetes.io~projected/kube-api-access-tbt5q DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:266 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-325 DeviceMajor:0 DeviceMinor:325 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a61a276-7283-4fac-8fe0-5ad917832ed7/volumes/kubernetes.io~projected/kube-api-access-skql9 DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:307 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:309 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/98c7ca3591bd7d9a38311083f712aa87823b3b7aeda74aa5df106e3bd817b469/userdata/shm DeviceMajor:0 DeviceMinor:433 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff675c3-2019-462d-a8de-19897c17fe0a/volumes/kubernetes.io~projected/kube-api-access-cj2xx DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-398 DeviceMajor:0 DeviceMinor:398 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/832cb00edb6b610499da9d7ef4f2656738041aabfd7981d1d532107863cc241c/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0e5c3065548bbceb14a06e103d95e70ac9bed23d031e0762d19e0151732d858/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/454e7c86b96a5930c5da777fab728da708364865c4c8923ae3db425e0c1e99fd/userdata/shm DeviceMajor:0 DeviceMinor:95 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/34d29ed8-adf3-4a5c-802c-a503b37eca31/volumes/kubernetes.io~projected/kube-api-access-5jc95 DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:296 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-216 DeviceMajor:0 DeviceMinor:216 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~projected/kube-api-access-d6cdw DeviceMajor:0 DeviceMinor:267 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/630261b5-f7ea-45e3-b243-5b6503684d93/volumes/kubernetes.io~projected/kube-api-access-nqvqn DeviceMajor:0 DeviceMinor:431 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1fade03ecacc45e2d89ece436905aad2debe2c44042f9a346f564aa1fd50e0c2/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-81 DeviceMajor:0 DeviceMinor:81 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/867b6ec36cd67920ced4f5cb4897762267c0cd701a4ee2f737d9c19f9029d67c/userdata/shm DeviceMajor:0 DeviceMinor:271 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ccd344f3a18853aa03a27a895dc29d257c972336503078bf5f5b21c964ce5f74/userdata/shm DeviceMajor:0 DeviceMinor:314 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335/userdata/shm DeviceMajor:0 DeviceMinor:420 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2b6f329248ef4f225a523e64875dc629bedac06f4d97d13ee25145680855aa5d/userdata/shm DeviceMajor:0 DeviceMinor:208 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:290 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650/userdata/shm DeviceMajor:0 DeviceMinor:298 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3a8e6e26428f1e5bb4de96257c2ed28d7136d0e808f0c2f2e1ae52ae7427b723/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff675c3-2019-462d-a8de-19897c17fe0a/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:426 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbf58cea2e777a9e1c98c2fccc0cbeddc5832f7ec39af8dff9a0fd533d933606/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-227 DeviceMajor:0 DeviceMinor:227 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-243 DeviceMajor:0 DeviceMinor:243 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~projected/kube-api-access-vlssz DeviceMajor:0 DeviceMinor:311 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-453 DeviceMajor:0 DeviceMinor:453 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~projected/kube-api-access-6ht5d DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0d8c904b4366b34d8ddb564c3a9c6f2fe01c990adddf1f0735dec9c856232538/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:289 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:285 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~projected/kube-api-access-64dz9 DeviceMajor:0 DeviceMinor:320 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eeb53852-5e0f-4152-a623-e7e3126a15d8/volumes/kubernetes.io~projected/kube-api-access-558nw DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/95d98a292a9e351184265e1d20100144f8723309cd0db2a20bdc91257d4df485/userdata/shm DeviceMajor:0 DeviceMinor:210 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812/userdata/shm DeviceMajor:0 DeviceMinor:321 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/980c77a906a7cb27fd2a6b6c12a9e536d1a26701c243e08a7db502e9ba11b6c7/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-388 DeviceMajor:0 DeviceMinor:388 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/57d05c2952cdc715c353ea0fc4925030d02d25c4712fd06315491484b80c8d21/userdata/shm DeviceMajor:0 DeviceMinor:269 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-347 DeviceMajor:0 DeviceMinor:347 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-439 DeviceMajor:0 DeviceMinor:439 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:344 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1693791d-6029-4385-a82b-20e084c7626c/volumes/kubernetes.io~projected/kube-api-access-wv8fd DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/911290aa-0ddf-43ed-a72b-c5a96b98217b/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:264 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:291 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7d76008d-f4a0-4f61-bad9-8362f553da69/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:418 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-163 DeviceMajor:0 DeviceMinor:163 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d27625f5-b27a-4797-8137-286db96afd2b/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-97 DeviceMajor:0 DeviceMinor:97 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes/kubernetes.io~projected/kube-api-access-6kddw DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:294 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:343 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:290 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c3676875-09f3-484d-8300-3a3c6e9da22b/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:308 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-383 DeviceMajor:0 DeviceMinor:383 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:413 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/67170db5771ea8e31844a8eb4892d11e61a3f7bbbc201c8401652ecb8217e855/userdata/shm DeviceMajor:0 DeviceMinor:435 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-279 DeviceMajor:0 DeviceMinor:279 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:319 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:292 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/67fb3cbcfd96c3aaccc5bbe341ea34b6302a9d0bfc68cb8da9ce3434ba7ee3c0/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/59f436cf-187c-4753-b7b7-54da03201b6f/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:345 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:290 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-458 DeviceMajor:0 DeviceMinor:458 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1b5f0856-7192-47d0-9590-8b4fd79add4b/volumes/kubernetes.io~projected/kube-api-access-vfzxz DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:292 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:293 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b158d189-1bc5-4434-a09d-960b03d52bde/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:259 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:318 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8b9ab7e1-0444-433c-bf66-e5d004aa40c7/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4449224ad702f6b8b01ed438309965d0c5deec47d793ab3cc27e08e343219d34/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/67cf6892-73a4-43fb-9126-b8226bb5406d/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8b9ab7e1-0444-433c-bf66-e5d004aa40c7/volumes/kubernetes.io~projected/kube-api-access-5kqcz DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:290 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:2b6f329248ef4f2 MacAddress:2a:12:05:1c:ba:10 Speed:10000 Mtu:8901} {Name:32c0c7baaebcde3 MacAddress:da:66:6a:3e:fd:b9 Speed:10000 Mtu:8901} {Name:3a8e6e26428f1e5 MacAddress:96:ed:48:5e:97:89 Speed:10000 Mtu:8901} {Name:4449224ad702f6b MacAddress:52:17:8a:9e:1f:88 Speed:10000 Mtu:8901} {Name:57d05c2952cdc71 MacAddress:06:97:f4:cd:03:15 Speed:10000 Mtu:8901} {Name:67170db5771ea8e MacAddress:46:b2:64:bb:f2:7b Speed:10000 Mtu:8901} {Name:95d98a292a9e351 MacAddress:8e:3d:3a:e1:dc:6e Speed:10000 Mtu:8901} {Name:98c7ca3591bd7d9 MacAddress:ca:59:af:2d:66:93 Speed:10000 Mtu:8901} {Name:b4d507c25631b5d MacAddress:32:72:1d:2a:a1:26 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:dc:3f:5a:45 Speed:0 Mtu:9001} {Name:br-int MacAddress:3e:2d:f3:c8:56:89 Speed:0 Mtu:8901} {Name:c99a71aa920f4bb MacAddress:fa:81:72:98:cd:02 Speed:10000 Mtu:8901} {Name:ccd344f3a18853a MacAddress:ae:7d:55:91:4f:36 Speed:10000 Mtu:8901} {Name:d49efcaeb769e6e MacAddress:52:4c:33:94:b3:b4 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:dc:3f:5a:45 Speed:0 Mtu:9001} {Name:f57f9ed6abb4ead MacAddress:8a:48:b2:de:4c:37 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:62:10:08:3f:e8:5d Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:e2:fc:85:fd:b9:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.282570 6394 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.282617 6394 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.282898 6394 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.282922 6394 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-124.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283051 6394 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283059 6394 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283069 6394 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283088 6394 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 22:51:38.283180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283183 6394 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283336 6394 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283447 6394 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283479 6394 kubelet.go:493] "Attempting to sync node with API server" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283488 6394 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283498 6394 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283506 6394 kubelet.go:405] "Adding apiserver pod source" Nov 03 22:51:38.283627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.283515 6394 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 22:51:38.284334 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.284322 6394 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 22:51:38.284368 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.284335 6394 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:51:38.284850 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.284835 6394 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 22:51:38.287363 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.287349 6394 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 22:51:38.287363 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.287363 6394 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 22:51:38.287469 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.287459 6394 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 03 22:51:38.288032 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288020 6394 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 22:51:38.288063 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288051 6394 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 22:51:38.288165 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288155 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 22:51:38.288195 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288170 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 22:51:38.288195 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288176 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 22:51:38.288195 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288183 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 22:51:38.288195 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288191 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288202 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288208 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288214 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288220 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288226 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288236 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288247 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288283 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 22:51:38.288297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.288293 6394 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 22:51:38.292673 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.292633 6394 server.go:1263] "Started kubelet" Nov 03 22:51:38.292806 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.292709 6394 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 22:51:38.292893 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.292813 6394 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 22:51:38.292955 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.292937 6394 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 22:51:38.293232 ip-10-0-128-124 systemd[1]: Started Kubernetes Kubelet. Nov 03 22:51:38.293451 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.293238 6394 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 22:51:38.295821 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.295803 6394 server.go:317] "Adding debug handlers to kubelet server" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.296577 6394 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.296687 6394 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-124.us-east-2.compute.internal\" not found" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.296839 6394 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.296883 6394 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 22:45:27 +0000 UTC" deadline="2028-08-21 14:31:08.483048286 +0000 UTC" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.296941 6394 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.296961 6394 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15759h39m30.186150658s" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.297021 6394 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 22:51:38.297125 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.297037 6394 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 22:51:38.299480 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.299438 6394 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:38.301429 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301368 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14d6f850-0120-4b49-9428-46913ac8566b" volumeName="kubernetes.io/projected/14d6f850-0120-4b49-9428-46913ac8566b-kube-api-access-lglsv" seLinuxMountContext="" Nov 03 22:51:38.301516 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301433 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1693791d-6029-4385-a82b-20e084c7626c" volumeName="kubernetes.io/projected/1693791d-6029-4385-a82b-20e084c7626c-kube-api-access-wv8fd" seLinuxMountContext="" Nov 03 22:51:38.301575 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301529 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj" seLinuxMountContext="" Nov 03 22:51:38.301575 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301542 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca" seLinuxMountContext="" Nov 03 22:51:38.301724 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301557 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eeb53852-5e0f-4152-a623-e7e3126a15d8" volumeName="kubernetes.io/projected/eeb53852-5e0f-4152-a623-e7e3126a15d8-kube-api-access-558nw" seLinuxMountContext="" Nov 03 22:51:38.301724 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301650 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-client-ca-bundle" seLinuxMountContext="" Nov 03 22:51:38.301724 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301682 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls" seLinuxMountContext="" Nov 03 22:51:38.301874 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301726 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Nov 03 22:51:38.301874 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301744 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config" seLinuxMountContext="" Nov 03 22:51:38.301874 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301759 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b9ab7e1-0444-433c-bf66-e5d004aa40c7" volumeName="kubernetes.io/projected/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-kube-api-access-5kqcz" seLinuxMountContext="" Nov 03 22:51:38.301874 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301849 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/projected/c3676875-09f3-484d-8300-3a3c6e9da22b-kube-api-access-vlssz" seLinuxMountContext="" Nov 03 22:51:38.301874 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301862 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-tls" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301880 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34d29ed8-adf3-4a5c-802c-a503b37eca31" volumeName="kubernetes.io/projected/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-api-access-5jc95" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301893 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-metrics-server-audit-profiles" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301915 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301928 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b158d189-1bc5-4434-a09d-960b03d52bde" volumeName="kubernetes.io/projected/b158d189-1bc5-4434-a09d-960b03d52bde-kube-api-access-qljg9" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301948 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/configmap/c3676875-09f3-484d-8300-3a3c6e9da22b-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301963 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/empty-dir/c3676875-09f3-484d-8300-3a3c6e9da22b-tmp" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301976 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d27625f5-b27a-4797-8137-286db96afd2b" volumeName="kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-script-lib" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.301993 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14d6f850-0120-4b49-9428-46913ac8566b" volumeName="kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-multus-daemon-config" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302004 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a61a276-7283-4fac-8fe0-5ad917832ed7" volumeName="kubernetes.io/configmap/4a61a276-7283-4fac-8fe0-5ad917832ed7-serviceca" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302021 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-tls" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302049 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Nov 03 22:51:38.302112 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302063 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" volumeName="kubernetes.io/projected/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-kube-api-access-6mkqv" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302081 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302171 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302190 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eeb53852-5e0f-4152-a623-e7e3126a15d8" volumeName="kubernetes.io/configmap/eeb53852-5e0f-4152-a623-e7e3126a15d8-iptables-alerter-script" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302203 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302230 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302243 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22f978bf-c043-4c0c-b895-b3ad7011c9b5" volumeName="kubernetes.io/empty-dir/22f978bf-c043-4c0c-b895-b3ad7011c9b5-tmp-dir" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302292 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-client-certs" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302305 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b158d189-1bc5-4434-a09d-960b03d52bde" volumeName="kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-tls" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302318 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34d29ed8-adf3-4a5c-802c-a503b37eca31" volumeName="kubernetes.io/empty-dir/34d29ed8-adf3-4a5c-802c-a503b37eca31-data-volume" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302404 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302411 6394 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302419 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d76008d-f4a0-4f61-bad9-8362f553da69" volumeName="kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-tmp" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302438 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="911290aa-0ddf-43ed-a72b-c5a96b98217b" volumeName="kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302511 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d27625f5-b27a-4797-8137-286db96afd2b" volumeName="kubernetes.io/projected/d27625f5-b27a-4797-8137-286db96afd2b-kube-api-access-sv7kc" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302524 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b5f0856-7192-47d0-9590-8b4fd79add4b" volumeName="kubernetes.io/projected/1b5f0856-7192-47d0-9590-8b4fd79add4b-kube-api-access-vfzxz" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302542 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302557 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302575 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302587 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="911290aa-0ddf-43ed-a72b-c5a96b98217b" volumeName="kubernetes.io/projected/911290aa-0ddf-43ed-a72b-c5a96b98217b-kube-api-access-d6cdw" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302599 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302617 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b158d189-1bc5-4434-a09d-960b03d52bde" volumeName="kubernetes.io/empty-dir/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-textfile" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302638 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Nov 03 22:51:38.302669 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302673 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302686 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1693791d-6029-4385-a82b-20e084c7626c" volumeName="kubernetes.io/secret/1693791d-6029-4385-a82b-20e084c7626c-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302701 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff675c3-2019-462d-a8de-19897c17fe0a" volumeName="kubernetes.io/projected/1ff675c3-2019-462d-a8de-19897c17fe0a-kube-api-access-cj2xx" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302713 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a61a276-7283-4fac-8fe0-5ad917832ed7" volumeName="kubernetes.io/projected/4a61a276-7283-4fac-8fe0-5ad917832ed7-kube-api-access-skql9" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302725 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302759 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" volumeName="kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302771 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b9ab7e1-0444-433c-bf66-e5d004aa40c7" volumeName="kubernetes.io/configmap/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-config-volume" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302783 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b158d189-1bc5-4434-a09d-960b03d52bde" volumeName="kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-accelerators-collector-config" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302791 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b9ab7e1-0444-433c-bf66-e5d004aa40c7" volumeName="kubernetes.io/empty-dir/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-tmp-dir" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302802 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff675c3-2019-462d-a8de-19897c17fe0a" volumeName="kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302820 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34d29ed8-adf3-4a5c-802c-a503b37eca31" volumeName="kubernetes.io/configmap/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302876 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302889 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67cf6892-73a4-43fb-9126-b8226bb5406d" volumeName="kubernetes.io/secret/67cf6892-73a4-43fb-9126-b8226bb5406d-agent-certs" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302908 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302945 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302963 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/projected/59f436cf-187c-4753-b7b7-54da03201b6f-kube-api-access-c4lfq" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302975 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="630261b5-f7ea-45e3-b243-5b6503684d93" volumeName="kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.302987 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="67cf6892-73a4-43fb-9126-b8226bb5406d" volumeName="kubernetes.io/configmap/67cf6892-73a4-43fb-9126-b8226bb5406d-konnectivity-ca" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303003 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303017 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303035 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b158d189-1bc5-4434-a09d-960b03d52bde" volumeName="kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303046 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d27625f5-b27a-4797-8137-286db96afd2b" volumeName="kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-config" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303059 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e57657f7-583c-49a4-8b97-c8e7980a95ae" volumeName="kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303075 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d76008d-f4a0-4f61-bad9-8362f553da69" volumeName="kubernetes.io/projected/7d76008d-f4a0-4f61-bad9-8362f553da69-kube-api-access-nt9tp" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303087 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" volumeName="kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-sysctl-allowlist" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303091 6394 factory.go:55] Registering systemd factory Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303107 6394 factory.go:223] Registration of the systemd container factory successfully Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303105 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303119 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b158d189-1bc5-4434-a09d-960b03d52bde" volumeName="kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303131 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-grpc-tls" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303218 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="14d6f850-0120-4b49-9428-46913ac8566b" volumeName="kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-cni-binary-copy" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303244 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34d29ed8-adf3-4a5c-802c-a503b37eca31" volumeName="kubernetes.io/secret/34d29ed8-adf3-4a5c-802c-a503b37eca31-insights-runtime-extractor-tls" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303276 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d76008d-f4a0-4f61-bad9-8362f553da69" volumeName="kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-tuned" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303299 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303338 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303353 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303365 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303384 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="59f436cf-187c-4753-b7b7-54da03201b6f" volumeName="kubernetes.io/empty-dir/59f436cf-187c-4753-b7b7-54da03201b6f-audit-log" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303397 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303415 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303462 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303477 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8b9ab7e1-0444-433c-bf66-e5d004aa40c7" volumeName="kubernetes.io/secret/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-metrics-tls" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303496 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="911290aa-0ddf-43ed-a72b-c5a96b98217b" volumeName="kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-tls" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303509 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303527 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b0afaa38-0893-4ead-87aa-db622d95c401" volumeName="kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303540 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d27625f5-b27a-4797-8137-286db96afd2b" volumeName="kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-env-overrides" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303554 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d27625f5-b27a-4797-8137-286db96afd2b" volumeName="kubernetes.io/secret/d27625f5-b27a-4797-8137-286db96afd2b-ovn-node-metrics-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303571 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303587 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00873659-d5eb-4f6e-861e-d96090a8e3a2" volumeName="kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303604 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="22f978bf-c043-4c0c-b895-b3ad7011c9b5" volumeName="kubernetes.io/projected/22f978bf-c043-4c0c-b895-b3ad7011c9b5-kube-api-access-tbt5q" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303617 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" volumeName="kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-binary-copy" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303630 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="911290aa-0ddf-43ed-a72b-c5a96b98217b" volumeName="kubernetes.io/configmap/911290aa-0ddf-43ed-a72b-c5a96b98217b-metrics-client-ca" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303647 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303686 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6d83112e-5266-4d93-a60f-8a6681f30568" volumeName="kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303705 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="917104af-56ea-402a-a489-677a81bbad80" volumeName="kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config" seLinuxMountContext="" Nov 03 22:51:38.303751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303718 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303785 6394 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3676875-09f3-484d-8300-3a3c6e9da22b" volumeName="kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303811 6394 reconstruct.go:97] "Volume reconstruction finished" Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.303819 6394 reconciler.go:29] "Reconciler: start to sync state" Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.304726 6394 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.305903 6394 factory.go:153] Registering CRI-O factory Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.305919 6394 factory.go:223] Registration of the crio container factory successfully Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.305975 6394 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.305999 6394 factory.go:103] Registering Raw factory Nov 03 22:51:38.306036 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.306012 6394 manager.go:1199] Started watching for new ooms in manager Nov 03 22:51:38.306398 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.306369 6394 manager.go:319] Starting recovery of all containers Nov 03 22:51:38.314485 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.314459 6394 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 03 22:51:38.334798 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.334757 6394 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 22:51:38.336802 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.336635 6394 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 22:51:38.336802 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.336678 6394 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 22:51:38.336802 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.336702 6394 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 22:51:38.336802 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.336743 6394 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 03 22:51:38.341064 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.341042 6394 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 22:51:38.350318 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.350287 6394 generic.go:356] "Generic (PLEG): container finished" podID="b158d189-1bc5-4434-a09d-960b03d52bde" containerID="cc5885a7f27cd2aa94d2898892bdd995f118332481ab6fef1fa85f8eeeeee0de" exitCode=0 Nov 03 22:51:38.370064 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.370031 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745" exitCode=0 Nov 03 22:51:38.379433 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.379399 6394 generic.go:356] "Generic (PLEG): container finished" podID="1e67d0a09c726730f95619671f6855aa" containerID="ae805e32a3831232de8b1ce88b4b6e8c8312e51979954b8642f97b07fff2ce64" exitCode=0 Nov 03 22:51:38.393213 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.393178 6394 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="2380178a24b80f069b7d5e7e984a28c2418bdd76d4c46ddd2135ff6de45a56e1" exitCode=0 Nov 03 22:51:38.393213 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.393212 6394 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="160c0080d3dc4bdca268561269bb25048d4e54133682f4f836bf3b43b64d9c19" exitCode=0 Nov 03 22:51:38.393213 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.393222 6394 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="cc15c25da2e2de972f9755be8bc427ca4e85723580e19bffb226e40c13f29969" exitCode=0 Nov 03 22:51:38.393496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.393232 6394 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="41ffda33034f4cc6782a219787208abca584d6c4d70cf64226f6f452c026361d" exitCode=0 Nov 03 22:51:38.393496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.393240 6394 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="6d965d6c5aeba2c074296d4757cc0c0465286b55a2e0b8ef20ee25e9fb775cc7" exitCode=0 Nov 03 22:51:38.393496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.393248 6394 generic.go:356] "Generic (PLEG): container finished" podID="8a9a75f9-9976-4d50-af9e-cc680ff1e36f" containerID="9f774a7f314e11ca3535457a8c0d74e39c37a2671680c8b3d6d8a7b958065cb2" exitCode=0 Nov 03 22:51:38.415609 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.415544 6394 manager.go:324] Recovery completed Nov 03 22:51:38.436848 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.436813 6394 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 03 22:51:38.439930 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.439911 6394 cpu_manager.go:226] "Starting" policy="none" Nov 03 22:51:38.439930 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.439926 6394 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 22:51:38.440072 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.439944 6394 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 22:51:38.440072 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440064 6394 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 03 22:51:38.440131 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440074 6394 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 03 22:51:38.440233 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440224 6394 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 03 22:51:38.440263 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440234 6394 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 03 22:51:38.440263 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440240 6394 policy_none.go:50] "Start" Nov 03 22:51:38.440263 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440249 6394 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 22:51:38.440263 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.440259 6394 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 22:51:38.441598 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.441588 6394 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 03 22:51:38.441666 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.441599 6394 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 03 22:51:38.441666 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.441605 6394 policy_none.go:44] "Start" Nov 03 22:51:38.446312 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.446286 6394 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 22:51:38.449062 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.449047 6394 manager.go:341] "Starting Device Plugin manager" Nov 03 22:51:38.449851 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.449071 6394 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 22:51:38.449928 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.449857 6394 server.go:87] "Starting device plugin registration server" Nov 03 22:51:38.450209 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450196 6394 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 22:51:38.450241 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450213 6394 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 22:51:38.450332 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450307 6394 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 22:51:38.450461 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450427 6394 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 22:51:38.450517 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450472 6394 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 22:51:38.450517 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450479 6394 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 22:51:38.450609 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.450536 6394 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T22:51:38.45045977Z","UUID":"d1b31208-af87-4dc7-a8aa-fa5d9cd77bb9","Handler":null,"Name":"","Endpoint":""} Nov 03 22:51:38.451836 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.451809 6394 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 22:51:38.451836 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.451832 6394 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 22:51:38.452006 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.451937 6394 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 22:51:38.550770 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.550724 6394 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 22:51:38.556779 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.556754 6394 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 03 22:51:38.556877 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.556790 6394 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 03 22:51:38.556877 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.556801 6394 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-124.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 03 22:51:38.556939 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.556885 6394 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.571579 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.571559 6394 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.571651 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.571642 6394 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.637889 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.637818 6394 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal"] Nov 03 22:51:38.638537 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638502 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"1e67d0a09c726730f95619671f6855aa","Type":"ContainerStarted","Data":"6e763a0d2722cef91103fe7f7aee866c96caa812d2a047cef7888bf171a7181d"} Nov 03 22:51:38.638582 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638549 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"1e67d0a09c726730f95619671f6855aa","Type":"ContainerDied","Data":"ae805e32a3831232de8b1ce88b4b6e8c8312e51979954b8642f97b07fff2ce64"} Nov 03 22:51:38.638582 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638569 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"1e67d0a09c726730f95619671f6855aa","Type":"ContainerStarted","Data":"2fd8672e2d68fa4647cf57ee5532b613d90cd3f55e9511d87909e32823d5d900"} Nov 03 22:51:38.638646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638587 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"933c853ec2aff1af9a557fa27b9770d1","Type":"ContainerStarted","Data":"e2fd187b145b685174968ea3c65fd036a8af8301835c60d47660bd8aa1434bca"} Nov 03 22:51:38.638646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638597 6394 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.638646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638604 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" event={"ID":"933c853ec2aff1af9a557fa27b9770d1","Type":"ContainerStarted","Data":"f8ed01a9e987ce51128006cc68b1f905c93d9266ea3d454d9b62a805207e9a36"} Nov 03 22:51:38.638808 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.638701 6394 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.649963 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.649940 6394 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:38.650020 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.649996 6394 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.650407 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.650391 6394 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:38.650445 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:38.650432 6394 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.715840 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.715767 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/933c853ec2aff1af9a557fa27b9770d1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"933c853ec2aff1af9a557fa27b9770d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.715840 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.715802 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.715840 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.715830 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.816754 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.816720 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.816754 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.816754 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.816946 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.816803 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.816946 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.816817 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1e67d0a09c726730f95619671f6855aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"1e67d0a09c726730f95619671f6855aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.816946 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.816838 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/933c853ec2aff1af9a557fa27b9770d1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"933c853ec2aff1af9a557fa27b9770d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:38.816946 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:38.816865 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/933c853ec2aff1af9a557fa27b9770d1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" (UID: \"933c853ec2aff1af9a557fa27b9770d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:39.284466 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.284429 6394 apiserver.go:52] "Watching apiserver" Nov 03 22:51:39.293745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.293723 6394 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 22:51:39.294384 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.294356 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b6stm","openshift-multus/multus-9zcf4","openshift-dns/dns-default-pqd56","openshift-cluster-node-tuning-operator/tuned-lfpp5","openshift-monitoring/metrics-server-676d8c84bc-qzgxz","kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal","openshift-console/console-7d558bb4-8f6q2","openshift-monitoring/alertmanager-main-0","kube-system/global-pull-secret-syncer-8bw5x","openshift-console/console-54f6b445b9-5k5ll","kube-system/konnectivity-agent-tkqg4","openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb","openshift-ovn-kubernetes/ovnkube-node-f7rrr","openshift-image-registry/node-ca-6wjjx","openshift-monitoring/thanos-querier-56d7b45d9c-69m9m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal","openshift-network-operator/iptables-alerter-nk2hp","openshift-network-diagnostics/network-check-target-nmwkz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt","openshift-insights/insights-runtime-extractor-x7d6c","openshift-console/console-6db9cd76d9-fkj8n","openshift-multus/multus-additional-cni-plugins-9nzlc","openshift-multus/network-metrics-daemon-wwlzx","openshift-dns/node-resolver-c4mbq","openshift-ingress-canary/ingress-canary-d72xp"] Nov 03 22:51:39.299956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.299848 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 22:51:39.299956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.299913 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.299956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.299946 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.300183 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300038 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-k9x8r\"" Nov 03 22:51:39.300183 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.299997 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.300183 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300124 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-55tt4\"" Nov 03 22:51:39.300183 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300135 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.300183 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300140 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.300354 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300220 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.300354 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300278 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qt84f\"" Nov 03 22:51:39.300647 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300626 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.300941 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.300892 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.301190 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.301175 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lq2j\"" Nov 03 22:51:39.301252 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.301230 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.301296 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.301257 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.301688 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.301649 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dgw9c\"" Nov 03 22:51:39.301786 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.301772 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 22:51:39.302273 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.302260 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 22:51:39.302352 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.302301 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 22:51:39.302352 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.302306 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7xqrp\"" Nov 03 22:51:39.303090 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303046 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4m98w\"" Nov 03 22:51:39.303785 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303765 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 22:51:39.303867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303811 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.303867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303835 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 22:51:39.303993 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303879 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xz7vt\"" Nov 03 22:51:39.303993 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303931 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 22:51:39.303993 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.303950 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 22:51:39.304347 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304322 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.304449 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304401 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-l7l8c\"" Nov 03 22:51:39.304449 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304407 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 22:51:39.304449 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304408 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.304551 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304522 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 22:51:39.304581 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304559 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.304675 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.304643 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 22:51:39.310902 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.310805 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 03 22:51:39.310902 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.310846 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 22:51:39.311235 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311219 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.311235 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311230 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.311373 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311358 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.311421 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311361 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.311421 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311362 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Nov 03 22:51:39.311421 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311379 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 22:51:39.311534 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311474 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 03 22:51:39.311534 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311474 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 03 22:51:39.311534 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311514 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 03 22:51:39.311627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311544 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 22:51:39.311627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311554 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 22:51:39.311713 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311555 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 22:51:39.311960 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.311926 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.312030 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312015 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 22:51:39.312096 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312045 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.312150 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312100 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 03 22:51:39.312150 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312119 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 03 22:51:39.312360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312343 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.312442 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312373 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 22:51:39.312533 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.312505 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.313379 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.313353 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Nov 03 22:51:39.313601 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.313586 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 22:51:39.313784 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.313767 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 22:51:39.313914 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.313896 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gxknx\"" Nov 03 22:51:39.314046 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314033 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-fpn8c\"" Nov 03 22:51:39.314140 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314122 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 22:51:39.314237 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314218 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-w6v9t\"" Nov 03 22:51:39.314298 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314265 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:51:39.314419 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314403 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Nov 03 22:51:39.314475 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314423 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-6ln97\"" Nov 03 22:51:39.314475 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314435 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 22:51:39.314574 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314043 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qb72\"" Nov 03 22:51:39.314622 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314039 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fq4pb\"" Nov 03 22:51:39.314885 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314864 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jbwjx\"" Nov 03 22:51:39.314885 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.314880 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 22:51:39.315035 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.315020 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvtdb\"" Nov 03 22:51:39.315089 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.315072 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 22:51:39.315089 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.315078 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 22:51:39.315271 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.315256 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Nov 03 22:51:39.315374 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.315260 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbgw4\"" Nov 03 22:51:39.315425 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.315407 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 03 22:51:39.317175 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.317153 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 03 22:51:39.317552 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.317534 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 03 22:51:39.317611 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.317596 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 03 22:51:39.318711 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318694 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-var-lib-kubelet\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.318758 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318721 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-tuned\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.318758 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318737 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt9tp\" (UniqueName: \"kubernetes.io/projected/7d76008d-f4a0-4f61-bad9-8362f553da69-kube-api-access-nt9tp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.318758 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318755 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqv\" (UniqueName: \"kubernetes.io/projected/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-kube-api-access-6mkqv\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.318879 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318775 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-tmp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.318879 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318816 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-socket-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.318879 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318845 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-device-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.318879 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318861 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-sys-fs\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.318879 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318864 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-tmp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318879 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-run\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318918 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-sys\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318918 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-tuned\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.318983 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-registration-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319014 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f978bf-c043-4c0c-b895-b3ad7011c9b5-hosts-file\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319035 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319053 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-system-cni-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319083 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319118 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-host\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319134 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cnibin\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319172 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319200 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319242 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319275 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319328 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-lib-modules\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319360 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319355 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f978bf-c043-4c0c-b895-b3ad7011c9b5-tmp-dir\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319378 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-modprobe-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319403 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysconfig\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319412 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319461 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-conf\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319488 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319513 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319539 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319564 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-kubernetes\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319588 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzxz\" (UniqueName: \"kubernetes.io/projected/1b5f0856-7192-47d0-9590-8b4fd79add4b-kube-api-access-vfzxz\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319617 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-binary-copy\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319699 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbt5q\" (UniqueName: \"kubernetes.io/projected/22f978bf-c043-4c0c-b895-b3ad7011c9b5-kube-api-access-tbt5q\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319720 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22f978bf-c043-4c0c-b895-b3ad7011c9b5-tmp-dir\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319728 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-systemd\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.319805 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319756 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj2xx\" (UniqueName: \"kubernetes.io/projected/1ff675c3-2019-462d-a8de-19897c17fe0a-kube-api-access-cj2xx\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:39.320381 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.319861 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.320381 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.320222 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ff675c3-2019-462d-a8de-19897c17fe0a-metrics-certs\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:39.325949 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.325922 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt9tp\" (UniqueName: \"kubernetes.io/projected/7d76008d-f4a0-4f61-bad9-8362f553da69-kube-api-access-nt9tp\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.326039 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.325922 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkqv\" (UniqueName: \"kubernetes.io/projected/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-kube-api-access-6mkqv\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.326498 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.326482 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj2xx\" (UniqueName: \"kubernetes.io/projected/1ff675c3-2019-462d-a8de-19897c17fe0a-kube-api-access-cj2xx\") pod \"network-metrics-daemon-wwlzx\" (UID: \"1ff675c3-2019-462d-a8de-19897c17fe0a\") " pod="openshift-multus/network-metrics-daemon-wwlzx" Nov 03 22:51:39.326948 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.326924 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzxz\" (UniqueName: \"kubernetes.io/projected/1b5f0856-7192-47d0-9590-8b4fd79add4b-kube-api-access-vfzxz\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.327033 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.327014 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbt5q\" (UniqueName: \"kubernetes.io/projected/22f978bf-c043-4c0c-b895-b3ad7011c9b5-kube-api-access-tbt5q\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.327434 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.327415 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvqn\" (UniqueName: \"kubernetes.io/projected/630261b5-f7ea-45e3-b243-5b6503684d93-kube-api-access-nqvqn\") pod \"network-check-target-nmwkz\" (UID: \"630261b5-f7ea-45e3-b243-5b6503684d93\") " pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:39.398895 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.398872 6394 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 22:51:39.399751 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.399731 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Nov 03 22:51:39.400298 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400275 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fhu3u1v53clad\"" Nov 03 22:51:39.400393 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400309 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqxw6\"" Nov 03 22:51:39.400393 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400346 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Nov 03 22:51:39.400393 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400356 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Nov 03 22:51:39.400506 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400446 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 03 22:51:39.400506 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400474 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Nov 03 22:51:39.400506 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400486 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Nov 03 22:51:39.400506 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400466 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dds9k\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400509 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400532 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400544 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400553 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9fo8ckkovhg49\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400578 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400578 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Nov 03 22:51:39.400646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400614 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fnkfl\"" Nov 03 22:51:39.400940 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.400922 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 03 22:51:39.402972 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.402957 6394 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:39.403074 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.403062 6394 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:39.414997 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.414974 6394 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:39.415124 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.415008 6394 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 22:51:39.415124 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:39.415032 6394 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:39.415124 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:39.415037 6394 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-124.us-east-2.compute.internal" Nov 03 22:51:39.420146 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420119 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeb53852-5e0f-4152-a623-e7e3126a15d8-iptables-alerter-script\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.420244 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420160 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-slash\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.420244 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420191 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.420244 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420217 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.420384 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420240 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.420384 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420292 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-systemd\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.420384 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420325 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-tls\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.420384 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420380 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eeb53852-5e0f-4152-a623-e7e3126a15d8-iptables-alerter-script\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.420567 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420389 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.420567 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420476 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.420567 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420516 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv7kc\" (UniqueName: \"kubernetes.io/projected/d27625f5-b27a-4797-8137-286db96afd2b-kube-api-access-sv7kc\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.420567 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420553 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.420567 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420556 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-systemd\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.420567 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420562 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420605 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-tls\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420610 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420770 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420790 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420801 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3676875-09f3-484d-8300-3a3c6e9da22b-metrics-client-ca\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420832 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-netd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.420855 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420855 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-run\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420878 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-sys\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420943 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-run\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420954 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-sys\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420971 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeb53852-5e0f-4152-a623-e7e3126a15d8-host-slash\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.420998 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421000 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.421066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421028 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421075 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3676875-09f3-484d-8300-3a3c6e9da22b-metrics-client-ca\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421133 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421246 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lfq\" (UniqueName: \"kubernetes.io/projected/59f436cf-187c-4753-b7b7-54da03201b6f-kube-api-access-c4lfq\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421262 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421274 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-etc-kubernetes\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421298 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-system-cni-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.421329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421323 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421338 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e57657f7-583c-49a4-8b97-c8e7980a95ae-original-pull-secret\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421345 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d29ed8-adf3-4a5c-802c-a503b37eca31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421371 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421375 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-system-cni-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421439 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421516 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421549 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d29ed8-adf3-4a5c-802c-a503b37eca31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421567 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.421620 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421589 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421624 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-config\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421649 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d29ed8-adf3-4a5c-802c-a503b37eca31-data-volume\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421701 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421725 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421750 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3676875-09f3-484d-8300-3a3c6e9da22b-tmp\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421775 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-k8s-cni-cncf-io\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421800 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cdw\" (UniqueName: \"kubernetes.io/projected/911290aa-0ddf-43ed-a72b-c5a96b98217b-kube-api-access-d6cdw\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421825 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421863 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421869 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-config\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421870 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421902 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3676875-09f3-484d-8300-3a3c6e9da22b-tmp\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421922 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421944 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d29ed8-adf3-4a5c-802c-a503b37eca31-data-volume\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.421946 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-modprobe-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.422038 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422025 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422099 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-558nw\" (UniqueName: \"kubernetes.io/projected/eeb53852-5e0f-4152-a623-e7e3126a15d8-kube-api-access-558nw\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422150 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlssz\" (UniqueName: \"kubernetes.io/projected/c3676875-09f3-484d-8300-3a3c6e9da22b-kube-api-access-vlssz\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422164 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-modprobe-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422192 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-system-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422293 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422311 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-ovn\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422351 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-kubernetes\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422388 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-client-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422435 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-netns\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422432 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-kubernetes\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422475 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-systemd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422494 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422541 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-multus-certs\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422578 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-node-log\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422592 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-client-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422608 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422642 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-var-lib-kubelet\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422712 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-kubelet-config\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422743 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422766 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.422777 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422777 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422783 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-client-certs\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422813 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422934 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-var-lib-kubelet\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422951 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1693791d-6029-4385-a82b-20e084c7626c-cert\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.422985 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/59f436cf-187c-4753-b7b7-54da03201b6f-secret-metrics-server-client-certs\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423025 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-bin\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423079 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-socket-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423095 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423109 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-device-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423120 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423154 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-device-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423159 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1693791d-6029-4385-a82b-20e084c7626c-cert\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423178 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423198 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-kubelet\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423253 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-socket-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423260 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-var-lib-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423283 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-root\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423314 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-tls\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423348 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423385 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423463 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423510 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-tls\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423533 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-dbus\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423584 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.423587 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423586 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423623 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-d\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423627 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d29ed8-adf3-4a5c-802c-a503b37eca31-crio-socket\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423678 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-cni-binary-copy\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423784 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-metrics-client-ca\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423903 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jc95\" (UniqueName: \"kubernetes.io/projected/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-api-access-5jc95\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423946 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-metrics-tls\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423970 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423971 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b158d189-1bc5-4434-a09d-960b03d52bde-metrics-client-ca\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.423995 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-metrics-server-audit-profiles\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424040 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424065 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-tmp-dir\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424090 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424115 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424163 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424173 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-cni-binary-copy\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424176 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424192 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-metrics-tls\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424195 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-lib-modules\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424211 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424229 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-conf\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424264 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424288 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424297 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-lib-modules\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424316 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424339 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-cnibin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424376 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424379 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysctl-conf\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424300 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424421 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-metrics-server-audit-profiles\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424440 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67cf6892-73a4-43fb-9126-b8226bb5406d-agent-certs\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424462 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424468 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424466 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424512 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424520 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424553 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-grpc-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424579 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424596 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424609 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-env-overrides\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424633 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27625f5-b27a-4797-8137-286db96afd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424648 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424680 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67cf6892-73a4-43fb-9126-b8226bb5406d-konnectivity-ca\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424717 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424608 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424753 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-bin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424770 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67cf6892-73a4-43fb-9126-b8226bb5406d-agent-certs\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424779 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a61a276-7283-4fac-8fe0-5ad917832ed7-host\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424780 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424812 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-registration-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424839 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-env-overrides\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424849 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424893 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lglsv\" (UniqueName: \"kubernetes.io/projected/14d6f850-0120-4b49-9428-46913ac8566b-kube-api-access-lglsv\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424925 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67cf6892-73a4-43fb-9126-b8226bb5406d-konnectivity-ca\") pod \"konnectivity-agent-tkqg4\" (UID: \"67cf6892-73a4-43fb-9126-b8226bb5406d\") " pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424934 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-registration-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424928 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-etc-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.424951 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-grpc-tls\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425015 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d27625f5-b27a-4797-8137-286db96afd2b-ovn-node-metrics-cert\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425025 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-textfile\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425055 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425100 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-host\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425122 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-textfile\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425140 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-tmp-dir\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425143 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425175 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cnibin\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425193 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8a9a75f9-9976-4d50-af9e-cc680ff1e36f-cnibin\") pod \"multus-additional-cni-plugins-9nzlc\" (UID: \"8a9a75f9-9976-4d50-af9e-cc680ff1e36f\") " pod="openshift-multus/multus-additional-cni-plugins-9nzlc" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425223 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425232 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-host\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425256 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425299 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.425342 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425349 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425413 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425458 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-multus-daemon-config\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425486 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/911290aa-0ddf-43ed-a72b-c5a96b98217b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425638 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14d6f850-0120-4b49-9428-46913ac8566b-multus-daemon-config\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425704 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425484 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425908 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqcz\" (UniqueName: \"kubernetes.io/projected/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-kube-api-access-5kqcz\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425929 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425945 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-sys\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425960 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.425979 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-socket-dir-parent\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426012 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426042 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426102 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-systemd-units\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426114 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426150 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-config-volume\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426195 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911290aa-0ddf-43ed-a72b-c5a96b98217b-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426215 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426303 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426320 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-config-volume\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426343 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911290aa-0ddf-43ed-a72b-c5a96b98217b-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426351 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-multus\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426387 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-hostroot\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426432 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426462 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426461 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426495 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-wtmp\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426535 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-sys-fs\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426562 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426572 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-sys-fs\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426577 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426607 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-conf-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426633 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426698 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f978bf-c043-4c0c-b895-b3ad7011c9b5-hosts-file\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426716 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426723 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426732 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426754 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-netns\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426780 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8fd\" (UniqueName: \"kubernetes.io/projected/1693791d-6029-4385-a82b-20e084c7626c-kube-api-access-wv8fd\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426780 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22f978bf-c043-4c0c-b895-b3ad7011c9b5-hosts-file\") pod \"node-resolver-c4mbq\" (UID: \"22f978bf-c043-4c0c-b895-b3ad7011c9b5\") " pod="openshift-dns/node-resolver-c4mbq" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426782 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c3676875-09f3-484d-8300-3a3c6e9da22b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426824 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-log-socket\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426852 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljg9\" (UniqueName: \"kubernetes.io/projected/b158d189-1bc5-4434-a09d-960b03d52bde-kube-api-access-qljg9\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426881 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59f436cf-187c-4753-b7b7-54da03201b6f-audit-log\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426892 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426906 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-kubelet\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426933 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-script-lib\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426960 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426963 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/59f436cf-187c-4753-b7b7-54da03201b6f-audit-log\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.426984 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a61a276-7283-4fac-8fe0-5ad917832ed7-serviceca\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427003 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59f436cf-187c-4753-b7b7-54da03201b6f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427075 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skql9\" (UniqueName: \"kubernetes.io/projected/4a61a276-7283-4fac-8fe0-5ad917832ed7-kube-api-access-skql9\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427085 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b5f0856-7192-47d0-9590-8b4fd79add4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh6bt\" (UID: \"1b5f0856-7192-47d0-9590-8b4fd79add4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh6bt" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427155 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427175 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d27625f5-b27a-4797-8137-286db96afd2b-ovnkube-script-lib\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427222 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427238 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysconfig\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427339 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7d76008d-f4a0-4f61-bad9-8362f553da69-etc-sysconfig\") pod \"tuned-lfpp5\" (UID: \"7d76008d-f4a0-4f61-bad9-8362f553da69\") " pod="openshift-cluster-node-tuning-operator/tuned-lfpp5" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427418 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427448 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427589 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a61a276-7283-4fac-8fe0-5ad917832ed7-serviceca\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.427827 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv7kc\" (UniqueName: \"kubernetes.io/projected/d27625f5-b27a-4797-8137-286db96afd2b-kube-api-access-sv7kc\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.428092 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lfq\" (UniqueName: \"kubernetes.io/projected/59f436cf-187c-4753-b7b7-54da03201b6f-kube-api-access-c4lfq\") pod \"metrics-server-676d8c84bc-qzgxz\" (UID: \"59f436cf-187c-4753-b7b7-54da03201b6f\") " pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.428199 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") pod \"console-6db9cd76d9-fkj8n\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.428295 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-558nw\" (UniqueName: \"kubernetes.io/projected/eeb53852-5e0f-4152-a623-e7e3126a15d8-kube-api-access-558nw\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.428333 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.428328 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") pod \"console-54f6b445b9-5k5ll\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:39.430141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.428513 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cdw\" (UniqueName: \"kubernetes.io/projected/911290aa-0ddf-43ed-a72b-c5a96b98217b-kube-api-access-d6cdw\") pod \"openshift-state-metrics-7bd7489957-5nbpb\" (UID: \"911290aa-0ddf-43ed-a72b-c5a96b98217b\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-5nbpb" Nov 03 22:51:39.430141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.428831 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlssz\" (UniqueName: \"kubernetes.io/projected/c3676875-09f3-484d-8300-3a3c6e9da22b-kube-api-access-vlssz\") pod \"thanos-querier-56d7b45d9c-69m9m\" (UID: \"c3676875-09f3-484d-8300-3a3c6e9da22b\") " pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:39.430141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.429478 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") pod \"console-7d558bb4-8f6q2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:51:39.430369 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.430354 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jc95\" (UniqueName: \"kubernetes.io/projected/34d29ed8-adf3-4a5c-802c-a503b37eca31-kube-api-access-5jc95\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.431601 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.431585 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lglsv\" (UniqueName: \"kubernetes.io/projected/14d6f850-0120-4b49-9428-46913ac8566b-kube-api-access-lglsv\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.431783 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.431767 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") pod \"alertmanager-main-0\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:51:39.432575 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.432556 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqcz\" (UniqueName: \"kubernetes.io/projected/8b9ab7e1-0444-433c-bf66-e5d004aa40c7-kube-api-access-5kqcz\") pod \"dns-default-pqd56\" (UID: \"8b9ab7e1-0444-433c-bf66-e5d004aa40c7\") " pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:39.436555 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.433272 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljg9\" (UniqueName: \"kubernetes.io/projected/b158d189-1bc5-4434-a09d-960b03d52bde-kube-api-access-qljg9\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.436555 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.434050 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8fd\" (UniqueName: \"kubernetes.io/projected/1693791d-6029-4385-a82b-20e084c7626c-kube-api-access-wv8fd\") pod \"ingress-canary-d72xp\" (UID: \"1693791d-6029-4385-a82b-20e084c7626c\") " pod="openshift-ingress-canary/ingress-canary-d72xp" Nov 03 22:51:39.436555 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.434283 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skql9\" (UniqueName: \"kubernetes.io/projected/4a61a276-7283-4fac-8fe0-5ad917832ed7-kube-api-access-skql9\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.494558 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.494526 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f6b445b9-5k5ll"] Nov 03 22:51:39.528484 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528446 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-log-socket\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528484 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528485 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-kubelet\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528515 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-slash\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528562 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-slash\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528566 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-log-socket\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528580 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-kubelet\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528627 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528684 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528704 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528715 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-netd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528738 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeb53852-5e0f-4152-a623-e7e3126a15d8-host-slash\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528744 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528785 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eeb53852-5e0f-4152-a623-e7e3126a15d8-host-slash\") pod \"iptables-alerter-nk2hp\" (UID: \"eeb53852-5e0f-4152-a623-e7e3126a15d8\") " pod="openshift-network-operator/iptables-alerter-nk2hp" Nov 03 22:51:39.528807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528790 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-netd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528829 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-etc-kubernetes\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528870 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-k8s-cni-cncf-io\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528898 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-system-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528922 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-ovn\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528944 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-netns\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528953 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-etc-kubernetes\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528966 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-systemd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528988 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-system-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528993 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-systemd\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.528956 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-k8s-cni-cncf-io\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529000 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-run-netns\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529014 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-ovn\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529041 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-multus-certs\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529063 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-node-log\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529083 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-kubelet-config\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529096 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-multus-certs\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529098 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-node-log\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529104 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-bin\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529136 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-cni-bin\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529141 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-kubelet\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529147 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-kubelet-config\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529170 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-var-lib-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529222 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-host-kubelet\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.529256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529264 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-root\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529289 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-var-lib-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529316 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-root\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529318 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-dbus\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529340 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d29ed8-adf3-4a5c-802c-a503b37eca31-crio-socket\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529360 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529381 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-cnibin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529409 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-bin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529424 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a61a276-7283-4fac-8fe0-5ad917832ed7-host\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529454 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a61a276-7283-4fac-8fe0-5ad917832ed7-host\") pod \"node-ca-6wjjx\" (UID: \"4a61a276-7283-4fac-8fe0-5ad917832ed7\") " pod="openshift-image-registry/node-ca-6wjjx" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529463 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e57657f7-583c-49a4-8b97-c8e7980a95ae-dbus\") pod \"global-pull-secret-syncer-8bw5x\" (UID: \"e57657f7-583c-49a4-8b97-c8e7980a95ae\") " pod="kube-system/global-pull-secret-syncer-8bw5x" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529476 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d29ed8-adf3-4a5c-802c-a503b37eca31-crio-socket\") pod \"insights-runtime-extractor-x7d6c\" (UID: \"34d29ed8-adf3-4a5c-802c-a503b37eca31\") " pod="openshift-insights/insights-runtime-extractor-x7d6c" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529464 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-cni-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529499 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-etc-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529494 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-bin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529535 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-sys\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529551 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-etc-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529564 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-sys\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529481 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-cnibin\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529563 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-socket-dir-parent\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529590 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-systemd-units\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529608 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-multus\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529623 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-hostroot\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529638 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-systemd-units\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529606 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-socket-dir-parent\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529643 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529691 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-wtmp\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529701 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d27625f5-b27a-4797-8137-286db96afd2b-run-openvswitch\") pod \"ovnkube-node-f7rrr\" (UID: \"d27625f5-b27a-4797-8137-286db96afd2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529713 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-conf-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529733 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-netns\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529741 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-var-lib-cni-multus\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529697 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-hostroot\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529800 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b158d189-1bc5-4434-a09d-960b03d52bde-node-exporter-wtmp\") pod \"node-exporter-b6stm\" (UID: \"b158d189-1bc5-4434-a09d-960b03d52bde\") " pod="openshift-monitoring/node-exporter-b6stm" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529799 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-host-run-netns\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:39.530041 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:39.529806 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14d6f850-0120-4b49-9428-46913ac8566b-multus-conf-dir\") pod \"multus-9zcf4\" (UID: \"14d6f850-0120-4b49-9428-46913ac8566b\") " pod="openshift-multus/multus-9zcf4" Nov 03 22:51:40.178304 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:40.178276 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:40.626746 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:40.626716 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56d7b45d9c-69m9m" Nov 03 22:51:40.920390 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:40.920314 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pqd56" Nov 03 22:51:44.638216 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:44.638172 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:51:44.807196 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:44.807159 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:44.811776 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:44.811750 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:46.253275 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:46.253242 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:51:46.253680 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:46.253485 6394 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 22:51:46.359233 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:46.359203 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:51:48.886733 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:51:48.886631 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:51:49.259093 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:49.258998 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:51:59.264589 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:51:59.264562 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:52:00.368158 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:00.368129 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tkqg4" Nov 03 22:52:00.621625 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:00.621548 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f7rrr" Nov 03 22:52:04.329607 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.329547 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7d558bb4-8f6q2" podUID="00873659-d5eb-4f6e-861e-d96090a8e3a2" containerName="console" containerID="cri-o://cb3cc09939abea02101f7b7d928ca1feefeeeb95779b53840339f20fb33f3e0e" gracePeriod=15 Nov 03 22:52:04.493640 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.493601 6394 generic.go:356] "Generic (PLEG): container finished" podID="00873659-d5eb-4f6e-861e-d96090a8e3a2" containerID="cb3cc09939abea02101f7b7d928ca1feefeeeb95779b53840339f20fb33f3e0e" exitCode=0 Nov 03 22:52:04.493815 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.493694 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d558bb4-8f6q2" event={"ID":"00873659-d5eb-4f6e-861e-d96090a8e3a2","Type":"ContainerDied","Data":"cb3cc09939abea02101f7b7d928ca1feefeeeb95779b53840339f20fb33f3e0e"} Nov 03 22:52:04.572905 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.572877 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:52:04.734794 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734704 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.734794 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734765 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.734794 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734790 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.735067 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734808 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.735067 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734835 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.735067 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734859 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.735067 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734926 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.735067 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.734990 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") pod \"00873659-d5eb-4f6e-861e-d96090a8e3a2\" (UID: \"00873659-d5eb-4f6e-861e-d96090a8e3a2\") " Nov 03 22:52:04.735330 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.735262 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:04.735412 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.735391 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:04.735412 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.735373 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:04.735558 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.735519 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:04.735774 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.735573 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:04.737375 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.737344 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:04.737757 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.737736 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:04.737837 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.737767 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9" pod "00873659-d5eb-4f6e-861e-d96090a8e3a2" (UID: "00873659-d5eb-4f6e-861e-d96090a8e3a2"). InnerVolumeSpecName "kube-api-access-64dz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:04.836424 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836380 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64dz9\" (UniqueName: \"kubernetes.io/projected/00873659-d5eb-4f6e-861e-d96090a8e3a2-kube-api-access-64dz9\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836424 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836413 6394 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-service-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836424 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836424 6394 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00873659-d5eb-4f6e-861e-d96090a8e3a2-tmp\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836424 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836433 6394 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-trusted-ca-bundle\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836718 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836468 6394 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-oauth-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836718 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836478 6394 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836718 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836486 6394 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-console-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:04.836718 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:04.836494 6394 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/00873659-d5eb-4f6e-861e-d96090a8e3a2-oauth-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.426169 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.426128 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-54f6b445b9-5k5ll" podUID="b0afaa38-0893-4ead-87aa-db622d95c401" containerName="console" containerID="cri-o://e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce" gracePeriod=15 Nov 03 22:52:05.501646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.501605 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d558bb4-8f6q2" event={"ID":"00873659-d5eb-4f6e-861e-d96090a8e3a2","Type":"ContainerDied","Data":"32c0c7baaebcde37f8196fba7b870ad29af5c8cfe0e83bbf037d222b20a11812"} Nov 03 22:52:05.501646 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.501628 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d558bb4-8f6q2" Nov 03 22:52:05.501865 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.501717 6394 scope.go:122] "RemoveContainer" containerID="cb3cc09939abea02101f7b7d928ca1feefeeeb95779b53840339f20fb33f3e0e" Nov 03 22:52:05.523100 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.523070 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d558bb4-8f6q2"] Nov 03 22:52:05.526739 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.526712 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d558bb4-8f6q2"] Nov 03 22:52:05.636520 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.636489 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-676d8c84bc-qzgxz" Nov 03 22:52:05.664383 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.664356 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:52:05.842522 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842488 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.842745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842537 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.842745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842589 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.842745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842633 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.842745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842687 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.842745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842715 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.843008 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842799 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") pod \"b0afaa38-0893-4ead-87aa-db622d95c401\" (UID: \"b0afaa38-0893-4ead-87aa-db622d95c401\") " Nov 03 22:52:05.843008 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.842917 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:05.843109 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.843019 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:05.843195 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.843028 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:05.843195 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.843038 6394 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0afaa38-0893-4ead-87aa-db622d95c401-tmp\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.843356 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.843231 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:05.845146 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.845116 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:05.845259 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.845146 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "kube-api-access-6kddw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:05.845259 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.845178 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert" pod "b0afaa38-0893-4ead-87aa-db622d95c401" (UID: "b0afaa38-0893-4ead-87aa-db622d95c401"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:05.943842 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.943804 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kddw\" (UniqueName: \"kubernetes.io/projected/b0afaa38-0893-4ead-87aa-db622d95c401-kube-api-access-6kddw\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.943842 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.943836 6394 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-oauth-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.943842 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.943846 6394 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-console-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.944078 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.943854 6394 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-oauth-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.944078 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.943863 6394 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0afaa38-0893-4ead-87aa-db622d95c401-console-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:05.944078 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:05.943872 6394 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0afaa38-0893-4ead-87aa-db622d95c401-service-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:06.342095 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.342066 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00873659-d5eb-4f6e-861e-d96090a8e3a2" path="/var/lib/kubelet/pods/00873659-d5eb-4f6e-861e-d96090a8e3a2/volumes" Nov 03 22:52:06.507867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.507833 6394 generic.go:356] "Generic (PLEG): container finished" podID="b0afaa38-0893-4ead-87aa-db622d95c401" containerID="e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce" exitCode=0 Nov 03 22:52:06.508320 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.507876 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6b445b9-5k5ll" Nov 03 22:52:06.508320 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.507893 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6b445b9-5k5ll" event={"ID":"b0afaa38-0893-4ead-87aa-db622d95c401","Type":"ContainerDied","Data":"e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce"} Nov 03 22:52:06.508320 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.507930 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6b445b9-5k5ll" event={"ID":"b0afaa38-0893-4ead-87aa-db622d95c401","Type":"ContainerDied","Data":"c99a71aa920f4bb6a6c3c614401aa8a27062acd6f0dfc9682aa78b7de635536a"} Nov 03 22:52:06.508320 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.507948 6394 scope.go:122] "RemoveContainer" containerID="e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce" Nov 03 22:52:06.515925 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.515910 6394 scope.go:122] "RemoveContainer" containerID="e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce" Nov 03 22:52:06.516194 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:06.516170 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce\": container with ID starting with e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce not found: ID does not exist" containerID="e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce" Nov 03 22:52:06.516259 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.516208 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce"} err="failed to get container status \"e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce\": rpc error: code = NotFound desc = could not find container \"e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce\": container with ID starting with e8ba765dbac94278318a7621b9ddcbb9a3dab24c3f025b1b506580c8ca68d4ce not found: ID does not exist" Nov 03 22:52:06.524006 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.523956 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f6b445b9-5k5ll"] Nov 03 22:52:06.528156 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:06.528134 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f6b445b9-5k5ll"] Nov 03 22:52:08.342768 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:08.342735 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0afaa38-0893-4ead-87aa-db622d95c401" path="/var/lib/kubelet/pods/b0afaa38-0893-4ead-87aa-db622d95c401/volumes" Nov 03 22:52:10.264754 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.264718 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:52:10.265258 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.265185 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="alertmanager" containerID="cri-o://bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751" gracePeriod=120 Nov 03 22:52:10.265399 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.265368 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-web" containerID="cri-o://25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d" gracePeriod=120 Nov 03 22:52:10.265577 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.265425 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="config-reloader" containerID="cri-o://0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8" gracePeriod=120 Nov 03 22:52:10.265577 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.265443 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="prom-label-proxy" containerID="cri-o://1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4" gracePeriod=120 Nov 03 22:52:10.265577 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.265382 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy" containerID="cri-o://3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc" gracePeriod=120 Nov 03 22:52:10.265577 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.265457 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-metric" containerID="cri-o://7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c" gracePeriod=120 Nov 03 22:52:10.525415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525333 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4" exitCode=0 Nov 03 22:52:10.525415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525358 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c" exitCode=0 Nov 03 22:52:10.525415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525364 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc" exitCode=0 Nov 03 22:52:10.525415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525370 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8" exitCode=0 Nov 03 22:52:10.525415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525374 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751" exitCode=0 Nov 03 22:52:10.525415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525396 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4"} Nov 03 22:52:10.525717 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525456 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c"} Nov 03 22:52:10.525717 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525484 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc"} Nov 03 22:52:10.525717 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525507 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8"} Nov 03 22:52:10.525717 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:10.525531 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751"} Nov 03 22:52:11.503678 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.503638 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.533289 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.533251 6394 generic.go:356] "Generic (PLEG): container finished" podID="6d83112e-5266-4d93-a60f-8a6681f30568" containerID="25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d" exitCode=0 Nov 03 22:52:11.533508 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.533302 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d"} Nov 03 22:52:11.533508 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.533388 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.533508 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.533398 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d83112e-5266-4d93-a60f-8a6681f30568","Type":"ContainerDied","Data":"b4d507c25631b5d75303f81a5244742be2d0302d7489e5575a646f829b5ad650"} Nov 03 22:52:11.533508 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.533446 6394 scope.go:122] "RemoveContainer" containerID="1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4" Nov 03 22:52:11.542398 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.542375 6394 scope.go:122] "RemoveContainer" containerID="7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c" Nov 03 22:52:11.551235 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.551215 6394 scope.go:122] "RemoveContainer" containerID="3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc" Nov 03 22:52:11.558719 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.558647 6394 scope.go:122] "RemoveContainer" containerID="25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d" Nov 03 22:52:11.566265 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.566244 6394 scope.go:122] "RemoveContainer" containerID="0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8" Nov 03 22:52:11.574973 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.574953 6394 scope.go:122] "RemoveContainer" containerID="bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751" Nov 03 22:52:11.582470 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.582451 6394 scope.go:122] "RemoveContainer" containerID="66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745" Nov 03 22:52:11.590864 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.590841 6394 scope.go:122] "RemoveContainer" containerID="1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4" Nov 03 22:52:11.591178 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.591158 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4\": container with ID starting with 1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4 not found: ID does not exist" containerID="1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4" Nov 03 22:52:11.591244 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.591198 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4"} err="failed to get container status \"1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4\": rpc error: code = NotFound desc = could not find container \"1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4\": container with ID starting with 1d64ef02dc3c4c2f1477616ff7614199c15a8dee94421293350da6046650d8e4 not found: ID does not exist" Nov 03 22:52:11.591244 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.591214 6394 scope.go:122] "RemoveContainer" containerID="7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c" Nov 03 22:52:11.591502 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.591475 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c\": container with ID starting with 7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c not found: ID does not exist" containerID="7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c" Nov 03 22:52:11.591545 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.591510 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c"} err="failed to get container status \"7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c\": rpc error: code = NotFound desc = could not find container \"7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c\": container with ID starting with 7c2fe01f70f744f1a4b37780f77f40040c9e279507ecd88471df31360098535c not found: ID does not exist" Nov 03 22:52:11.591545 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.591526 6394 scope.go:122] "RemoveContainer" containerID="3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc" Nov 03 22:52:11.591851 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.591835 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc\": container with ID starting with 3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc not found: ID does not exist" containerID="3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc" Nov 03 22:52:11.591892 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.591855 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc"} err="failed to get container status \"3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc\": rpc error: code = NotFound desc = could not find container \"3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc\": container with ID starting with 3c97565c52dadb8ff9de59d7f12a8405434dac4cb4ad4a7d0267aace572112cc not found: ID does not exist" Nov 03 22:52:11.591892 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.591867 6394 scope.go:122] "RemoveContainer" containerID="25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d" Nov 03 22:52:11.592125 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.592111 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d\": container with ID starting with 25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d not found: ID does not exist" containerID="25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d" Nov 03 22:52:11.592175 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592126 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d"} err="failed to get container status \"25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d\": rpc error: code = NotFound desc = could not find container \"25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d\": container with ID starting with 25728f4ae2009f15449f6427b3aabec32bbf6643b833b86973eb7dd8a2488f2d not found: ID does not exist" Nov 03 22:52:11.592175 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592145 6394 scope.go:122] "RemoveContainer" containerID="0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8" Nov 03 22:52:11.592360 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.592346 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8\": container with ID starting with 0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8 not found: ID does not exist" containerID="0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8" Nov 03 22:52:11.592400 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592365 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8"} err="failed to get container status \"0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8\": rpc error: code = NotFound desc = could not find container \"0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8\": container with ID starting with 0731b04d8d5ff7295288eacbe65461aa8b986f049d8985a27ce6900b543625c8 not found: ID does not exist" Nov 03 22:52:11.592400 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592377 6394 scope.go:122] "RemoveContainer" containerID="bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751" Nov 03 22:52:11.592605 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.592590 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751\": container with ID starting with bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751 not found: ID does not exist" containerID="bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751" Nov 03 22:52:11.592651 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592609 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751"} err="failed to get container status \"bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751\": rpc error: code = NotFound desc = could not find container \"bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751\": container with ID starting with bd0f35baf0c00156a5b7fa4b37e4da4f0ab9909ade6fa40912b7cc362bbb2751 not found: ID does not exist" Nov 03 22:52:11.592651 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592631 6394 scope.go:122] "RemoveContainer" containerID="66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745" Nov 03 22:52:11.592928 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:11.592910 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745\": container with ID starting with 66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745 not found: ID does not exist" containerID="66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745" Nov 03 22:52:11.592983 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.592935 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745"} err="failed to get container status \"66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745\": rpc error: code = NotFound desc = could not find container \"66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745\": container with ID starting with 66d2630d440957adf1c61df91189f2eec5774988ceb9a2aadc16aac276297745 not found: ID does not exist" Nov 03 22:52:11.686277 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686188 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686277 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686259 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686286 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686321 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686364 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686387 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686421 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686440 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686470 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686497 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686511 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686514 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686969 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686542 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686969 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686564 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6d83112e-5266-4d93-a60f-8a6681f30568\" (UID: \"6d83112e-5266-4d93-a60f-8a6681f30568\") " Nov 03 22:52:11.686969 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686641 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:11.686969 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.686786 6394 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.688684 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.687713 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:11.688684 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.687709 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:11.689537 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.689512 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "kube-api-access-6ht5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:11.689774 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.689748 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.689847 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.689785 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:11.689915 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.689862 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.690429 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.690400 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.690761 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.690735 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.691114 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.691092 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:11.691545 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.691521 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.694736 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.694632 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.701588 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.701560 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config" pod "6d83112e-5266-4d93-a60f-8a6681f30568" (UID: "6d83112e-5266-4d93-a60f-8a6681f30568"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:11.788002 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.787950 6394 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-web-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788002 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.787995 6394 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-tls-assets\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788002 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788007 6394 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788002 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788019 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ht5d\" (UniqueName: \"kubernetes.io/projected/6d83112e-5266-4d93-a60f-8a6681f30568-kube-api-access-6ht5d\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788029 6394 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-main-tls\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788038 6394 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788047 6394 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d83112e-5266-4d93-a60f-8a6681f30568-metrics-client-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788056 6394 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-config-out\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788064 6394 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-cluster-tls-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788073 6394 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788081 6394 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d83112e-5266-4d93-a60f-8a6681f30568-config-volume\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.788260 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.788089 6394 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d83112e-5266-4d93-a60f-8a6681f30568-alertmanager-main-db\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:11.856802 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.856774 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:52:11.861090 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.861067 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:52:11.884841 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.884806 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:52:11.885118 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885096 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="prom-label-proxy" Nov 03 22:52:11.885118 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885112 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="prom-label-proxy" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885131 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="init-config-reloader" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885137 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="init-config-reloader" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885146 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885151 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885159 6394 cpu_manager.go:414] "containerMap: removing container" podUID="b0afaa38-0893-4ead-87aa-db622d95c401" containerName="console" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885166 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0afaa38-0893-4ead-87aa-db622d95c401" containerName="console" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885175 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="config-reloader" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885179 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="config-reloader" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885184 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="alertmanager" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885188 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="alertmanager" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885196 6394 cpu_manager.go:414] "containerMap: removing container" podUID="00873659-d5eb-4f6e-861e-d96090a8e3a2" containerName="console" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885201 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00873659-d5eb-4f6e-861e-d96090a8e3a2" containerName="console" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885209 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-metric" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885213 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-metric" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885219 6394 cpu_manager.go:414] "containerMap: removing container" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-web" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885224 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-web" Nov 03 22:52:11.885264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885271 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885279 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0afaa38-0893-4ead-87aa-db622d95c401" containerName="console" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885285 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="config-reloader" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885290 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="alertmanager" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885296 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="00873659-d5eb-4f6e-861e-d96090a8e3a2" containerName="console" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885301 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-metric" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885305 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="kube-rbac-proxy-web" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885312 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="prom-label-proxy" Nov 03 22:52:11.885975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.885319 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" containerName="init-config-reloader" Nov 03 22:52:11.894726 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.894701 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.898794 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.898775 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Nov 03 22:52:11.901628 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.901608 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Nov 03 22:52:11.901758 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.901642 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Nov 03 22:52:11.904491 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.904465 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Nov 03 22:52:11.905035 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.905018 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:52:11.990198 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990109 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-web-config\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990198 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990154 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990198 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990182 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990419 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990307 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990419 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990341 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-config-out\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990419 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990356 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990428 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glc5d\" (UniqueName: \"kubernetes.io/projected/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-kube-api-access-glc5d\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990456 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990478 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990601 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990519 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990601 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990567 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990696 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990619 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:11.990696 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:11.990640 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.000255 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.000221 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Nov 03 22:52:12.000255 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.000242 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Nov 03 22:52:12.000255 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.000236 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Nov 03 22:52:12.000443 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.000267 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gqxw6\"" Nov 03 22:52:12.000443 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.000221 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Nov 03 22:52:12.000443 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.000300 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Nov 03 22:52:12.091774 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091739 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.091916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091791 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-config-out\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.091916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091809 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.091916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091833 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glc5d\" (UniqueName: \"kubernetes.io/projected/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-kube-api-access-glc5d\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.091916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091859 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.091916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091880 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.091916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091895 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092201 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.091925 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092201 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092071 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092201 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092121 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092201 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092165 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-web-config\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092402 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092209 6394 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 22:52:12.092883 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092473 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092883 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092216 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.092883 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.092540 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.093211 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.093127 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.093354 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.093262 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.095318 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095286 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.095426 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095335 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.095493 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095462 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-web-config\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.095589 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095564 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-config-out\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.095708 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095685 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.095769 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095707 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.096001 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.095980 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.096395 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.096376 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.096858 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.096838 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.100094 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.100077 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glc5d\" (UniqueName: \"kubernetes.io/projected/65e0beed-cf3c-4cbd-ae79-34dacd82f0c2-kube-api-access-glc5d\") pod \"alertmanager-main-0\" (UID: \"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2\") " pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.219305 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.219267 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Nov 03 22:52:12.342466 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.342433 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d83112e-5266-4d93-a60f-8a6681f30568" path="/var/lib/kubelet/pods/6d83112e-5266-4d93-a60f-8a6681f30568/volumes" Nov 03 22:52:12.541170 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:12.541151 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Nov 03 22:52:12.543602 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:52:12.543559 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e0beed_cf3c_4cbd_ae79_34dacd82f0c2.slice/crio-9d267c5d5203599e141154bedf359a11d44119afdfef42a5cbf5a98f9c7875a7 WatchSource:0}: Error finding container 9d267c5d5203599e141154bedf359a11d44119afdfef42a5cbf5a98f9c7875a7: Status 404 returned error can't find the container with id 9d267c5d5203599e141154bedf359a11d44119afdfef42a5cbf5a98f9c7875a7 Nov 03 22:52:13.543202 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:13.543173 6394 generic.go:356] "Generic (PLEG): container finished" podID="65e0beed-cf3c-4cbd-ae79-34dacd82f0c2" containerID="bc26542ac46bb7cc024e0c6157539ed6ffe5bab94e0b02b41566fe78bd6a782b" exitCode=0 Nov 03 22:52:13.543565 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:13.543210 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerDied","Data":"bc26542ac46bb7cc024e0c6157539ed6ffe5bab94e0b02b41566fe78bd6a782b"} Nov 03 22:52:13.543565 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:13.543259 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"9d267c5d5203599e141154bedf359a11d44119afdfef42a5cbf5a98f9c7875a7"} Nov 03 22:52:14.295131 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.295094 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b88c98b8d-8q86r"] Nov 03 22:52:14.298412 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.298394 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.305379 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.305354 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Nov 03 22:52:14.308151 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.308132 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Nov 03 22:52:14.311486 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311459 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311566 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311511 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-secret-telemeter-client\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311566 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311547 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-serving-certs-ca-bundle\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311693 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311572 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-metrics-client-ca\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311741 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311707 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311792 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311777 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-federate-client-tls\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311829 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311810 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn7lg\" (UniqueName: \"kubernetes.io/projected/22cc7343-fce6-4f53-a3a7-096f9cdadb14-kube-api-access-dn7lg\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.311963 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.311846 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-telemeter-client-tls\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.313040 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.313021 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b88c98b8d-8q86r"] Nov 03 22:52:14.392345 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.392314 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Nov 03 22:52:14.392345 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.392318 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Nov 03 22:52:14.392610 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.392489 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Nov 03 22:52:14.392610 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.392538 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z2rqk\"" Nov 03 22:52:14.392610 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.392597 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Nov 03 22:52:14.412932 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.412898 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-federate-client-tls\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.412999 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.412936 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn7lg\" (UniqueName: \"kubernetes.io/projected/22cc7343-fce6-4f53-a3a7-096f9cdadb14-kube-api-access-dn7lg\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.412999 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.412958 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-telemeter-client-tls\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.412999 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.412991 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.413141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.413018 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-secret-telemeter-client\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.413141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.413049 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-serving-certs-ca-bundle\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.413141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.413073 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-metrics-client-ca\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.413141 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.413115 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.414080 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.414049 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-serving-certs-ca-bundle\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.414213 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.414100 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-metrics-client-ca\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.414213 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.414199 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22cc7343-fce6-4f53-a3a7-096f9cdadb14-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.415744 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.415721 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.415825 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.415810 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-secret-telemeter-client\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.415979 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.415960 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-federate-client-tls\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.416015 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.415964 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/22cc7343-fce6-4f53-a3a7-096f9cdadb14-telemeter-client-tls\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.422236 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.422209 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn7lg\" (UniqueName: \"kubernetes.io/projected/22cc7343-fce6-4f53-a3a7-096f9cdadb14-kube-api-access-dn7lg\") pod \"telemeter-client-b88c98b8d-8q86r\" (UID: \"22cc7343-fce6-4f53-a3a7-096f9cdadb14\") " pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.550482 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.550389 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"45ca2f30bdf22922d6d2825407ea7040833557f61f0ec5e3b8a14385aafb7a82"} Nov 03 22:52:14.550482 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.550456 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"5cc5e764a3ccfa20189de28f39bdf78359fc671996b32d62511216cc06ff3cc9"} Nov 03 22:52:14.550482 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.550481 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"42f7d87e8c45c9bad6d56b569123e6e0700508f4957c28d365eb4c3c3f2d85ed"} Nov 03 22:52:14.550950 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.550514 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"6e98b365f190e20aaee4d393018fd58c19c44159d6e82d5dc02c7006dfb84cf3"} Nov 03 22:52:14.550950 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.550540 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"08a5535ea0c2e8a7c9cd28595ee8606312adf4971fa6e29821d8f918057c573e"} Nov 03 22:52:14.550950 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.550605 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"65e0beed-cf3c-4cbd-ae79-34dacd82f0c2","Type":"ContainerStarted","Data":"ac7a782ac04297126ee1eec69e270093c55a9d2a38a31ca615605407bda14a73"} Nov 03 22:52:14.578512 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.578445 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.564708933 podStartE2EDuration="3.578430344s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.721411ms" isStatefulPod=false podCreationTimestamp="2026-11-03 22:52:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:52:14.578032243 +0000 UTC m=+36.355001431" watchObservedRunningTime="2026-11-03 22:52:14.578430344 +0000 UTC m=+36.355399529" Nov 03 22:52:14.614275 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.614229 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" Nov 03 22:52:14.641496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.641465 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nmwkz" Nov 03 22:52:14.893782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.893743 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b88c98b8d-8q86r"] Nov 03 22:52:14.896713 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:52:14.896681 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cc7343_fce6_4f53_a3a7_096f9cdadb14.slice/crio-50f0ff96dd8c6f79b83c2c3f1b65a2df7f2f00e44eb1a7c1faddfb6a98c6f27e WatchSource:0}: Error finding container 50f0ff96dd8c6f79b83c2c3f1b65a2df7f2f00e44eb1a7c1faddfb6a98c6f27e: Status 404 returned error can't find the container with id 50f0ff96dd8c6f79b83c2c3f1b65a2df7f2f00e44eb1a7c1faddfb6a98c6f27e Nov 03 22:52:14.898696 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:14.898681 6394 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 22:52:15.557296 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:15.557262 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" event={"ID":"22cc7343-fce6-4f53-a3a7-096f9cdadb14","Type":"ContainerStarted","Data":"50f0ff96dd8c6f79b83c2c3f1b65a2df7f2f00e44eb1a7c1faddfb6a98c6f27e"} Nov 03 22:52:17.566180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.566145 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" event={"ID":"22cc7343-fce6-4f53-a3a7-096f9cdadb14","Type":"ContainerStarted","Data":"b9ae611a03fbbebc9b49ec282212e12e49ac9c8da530c9604157af6ded61f091"} Nov 03 22:52:17.566598 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.566199 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" event={"ID":"22cc7343-fce6-4f53-a3a7-096f9cdadb14","Type":"ContainerStarted","Data":"c8fa8b48fdee6a92423904039da48c9665c0db63bd30fff4d11e54764aa8cd10"} Nov 03 22:52:17.566598 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.566219 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" event={"ID":"22cc7343-fce6-4f53-a3a7-096f9cdadb14","Type":"ContainerStarted","Data":"091d5614a1ca61dfd74aff47e8b4de42a791682583d09351817ef8deb9ef80fc"} Nov 03 22:52:17.588143 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.588087 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b88c98b8d-8q86r" podStartSLOduration=1.8824939619999999 podStartE2EDuration="3.588073152s" totalImagesPullingTime="1.70557919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:52:17.5862178 +0000 UTC m=+39.363186988" watchObservedRunningTime="2026-11-03 22:52:17.588073152 +0000 UTC m=+39.365042341" Nov 03 22:52:17.665005 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.664973 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-76cd598c88-ch6h9"] Nov 03 22:52:17.668097 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.668080 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.678193 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.678164 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cd598c88-ch6h9"] Nov 03 22:52:17.740429 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740394 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740429 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740431 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740712 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740461 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740712 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740613 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740712 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740649 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppr9m\" (UniqueName: \"kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740822 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740776 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740822 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740804 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.740916 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.740840 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842032 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.841994 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842032 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842035 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842261 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842067 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842261 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842090 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842261 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842108 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppr9m\" (UniqueName: \"kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842261 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842241 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842477 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842276 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842477 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842332 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.842798 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842722 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.843020 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842995 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.843093 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.842995 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.843093 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.843033 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.843192 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.843138 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.845234 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.845209 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.845318 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.845296 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.854544 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.854518 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppr9m\" (UniqueName: \"kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m\") pod \"console-76cd598c88-ch6h9\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:17.980258 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:17.980223 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:18.252106 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:18.252027 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cd598c88-ch6h9"] Nov 03 22:52:18.257693 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:52:18.257641 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a57262_b1bb_4abf_bf57_522a0c57c493.slice/crio-8a81e19b0a59d5f8030810a3e1752a4c322b70eb3562992508540294af95718b WatchSource:0}: Error finding container 8a81e19b0a59d5f8030810a3e1752a4c322b70eb3562992508540294af95718b: Status 404 returned error can't find the container with id 8a81e19b0a59d5f8030810a3e1752a4c322b70eb3562992508540294af95718b Nov 03 22:52:18.571242 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:18.571212 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd598c88-ch6h9" event={"ID":"58a57262-b1bb-4abf-bf57-522a0c57c493","Type":"ContainerStarted","Data":"13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9"} Nov 03 22:52:18.571634 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:18.571262 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd598c88-ch6h9" event={"ID":"58a57262-b1bb-4abf-bf57-522a0c57c493","Type":"ContainerStarted","Data":"8a81e19b0a59d5f8030810a3e1752a4c322b70eb3562992508540294af95718b"} Nov 03 22:52:18.592019 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:18.591962 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-76cd598c88-ch6h9" podStartSLOduration=1.591945631 podStartE2EDuration="1.591945631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:52:18.589483373 +0000 UTC m=+40.366452564" watchObservedRunningTime="2026-11-03 22:52:18.591945631 +0000 UTC m=+40.368914821" Nov 03 22:52:18.886683 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:18.886577 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:52:27.981003 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:27.980964 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:27.981496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:27.981050 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:27.985616 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:27.985594 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:28.611279 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:28.611251 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:52:28.655550 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:28.655520 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6db9cd76d9-fkj8n"] Nov 03 22:52:34.775574 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.775539 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-69945fc674-7bbft"] Nov 03 22:52:34.779903 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.779879 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.791985 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.791943 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69945fc674-7bbft"] Nov 03 22:52:34.886293 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886256 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-config\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886293 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886293 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-oauth-config\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886327 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-service-ca\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886435 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-tmp\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886470 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-serving-cert\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886496 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886491 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-oauth-serving-cert\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886629 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886611 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-trusted-ca-bundle\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.886681 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.886645 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fskrq\" (UniqueName: \"kubernetes.io/projected/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-kube-api-access-fskrq\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.987792 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987758 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-service-ca\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.987956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987800 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-tmp\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.987956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987823 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-serving-cert\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.987956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987847 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-oauth-serving-cert\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.987956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987894 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-trusted-ca-bundle\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.987956 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987934 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fskrq\" (UniqueName: \"kubernetes.io/projected/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-kube-api-access-fskrq\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988198 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987957 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-config\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988198 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.987979 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-oauth-config\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988494 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.988456 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-tmp\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988627 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.988605 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-service-ca\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988725 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.988606 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-oauth-serving-cert\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988826 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.988805 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-config\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.988910 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.988891 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-trusted-ca-bundle\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.991064 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.991041 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-serving-cert\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.991151 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.991086 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-console-oauth-config\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:34.996474 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:34.996452 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fskrq\" (UniqueName: \"kubernetes.io/projected/5ec5f7a9-534d-44dd-a489-2a7627fe74d9-kube-api-access-fskrq\") pod \"console-69945fc674-7bbft\" (UID: \"5ec5f7a9-534d-44dd-a489-2a7627fe74d9\") " pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:35.092364 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:35.092333 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:35.363396 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:35.363316 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69945fc674-7bbft"] Nov 03 22:52:35.367170 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:52:35.367142 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec5f7a9_534d_44dd_a489_2a7627fe74d9.slice/crio-a3e6838809768b953123e1b99e7cdd95700e7f067d732030a08cef0380ab5d85 WatchSource:0}: Error finding container a3e6838809768b953123e1b99e7cdd95700e7f067d732030a08cef0380ab5d85: Status 404 returned error can't find the container with id a3e6838809768b953123e1b99e7cdd95700e7f067d732030a08cef0380ab5d85 Nov 03 22:52:35.633925 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:35.633834 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69945fc674-7bbft" event={"ID":"5ec5f7a9-534d-44dd-a489-2a7627fe74d9","Type":"ContainerStarted","Data":"b86af80e8aca21dc3208660e2a57f9d1153385b56a72124702b07e64ce53d7e9"} Nov 03 22:52:35.633925 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:35.633893 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69945fc674-7bbft" event={"ID":"5ec5f7a9-534d-44dd-a489-2a7627fe74d9","Type":"ContainerStarted","Data":"a3e6838809768b953123e1b99e7cdd95700e7f067d732030a08cef0380ab5d85"} Nov 03 22:52:45.092748 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:45.092710 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:45.093203 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:45.092804 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:45.097442 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:45.097421 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:45.115925 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:45.115879 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-69945fc674-7bbft" podStartSLOduration=11.115867675 podStartE2EDuration="11.115867675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:52:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:52:35.651748857 +0000 UTC m=+57.428718050" watchObservedRunningTime="2026-11-03 22:52:45.115867675 +0000 UTC m=+66.892836858" Nov 03 22:52:45.675031 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:45.674999 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69945fc674-7bbft" Nov 03 22:52:45.724739 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:45.724709 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cd598c88-ch6h9"] Nov 03 22:52:48.887303 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:48.887257 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:52:53.675909 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:53.675865 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6db9cd76d9-fkj8n" podUID="917104af-56ea-402a-a489-677a81bbad80" containerName="console" containerID="cri-o://2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010" gracePeriod=15 Nov 03 22:52:53.916188 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:53.916164 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:52:54.051630 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051534 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.051630 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051587 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.051630 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051620 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.051910 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051746 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.051910 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051813 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.051910 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051876 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.051910 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051903 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.052110 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.051966 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") pod \"917104af-56ea-402a-a489-677a81bbad80\" (UID: \"917104af-56ea-402a-a489-677a81bbad80\") " Nov 03 22:52:54.052110 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052008 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:54.052110 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052068 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:54.052264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052103 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:52:54.052264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052216 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:54.052264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052223 6394 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-console-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.052264 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052262 6394 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-oauth-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.052414 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052279 6394 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917104af-56ea-402a-a489-677a81bbad80-tmp\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.052414 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.052293 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:52:54.054211 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.054176 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:54.054326 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.054306 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "kube-api-access-qwplj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:52:54.054326 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.054312 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config" pod "917104af-56ea-402a-a489-677a81bbad80" (UID: "917104af-56ea-402a-a489-677a81bbad80"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:52:54.153051 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.153013 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwplj\" (UniqueName: \"kubernetes.io/projected/917104af-56ea-402a-a489-677a81bbad80-kube-api-access-qwplj\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.153051 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.153045 6394 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-trusted-ca-bundle\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.153051 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.153057 6394 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/917104af-56ea-402a-a489-677a81bbad80-service-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.153288 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.153066 6394 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.153288 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.153075 6394 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/917104af-56ea-402a-a489-677a81bbad80-console-oauth-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:52:54.701719 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.701613 6394 generic.go:356] "Generic (PLEG): container finished" podID="917104af-56ea-402a-a489-677a81bbad80" containerID="2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010" exitCode=0 Nov 03 22:52:54.701719 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.701690 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6db9cd76d9-fkj8n" Nov 03 22:52:54.701719 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.701702 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db9cd76d9-fkj8n" event={"ID":"917104af-56ea-402a-a489-677a81bbad80","Type":"ContainerDied","Data":"2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010"} Nov 03 22:52:54.702227 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.701753 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6db9cd76d9-fkj8n" event={"ID":"917104af-56ea-402a-a489-677a81bbad80","Type":"ContainerDied","Data":"d49efcaeb769e6ecc34cd34999a17816efc352235f10ab29c3bb89805f39b335"} Nov 03 22:52:54.702227 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.701774 6394 scope.go:122] "RemoveContainer" containerID="2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010" Nov 03 22:52:54.709792 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.709773 6394 scope.go:122] "RemoveContainer" containerID="2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010" Nov 03 22:52:54.710064 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:52:54.710040 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010\": container with ID starting with 2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010 not found: ID does not exist" containerID="2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010" Nov 03 22:52:54.710123 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.710073 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010"} err="failed to get container status \"2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010\": rpc error: code = NotFound desc = could not find container \"2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010\": container with ID starting with 2384205e415211a02afd73689a7c909c18c0d28c2dda82e6365ba6d9f5940010 not found: ID does not exist" Nov 03 22:52:54.718564 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.718539 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6db9cd76d9-fkj8n"] Nov 03 22:52:54.720215 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:54.720194 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6db9cd76d9-fkj8n"] Nov 03 22:52:56.342178 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:52:56.342147 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="917104af-56ea-402a-a489-677a81bbad80" path="/var/lib/kubelet/pods/917104af-56ea-402a-a489-677a81bbad80/volumes" Nov 03 22:53:10.744721 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:10.744637 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-76cd598c88-ch6h9" podUID="58a57262-b1bb-4abf-bf57-522a0c57c493" containerName="console" containerID="cri-o://13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9" gracePeriod=15 Nov 03 22:53:10.978716 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:10.978692 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:53:11.076277 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076249 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076289 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076306 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076337 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076360 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076379 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076405 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m\" (UniqueName: \"kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076481 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076447 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert\") pod \"58a57262-b1bb-4abf-bf57-522a0c57c493\" (UID: \"58a57262-b1bb-4abf-bf57-522a0c57c493\") " Nov 03 22:53:11.076873 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076784 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:53:11.076975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076836 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:53:11.076975 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.076848 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:53:11.077329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.077025 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:53:11.077329 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.077076 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:53:11.078730 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.078702 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "kube-api-access-ppr9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:53:11.078818 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.078767 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:53:11.078818 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.078788 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config" pod "58a57262-b1bb-4abf-bf57-522a0c57c493" (UID: "58a57262-b1bb-4abf-bf57-522a0c57c493"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:53:11.177358 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177319 6394 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-console-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177358 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177351 6394 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-service-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177358 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177361 6394 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58a57262-b1bb-4abf-bf57-522a0c57c493-tmp\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177594 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177370 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppr9m\" (UniqueName: \"kubernetes.io/projected/58a57262-b1bb-4abf-bf57-522a0c57c493-kube-api-access-ppr9m\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177594 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177380 6394 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-oauth-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177594 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177389 6394 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58a57262-b1bb-4abf-bf57-522a0c57c493-trusted-ca-bundle\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177594 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177397 6394 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-oauth-config\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.177594 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.177405 6394 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58a57262-b1bb-4abf-bf57-522a0c57c493-console-serving-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:53:11.763258 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.763223 6394 generic.go:356] "Generic (PLEG): container finished" podID="58a57262-b1bb-4abf-bf57-522a0c57c493" containerID="13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9" exitCode=0 Nov 03 22:53:11.763702 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.763268 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd598c88-ch6h9" Nov 03 22:53:11.763702 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.763276 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd598c88-ch6h9" event={"ID":"58a57262-b1bb-4abf-bf57-522a0c57c493","Type":"ContainerDied","Data":"13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9"} Nov 03 22:53:11.763702 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.763315 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd598c88-ch6h9" event={"ID":"58a57262-b1bb-4abf-bf57-522a0c57c493","Type":"ContainerDied","Data":"8a81e19b0a59d5f8030810a3e1752a4c322b70eb3562992508540294af95718b"} Nov 03 22:53:11.763702 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.763334 6394 scope.go:122] "RemoveContainer" containerID="13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9" Nov 03 22:53:11.771613 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.771594 6394 scope.go:122] "RemoveContainer" containerID="13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9" Nov 03 22:53:11.771928 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:53:11.771907 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9\": container with ID starting with 13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9 not found: ID does not exist" containerID="13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9" Nov 03 22:53:11.772020 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.771934 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9"} err="failed to get container status \"13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9\": rpc error: code = NotFound desc = could not find container \"13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9\": container with ID starting with 13392bb4c924aafebea35af14b9017fc1b2e1ae583c84282f2fc0d4cad8753e9 not found: ID does not exist" Nov 03 22:53:11.783022 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.782998 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cd598c88-ch6h9"] Nov 03 22:53:11.786476 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:11.786454 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76cd598c88-ch6h9"] Nov 03 22:53:12.342020 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:53:12.341987 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58a57262-b1bb-4abf-bf57-522a0c57c493" path="/var/lib/kubelet/pods/58a57262-b1bb-4abf-bf57-522a0c57c493/volumes" Nov 03 22:53:18.886084 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:53:18.886003 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:53:48.886183 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:53:48.886144 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:54:18.887689 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:54:18.887635 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:54:34.168734 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.168700 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl"] Nov 03 22:54:34.169136 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.169042 6394 cpu_manager.go:414] "containerMap: removing container" podUID="917104af-56ea-402a-a489-677a81bbad80" containerName="console" Nov 03 22:54:34.169136 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.169059 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="917104af-56ea-402a-a489-677a81bbad80" containerName="console" Nov 03 22:54:34.169136 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.169082 6394 cpu_manager.go:414] "containerMap: removing container" podUID="58a57262-b1bb-4abf-bf57-522a0c57c493" containerName="console" Nov 03 22:54:34.169136 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.169087 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58a57262-b1bb-4abf-bf57-522a0c57c493" containerName="console" Nov 03 22:54:34.169288 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.169149 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="917104af-56ea-402a-a489-677a81bbad80" containerName="console" Nov 03 22:54:34.169288 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.169158 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="58a57262-b1bb-4abf-bf57-522a0c57c493" containerName="console" Nov 03 22:54:34.172233 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.172213 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.179212 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.178929 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-l8s87\"" Nov 03 22:54:34.179212 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.178956 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 22:54:34.179212 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.179043 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 22:54:34.184638 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.184615 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl"] Nov 03 22:54:34.230782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.230743 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.230782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.230789 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.231010 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.230911 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddtg6\" (UniqueName: \"kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.331680 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.331620 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddtg6\" (UniqueName: \"kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.331849 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.331721 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.331849 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.331744 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.332076 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.332062 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.332143 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.332124 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.343028 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.343000 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddtg6\" (UniqueName: \"kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.488336 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.488253 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:54:34.621382 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.621352 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm"] Nov 03 22:54:34.624565 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.624550 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.630867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.630748 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 03 22:54:34.630867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.630761 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 22:54:34.630867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.630766 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 03 22:54:34.630867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.630823 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 22:54:34.630867 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.630827 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 03 22:54:34.631936 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.631920 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 03 22:54:34.632032 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.632005 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4z5kk\"" Nov 03 22:54:34.637035 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.636981 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm"] Nov 03 22:54:34.734314 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734277 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.734314 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734320 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.734733 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734409 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.734733 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734457 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.734733 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734486 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.734733 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734508 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2zc\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.734733 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.734599 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.758274 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.758193 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl"] Nov 03 22:54:34.761944 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:54:34.761920 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a9565e_f9c9_4daa_91f6_5549d09ed75c.slice/crio-40a08ff41c35b903858b91612fc0b8399a998768415e5a9459cf604ac0d3af1f WatchSource:0}: Error finding container 40a08ff41c35b903858b91612fc0b8399a998768415e5a9459cf604ac0d3af1f: Status 404 returned error can't find the container with id 40a08ff41c35b903858b91612fc0b8399a998768415e5a9459cf604ac0d3af1f Nov 03 22:54:34.835307 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835274 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2zc\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.835307 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835310 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.835588 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835342 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.835588 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835370 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.835588 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835401 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.835588 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835425 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.835588 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.835447 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.836066 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.836039 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.838068 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.838043 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.838217 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.838138 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.838286 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.838223 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.838340 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.838297 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.843272 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.843246 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.843470 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.843452 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2zc\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc\") pod \"istiod-openshift-gateway-7876bfcb74-mmgdm\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:34.935981 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:34.935952 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:35.041115 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:35.041029 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" event={"ID":"b7a9565e-f9c9-4daa-91f6-5549d09ed75c","Type":"ContainerStarted","Data":"40a08ff41c35b903858b91612fc0b8399a998768415e5a9459cf604ac0d3af1f"} Nov 03 22:54:35.209440 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:35.209407 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm"] Nov 03 22:54:35.212989 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:54:35.212952 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa15df87_6dec_4c0b_8bc1_4e713161cf3f.slice/crio-e8c158b5b0f35732abfc422326d75471339bd247f78249f78a1c9eb0ced69ef9 WatchSource:0}: Error finding container e8c158b5b0f35732abfc422326d75471339bd247f78249f78a1c9eb0ced69ef9: Status 404 returned error can't find the container with id e8c158b5b0f35732abfc422326d75471339bd247f78249f78a1c9eb0ced69ef9 Nov 03 22:54:36.045974 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:36.045940 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" event={"ID":"aa15df87-6dec-4c0b-8bc1-4e713161cf3f","Type":"ContainerStarted","Data":"e8c158b5b0f35732abfc422326d75471339bd247f78249f78a1c9eb0ced69ef9"} Nov 03 22:54:46.086273 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:46.086234 6394 generic.go:356] "Generic (PLEG): container finished" podID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerID="249c0899894246eb1efc611312592d65f5faf096f3005d010926e842f3a3a52e" exitCode=0 Nov 03 22:54:46.086812 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:46.086281 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" event={"ID":"b7a9565e-f9c9-4daa-91f6-5549d09ed75c","Type":"ContainerDied","Data":"249c0899894246eb1efc611312592d65f5faf096f3005d010926e842f3a3a52e"} Nov 03 22:54:48.886390 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:54:48.886353 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:54:49.099474 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:49.099436 6394 generic.go:356] "Generic (PLEG): container finished" podID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerID="50a3bcbe40289751c010ec6557cce31459cea141bc46e5a7db4ae75ecbb9a259" exitCode=0 Nov 03 22:54:49.099690 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:49.099521 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" event={"ID":"b7a9565e-f9c9-4daa-91f6-5549d09ed75c","Type":"ContainerDied","Data":"50a3bcbe40289751c010ec6557cce31459cea141bc46e5a7db4ae75ecbb9a259"} Nov 03 22:54:52.829090 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:52.829061 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:54:52.829524 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:52.829130 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 22:54:53.117953 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:53.117869 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" event={"ID":"aa15df87-6dec-4c0b-8bc1-4e713161cf3f","Type":"ContainerStarted","Data":"1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e"} Nov 03 22:54:53.118139 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:53.118047 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:54:53.119675 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:53.119636 6394 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-mmgdm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 03 22:54:53.119786 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:53.119722 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" podUID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 22:54:53.139048 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:53.138997 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" podStartSLOduration=1.526089522 podStartE2EDuration="19.138985063s" totalImagesPullingTime="17.612895541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:54:53.13710774 +0000 UTC m=+194.914076923" watchObservedRunningTime="2026-11-03 22:54:53.138985063 +0000 UTC m=+194.915954251" Nov 03 22:54:54.121874 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:54:54.121844 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:55:01.148085 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:01.148046 6394 generic.go:356] "Generic (PLEG): container finished" podID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerID="7b7e9d08c062fc522e946516df87815c879b4c9b3634c31aa492cbaf2f52a85a" exitCode=0 Nov 03 22:55:01.148537 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:01.148103 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" event={"ID":"b7a9565e-f9c9-4daa-91f6-5549d09ed75c","Type":"ContainerDied","Data":"7b7e9d08c062fc522e946516df87815c879b4c9b3634c31aa492cbaf2f52a85a"} Nov 03 22:55:02.301626 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.301588 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:55:02.484451 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.484372 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle\") pod \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " Nov 03 22:55:02.484451 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.484416 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6\" (UniqueName: \"kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6\") pod \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " Nov 03 22:55:02.484678 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.484468 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util\") pod \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\" (UID: \"b7a9565e-f9c9-4daa-91f6-5549d09ed75c\") " Nov 03 22:55:02.484910 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.484883 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle" pod "b7a9565e-f9c9-4daa-91f6-5549d09ed75c" (UID: "b7a9565e-f9c9-4daa-91f6-5549d09ed75c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:02.486880 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.486849 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6" pod "b7a9565e-f9c9-4daa-91f6-5549d09ed75c" (UID: "b7a9565e-f9c9-4daa-91f6-5549d09ed75c"). InnerVolumeSpecName "kube-api-access-ddtg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:55:02.488993 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.488970 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util" pod "b7a9565e-f9c9-4daa-91f6-5549d09ed75c" (UID: "b7a9565e-f9c9-4daa-91f6-5549d09ed75c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:55:02.585177 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.585135 6394 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-bundle\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:02.585177 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.585170 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddtg6\" (UniqueName: \"kubernetes.io/projected/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-kube-api-access-ddtg6\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:02.585177 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:02.585183 6394 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7a9565e-f9c9-4daa-91f6-5549d09ed75c-util\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:55:03.156705 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:03.156643 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" event={"ID":"b7a9565e-f9c9-4daa-91f6-5549d09ed75c","Type":"ContainerDied","Data":"40a08ff41c35b903858b91612fc0b8399a998768415e5a9459cf604ac0d3af1f"} Nov 03 22:55:03.156872 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:03.156724 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40a08ff41c35b903858b91612fc0b8399a998768415e5a9459cf604ac0d3af1f" Nov 03 22:55:03.156872 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:03.156735 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644ggkpl" Nov 03 22:55:14.729283 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729253 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw"] Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729544 6394 cpu_manager.go:414] "containerMap: removing container" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="extract" Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729555 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="extract" Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729567 6394 cpu_manager.go:414] "containerMap: removing container" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="pull" Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729572 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="pull" Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729582 6394 cpu_manager.go:414] "containerMap: removing container" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="util" Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729586 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="util" Nov 03 22:55:14.729782 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.729642 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7a9565e-f9c9-4daa-91f6-5549d09ed75c" containerName="extract" Nov 03 22:55:14.731601 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.731586 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.760870 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.760841 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw"] Nov 03 22:55:14.774966 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.774933 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2380ed68-2192-4dfc-8940-a0871bd539d6-manifests\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.775138 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.774985 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-metrics-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.775138 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.775013 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj9gx\" (UniqueName: \"kubernetes.io/projected/2380ed68-2192-4dfc-8940-a0871bd539d6-kube-api-access-rj9gx\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.775138 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.775093 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2380ed68-2192-4dfc-8940-a0871bd539d6-tmp\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.775138 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.775123 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.775286 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.775142 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.821356 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.821323 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 03 22:55:14.821539 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.821411 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 03 22:55:14.824840 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.824823 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 03 22:55:14.825081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.825063 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 03 22:55:14.825081 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.825073 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-psthp\"" Nov 03 22:55:14.825215 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.825145 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 03 22:55:14.875569 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.875530 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-metrics-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.875755 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.875573 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj9gx\" (UniqueName: \"kubernetes.io/projected/2380ed68-2192-4dfc-8940-a0871bd539d6-kube-api-access-rj9gx\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.875755 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.875615 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2380ed68-2192-4dfc-8940-a0871bd539d6-tmp\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.875755 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.875647 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.875909 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.875871 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.875960 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.875931 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2380ed68-2192-4dfc-8940-a0871bd539d6-manifests\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.876301 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.876280 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2380ed68-2192-4dfc-8940-a0871bd539d6-manifests\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.878133 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.878105 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2380ed68-2192-4dfc-8940-a0871bd539d6-tmp\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.878373 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.878353 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-webhook-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.878644 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.878628 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-metrics-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.878797 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.878778 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2380ed68-2192-4dfc-8940-a0871bd539d6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:14.893273 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:14.893247 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj9gx\" (UniqueName: \"kubernetes.io/projected/2380ed68-2192-4dfc-8940-a0871bd539d6-kube-api-access-rj9gx\") pod \"opendatahub-operator-controller-manager-8b65dd898-z95sw\" (UID: \"2380ed68-2192-4dfc-8940-a0871bd539d6\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:15.044561 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:15.044476 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:15.340520 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:15.340497 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw"] Nov 03 22:55:15.343233 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:55:15.343206 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2380ed68_2192_4dfc_8940_a0871bd539d6.slice/crio-50f1256b6ba030e14f5b9f4d37bc5222f40a4455eebc7af0743abc7ccceec828 WatchSource:0}: Error finding container 50f1256b6ba030e14f5b9f4d37bc5222f40a4455eebc7af0743abc7ccceec828: Status 404 returned error can't find the container with id 50f1256b6ba030e14f5b9f4d37bc5222f40a4455eebc7af0743abc7ccceec828 Nov 03 22:55:16.205828 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:16.205792 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" event={"ID":"2380ed68-2192-4dfc-8940-a0871bd539d6","Type":"ContainerStarted","Data":"50f1256b6ba030e14f5b9f4d37bc5222f40a4455eebc7af0743abc7ccceec828"} Nov 03 22:55:18.888341 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:55:18.888302 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:55:19.219487 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:19.219399 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" event={"ID":"2380ed68-2192-4dfc-8940-a0871bd539d6","Type":"ContainerStarted","Data":"82a1c809822601a98066e674c32dfb4d72b78d52f67846b588547997cbf859ae"} Nov 03 22:55:20.225101 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:20.225065 6394 generic.go:356] "Generic (PLEG): container finished" podID="2380ed68-2192-4dfc-8940-a0871bd539d6" containerID="82a1c809822601a98066e674c32dfb4d72b78d52f67846b588547997cbf859ae" exitCode=0 Nov 03 22:55:20.225101 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:20.225089 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" event={"ID":"2380ed68-2192-4dfc-8940-a0871bd539d6","Type":"ContainerDied","Data":"82a1c809822601a98066e674c32dfb4d72b78d52f67846b588547997cbf859ae"} Nov 03 22:55:21.230416 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:21.230380 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" event={"ID":"2380ed68-2192-4dfc-8940-a0871bd539d6","Type":"ContainerStarted","Data":"479a71d5c1ca4bebe74cefca41a0bfbc926c6219dbb9c4091e92217979828987"} Nov 03 22:55:21.230865 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:21.230480 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:21.263953 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:21.263894 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" podStartSLOduration=2.682646437 podStartE2EDuration="7.263876619s" totalImagesPullingTime="4.062333233s" totalInitContainerRuntime="518.896949ms" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:21.261840116 +0000 UTC m=+223.038809332" watchObservedRunningTime="2026-11-03 22:55:21.263876619 +0000 UTC m=+223.040845805" Nov 03 22:55:32.235982 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:32.235951 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8b65dd898-z95sw" Nov 03 22:55:35.251624 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.251589 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v"] Nov 03 22:55:35.253606 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.253588 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:35.264955 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.264198 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 03 22:55:35.264955 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.264356 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mcjzv\"" Nov 03 22:55:35.265388 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.265363 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 03 22:55:35.266127 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.266101 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v"] Nov 03 22:55:35.348197 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.348157 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk7th\" (UniqueName: \"kubernetes.io/projected/2afd1042-9056-4440-92f1-d00ce5ec38ae-kube-api-access-vk7th\") pod \"authorino-operator-7b7bb4bc77-fbm7v\" (UID: \"2afd1042-9056-4440-92f1-d00ce5ec38ae\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:35.448568 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.448534 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk7th\" (UniqueName: \"kubernetes.io/projected/2afd1042-9056-4440-92f1-d00ce5ec38ae-kube-api-access-vk7th\") pod \"authorino-operator-7b7bb4bc77-fbm7v\" (UID: \"2afd1042-9056-4440-92f1-d00ce5ec38ae\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:35.462606 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.462563 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk7th\" (UniqueName: \"kubernetes.io/projected/2afd1042-9056-4440-92f1-d00ce5ec38ae-kube-api-access-vk7th\") pod \"authorino-operator-7b7bb4bc77-fbm7v\" (UID: \"2afd1042-9056-4440-92f1-d00ce5ec38ae\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:35.566970 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.566871 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:35.838610 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:35.838565 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v"] Nov 03 22:55:35.841624 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:55:35.841596 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2afd1042_9056_4440_92f1_d00ce5ec38ae.slice/crio-e6afa70408619673bd8b390a9b429790357e3e2b65713caed04fb31cf2d9e4ae WatchSource:0}: Error finding container e6afa70408619673bd8b390a9b429790357e3e2b65713caed04fb31cf2d9e4ae: Status 404 returned error can't find the container with id e6afa70408619673bd8b390a9b429790357e3e2b65713caed04fb31cf2d9e4ae Nov 03 22:55:36.285203 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:36.285119 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" event={"ID":"2afd1042-9056-4440-92f1-d00ce5ec38ae","Type":"ContainerStarted","Data":"e6afa70408619673bd8b390a9b429790357e3e2b65713caed04fb31cf2d9e4ae"} Nov 03 22:55:41.653783 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.653746 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq"] Nov 03 22:55:41.657127 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.657108 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:41.669032 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.669006 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tzxmq\"" Nov 03 22:55:41.670831 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.670804 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq"] Nov 03 22:55:41.807325 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.807289 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4z5\" (UniqueName: \"kubernetes.io/projected/2a92bfd0-105a-4b00-a171-bf0fadd6b412-kube-api-access-9b4z5\") pod \"limitador-operator-controller-manager-5778bb4449-xgxbq\" (UID: \"2a92bfd0-105a-4b00-a171-bf0fadd6b412\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:41.908598 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.908499 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4z5\" (UniqueName: \"kubernetes.io/projected/2a92bfd0-105a-4b00-a171-bf0fadd6b412-kube-api-access-9b4z5\") pod \"limitador-operator-controller-manager-5778bb4449-xgxbq\" (UID: \"2a92bfd0-105a-4b00-a171-bf0fadd6b412\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:41.917157 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.917129 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4z5\" (UniqueName: \"kubernetes.io/projected/2a92bfd0-105a-4b00-a171-bf0fadd6b412-kube-api-access-9b4z5\") pod \"limitador-operator-controller-manager-5778bb4449-xgxbq\" (UID: \"2a92bfd0-105a-4b00-a171-bf0fadd6b412\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:41.969709 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:41.969676 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:42.244257 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:42.244174 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq"] Nov 03 22:55:42.247229 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:55:42.247193 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a92bfd0_105a_4b00_a171_bf0fadd6b412.slice/crio-8256741e8069fe1cf720f6940f4e4d29feeb06b9a4570f49445467d1ffcb22eb WatchSource:0}: Error finding container 8256741e8069fe1cf720f6940f4e4d29feeb06b9a4570f49445467d1ffcb22eb: Status 404 returned error can't find the container with id 8256741e8069fe1cf720f6940f4e4d29feeb06b9a4570f49445467d1ffcb22eb Nov 03 22:55:42.312408 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:42.312370 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" event={"ID":"2a92bfd0-105a-4b00-a171-bf0fadd6b412","Type":"ContainerStarted","Data":"8256741e8069fe1cf720f6940f4e4d29feeb06b9a4570f49445467d1ffcb22eb"} Nov 03 22:55:42.313878 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:42.313850 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" event={"ID":"2afd1042-9056-4440-92f1-d00ce5ec38ae","Type":"ContainerStarted","Data":"35d86986967b3f643a17418c7ee0861cf64ecdb883e8c60e94b4e1cef905d1b0"} Nov 03 22:55:42.314015 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:42.314000 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:42.336256 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:42.336208 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" podStartSLOduration=1.894173247 podStartE2EDuration="7.33619271s" totalImagesPullingTime="5.442019463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:42.335233179 +0000 UTC m=+244.112202367" watchObservedRunningTime="2026-11-03 22:55:42.33619271 +0000 UTC m=+244.113161898" Nov 03 22:55:45.327140 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:45.327103 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" event={"ID":"2a92bfd0-105a-4b00-a171-bf0fadd6b412","Type":"ContainerStarted","Data":"2bebdc979270e92fcfb06c4ee8e1d130f99b35fc4909020fc9d4985e8758809d"} Nov 03 22:55:45.327558 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:45.327223 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:45.345283 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:45.345234 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" podStartSLOduration=2.309419111 podStartE2EDuration="4.345222198s" totalImagesPullingTime="2.035803087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:45.343618835 +0000 UTC m=+247.120588025" watchObservedRunningTime="2026-11-03 22:55:45.345222198 +0000 UTC m=+247.122191386" Nov 03 22:55:48.887054 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:55:48.887014 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:55:50.414754 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.414714 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-rz2w9"] Nov 03 22:55:50.468637 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.468580 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-rz2w9"] Nov 03 22:55:50.468842 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.468727 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 22:55:50.473313 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.473282 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pvzt6\"" Nov 03 22:55:50.584974 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.584926 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lw74\" (UniqueName: \"kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74\") pod \"authorino-57f7f8659f-rz2w9\" (UID: \"544c608b-4e3e-4634-8f82-70dc6c178963\") " pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 22:55:50.685785 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.685684 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lw74\" (UniqueName: \"kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74\") pod \"authorino-57f7f8659f-rz2w9\" (UID: \"544c608b-4e3e-4634-8f82-70dc6c178963\") " pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 22:55:50.695107 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.695085 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lw74\" (UniqueName: \"kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74\") pod \"authorino-57f7f8659f-rz2w9\" (UID: \"544c608b-4e3e-4634-8f82-70dc6c178963\") " pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 22:55:50.804427 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:50.804380 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 22:55:51.098758 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.098621 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-rz2w9"] Nov 03 22:55:51.101514 ip-10-0-128-124 kubenswrapper[6394]: W1103 22:55:51.101482 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod544c608b_4e3e_4634_8f82_70dc6c178963.slice/crio-cf29022b2a6a35b9666f7900997c32062661b4e5a69b4bd594bbc94755d9ad27 WatchSource:0}: Error finding container cf29022b2a6a35b9666f7900997c32062661b4e5a69b4bd594bbc94755d9ad27: Status 404 returned error can't find the container with id cf29022b2a6a35b9666f7900997c32062661b4e5a69b4bd594bbc94755d9ad27 Nov 03 22:55:51.352212 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.352128 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" event={"ID":"544c608b-4e3e-4634-8f82-70dc6c178963","Type":"ContainerStarted","Data":"cf29022b2a6a35b9666f7900997c32062661b4e5a69b4bd594bbc94755d9ad27"} Nov 03 22:55:51.974048 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.974014 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk"] Nov 03 22:55:51.976832 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.976812 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:51.981882 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.981850 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Nov 03 22:55:51.982040 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.981931 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\"" Nov 03 22:55:51.982040 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.981940 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Nov 03 22:55:51.982040 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.981975 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-zrfgj\"" Nov 03 22:55:51.982040 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.981975 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\"" Nov 03 22:55:51.982198 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.982058 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\"" Nov 03 22:55:51.985297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:51.985272 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk"] Nov 03 22:55:52.098294 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.098259 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28167517-0c84-4cec-ab5a-604765b61b91-metrics-certs\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.098461 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.098314 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28167517-0c84-4cec-ab5a-604765b61b91-cert\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.098461 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.098419 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28167517-0c84-4cec-ab5a-604765b61b91-manager-config\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.098461 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.098452 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmgrq\" (UniqueName: \"kubernetes.io/projected/28167517-0c84-4cec-ab5a-604765b61b91-kube-api-access-bmgrq\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.199095 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.199060 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28167517-0c84-4cec-ab5a-604765b61b91-cert\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.199271 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.199113 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28167517-0c84-4cec-ab5a-604765b61b91-manager-config\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.199271 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.199144 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmgrq\" (UniqueName: \"kubernetes.io/projected/28167517-0c84-4cec-ab5a-604765b61b91-kube-api-access-bmgrq\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.199271 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.199186 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28167517-0c84-4cec-ab5a-604765b61b91-metrics-certs\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.199912 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.199883 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/28167517-0c84-4cec-ab5a-604765b61b91-manager-config\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.201763 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.201741 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28167517-0c84-4cec-ab5a-604765b61b91-metrics-certs\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.201856 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.201780 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28167517-0c84-4cec-ab5a-604765b61b91-cert\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.207309 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.207281 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmgrq\" (UniqueName: \"kubernetes.io/projected/28167517-0c84-4cec-ab5a-604765b61b91-kube-api-access-bmgrq\") pod \"jobset-controller-manager-7c646f4476-xp7tk\" (UID: \"28167517-0c84-4cec-ab5a-604765b61b91\") " pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.288883 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.288798 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:52.567727 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:52.567599 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk"] Nov 03 22:55:53.320180 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:53.320137 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fbm7v" Nov 03 22:55:53.367147 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:53.367111 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" event={"ID":"28167517-0c84-4cec-ab5a-604765b61b91","Type":"ContainerStarted","Data":"ad67882136a61c2f2cdb12c78d16a7ab0d8b89c657fcb1b235cbb1270e9f4a0f"} Nov 03 22:55:54.372745 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:54.372707 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" event={"ID":"544c608b-4e3e-4634-8f82-70dc6c178963","Type":"ContainerStarted","Data":"91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0"} Nov 03 22:55:54.396765 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:54.396713 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" podStartSLOduration=1.9780149919999999 podStartE2EDuration="4.396689446s" totalImagesPullingTime="2.418674454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:54.395612987 +0000 UTC m=+256.172582181" watchObservedRunningTime="2026-11-03 22:55:54.396689446 +0000 UTC m=+256.173658636" Nov 03 22:55:56.333922 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:56.333885 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-xgxbq" Nov 03 22:55:57.387391 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:57.387357 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" event={"ID":"28167517-0c84-4cec-ab5a-604765b61b91","Type":"ContainerStarted","Data":"99c7f78f6e42da5a049995432d13e7fdd89050288d4ba3e409b9333650fbd062"} Nov 03 22:55:57.387831 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:57.387482 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:55:57.403835 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:55:57.403787 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" podStartSLOduration=2.163697666 podStartE2EDuration="6.403772672s" totalImagesPullingTime="4.240075006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 22:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 22:55:57.402525584 +0000 UTC m=+259.179494774" watchObservedRunningTime="2026-11-03 22:55:57.403772672 +0000 UTC m=+259.180741861" Nov 03 22:56:08.396504 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:08.396466 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 22:56:18.887261 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:56:18.887167 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:56:46.121454 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.121417 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm"] Nov 03 22:56:46.122020 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.121631 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" podUID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" containerName="discovery" containerID="cri-o://1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e" gracePeriod=30 Nov 03 22:56:46.369570 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.369543 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:56:46.467182 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467082 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467182 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467168 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467198 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467216 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467259 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467310 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467415 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467340 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts\") pod \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\" (UID: \"aa15df87-6dec-4c0b-8bc1-4e713161cf3f\") " Nov 03 22:56:46.467796 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.467754 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 22:56:46.469795 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.469764 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:56:46.469934 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.469873 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:56:46.470088 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.470068 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "kube-api-access-cc2zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:56:46.470155 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.470133 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 22:56:46.470189 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.470176 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 22:56:46.470222 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.470182 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts" pod "aa15df87-6dec-4c0b-8bc1-4e713161cf3f" (UID: "aa15df87-6dec-4c0b-8bc1-4e713161cf3f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 22:56:46.568564 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568521 6394 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-local-certs\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.568564 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568558 6394 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-ca-configmap\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.568564 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568572 6394 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-cacerts\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.568825 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568581 6394 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-token\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.568825 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568590 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2zc\" (UniqueName: \"kubernetes.io/projected/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-kube-api-access-cc2zc\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.568825 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568598 6394 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-kubeconfig\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.568825 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.568608 6394 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aa15df87-6dec-4c0b-8bc1-4e713161cf3f-istio-csr-dns-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 22:56:46.586297 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.586266 6394 generic.go:356] "Generic (PLEG): container finished" podID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" containerID="1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e" exitCode=0 Nov 03 22:56:46.586441 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.586313 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" Nov 03 22:56:46.586441 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.586359 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" event={"ID":"aa15df87-6dec-4c0b-8bc1-4e713161cf3f","Type":"ContainerDied","Data":"1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e"} Nov 03 22:56:46.586441 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.586413 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm" event={"ID":"aa15df87-6dec-4c0b-8bc1-4e713161cf3f","Type":"ContainerDied","Data":"e8c158b5b0f35732abfc422326d75471339bd247f78249f78a1c9eb0ced69ef9"} Nov 03 22:56:46.586441 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.586439 6394 scope.go:122] "RemoveContainer" containerID="1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e" Nov 03 22:56:46.601397 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.601376 6394 scope.go:122] "RemoveContainer" containerID="1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e" Nov 03 22:56:46.601756 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:56:46.601732 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e\": container with ID starting with 1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e not found: ID does not exist" containerID="1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e" Nov 03 22:56:46.601822 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.601767 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e"} err="failed to get container status \"1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e\": rpc error: code = NotFound desc = could not find container \"1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e\": container with ID starting with 1e08951906fec4005d01d4fa933939854ef85d30197cde973ba29d31d22dde0e not found: ID does not exist" Nov 03 22:56:46.613886 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.613863 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm"] Nov 03 22:56:46.617807 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:46.617785 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-mmgdm"] Nov 03 22:56:48.342758 ip-10-0-128-124 kubenswrapper[6394]: I1103 22:56:48.342724 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" path="/var/lib/kubelet/pods/aa15df87-6dec-4c0b-8bc1-4e713161cf3f/volumes" Nov 03 22:56:48.887157 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:56:48.887122 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:57:18.887275 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:57:18.887236 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:57:48.887248 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:57:48.887167 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:58:18.887108 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:58:18.887065 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:58:48.887488 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:58:48.887443 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:59:18.887302 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:59:18.887216 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 22:59:48.887530 ip-10-0-128-124 kubenswrapper[6394]: E1103 22:59:48.887494 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:00:18.887001 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:00:18.886959 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:00:48.886874 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:00:48.886789 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:01:18.887410 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:01:18.887369 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:01:48.886963 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:01:48.886927 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:02:18.887305 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:02:18.887219 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:02:48.887156 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:02:48.887118 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:03:18.887634 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:03:18.887590 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:03:48.887488 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:03:48.887402 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:04:18.887593 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:04:18.887557 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:04:48.886737 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:04:48.886699 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:05:18.887606 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:05:18.887526 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:05:48.886825 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:05:48.886783 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:06:18.887681 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:06:18.887620 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:06:25.899674 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.899621 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cps9r"] Nov 03 23:06:25.900056 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.900017 6394 cpu_manager.go:414] "containerMap: removing container" podUID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" containerName="discovery" Nov 03 23:06:25.900056 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.900030 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" containerName="discovery" Nov 03 23:06:25.900126 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.900093 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa15df87-6dec-4c0b-8bc1-4e713161cf3f" containerName="discovery" Nov 03 23:06:25.903166 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.903146 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:06:25.910546 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.910524 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cps9r"] Nov 03 23:06:25.934891 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.934859 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:25.938126 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.938109 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:25.941609 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.941591 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 03 23:06:25.942043 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.942029 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6br6k\"" Nov 03 23:06:25.946086 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:25.946064 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:26.022967 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.022928 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9d2\" (UniqueName: \"kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2\") pod \"authorino-56c6c9ddd5-cps9r\" (UID: \"13f2ab9c-f199-4542-bfe7-95e712315f52\") " pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:06:26.023145 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.022991 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file\") pod \"limitador-limitador-74dfcfb894-dnwfl\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.023145 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.023110 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmt2\" (UniqueName: \"kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2\") pod \"limitador-limitador-74dfcfb894-dnwfl\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.034209 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.034182 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:26.124230 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.124185 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9d2\" (UniqueName: \"kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2\") pod \"authorino-56c6c9ddd5-cps9r\" (UID: \"13f2ab9c-f199-4542-bfe7-95e712315f52\") " pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:06:26.124427 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.124246 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file\") pod \"limitador-limitador-74dfcfb894-dnwfl\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.124427 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.124279 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmt2\" (UniqueName: \"kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2\") pod \"limitador-limitador-74dfcfb894-dnwfl\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.125055 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.125035 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file\") pod \"limitador-limitador-74dfcfb894-dnwfl\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.133948 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.133916 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmt2\" (UniqueName: \"kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2\") pod \"limitador-limitador-74dfcfb894-dnwfl\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.134070 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.133918 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9d2\" (UniqueName: \"kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2\") pod \"authorino-56c6c9ddd5-cps9r\" (UID: \"13f2ab9c-f199-4542-bfe7-95e712315f52\") " pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:06:26.215866 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.215778 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:06:26.253287 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.253250 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:26.268097 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.266330 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:06:26.273961 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.273335 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.280705 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.279751 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:06:26.313461 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.313431 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:06:26.427141 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.427105 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b70baa2b-2aa3-4860-9ca7-a174a932839f-config-file\") pod \"limitador-limitador-7c9b87d574-vf2qv\" (UID: \"b70baa2b-2aa3-4860-9ca7-a174a932839f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.427345 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.427238 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkcb9\" (UniqueName: \"kubernetes.io/projected/b70baa2b-2aa3-4860-9ca7-a174a932839f-kube-api-access-rkcb9\") pod \"limitador-limitador-7c9b87d574-vf2qv\" (UID: \"b70baa2b-2aa3-4860-9ca7-a174a932839f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.495591 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.495466 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cps9r"] Nov 03 23:06:26.498413 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:06:26.498385 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13f2ab9c_f199_4542_bfe7_95e712315f52.slice/crio-f49383c6521b7e57dbc30c5dd5cda498fcf5a7bc1027ba9298955b50b79eefc4 WatchSource:0}: Error finding container f49383c6521b7e57dbc30c5dd5cda498fcf5a7bc1027ba9298955b50b79eefc4: Status 404 returned error can't find the container with id f49383c6521b7e57dbc30c5dd5cda498fcf5a7bc1027ba9298955b50b79eefc4 Nov 03 23:06:26.499802 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.499782 6394 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 23:06:26.528091 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.528053 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b70baa2b-2aa3-4860-9ca7-a174a932839f-config-file\") pod \"limitador-limitador-7c9b87d574-vf2qv\" (UID: \"b70baa2b-2aa3-4860-9ca7-a174a932839f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.528292 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.528119 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkcb9\" (UniqueName: \"kubernetes.io/projected/b70baa2b-2aa3-4860-9ca7-a174a932839f-kube-api-access-rkcb9\") pod \"limitador-limitador-7c9b87d574-vf2qv\" (UID: \"b70baa2b-2aa3-4860-9ca7-a174a932839f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.528772 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.528749 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b70baa2b-2aa3-4860-9ca7-a174a932839f-config-file\") pod \"limitador-limitador-7c9b87d574-vf2qv\" (UID: \"b70baa2b-2aa3-4860-9ca7-a174a932839f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.536840 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.536811 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkcb9\" (UniqueName: \"kubernetes.io/projected/b70baa2b-2aa3-4860-9ca7-a174a932839f-kube-api-access-rkcb9\") pod \"limitador-limitador-7c9b87d574-vf2qv\" (UID: \"b70baa2b-2aa3-4860-9ca7-a174a932839f\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.554355 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.554325 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:26.557537 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:06:26.557511 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720c7b0d_cf39_431f_b0cf_f31bb721ec45.slice/crio-16097ede1b052463a7ee5a0178c1a98b6e605907f30b3cb0fdb60493cef5f38b WatchSource:0}: Error finding container 16097ede1b052463a7ee5a0178c1a98b6e605907f30b3cb0fdb60493cef5f38b: Status 404 returned error can't find the container with id 16097ede1b052463a7ee5a0178c1a98b6e605907f30b3cb0fdb60493cef5f38b Nov 03 23:06:26.595492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.595451 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:26.869257 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.869229 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:06:26.871865 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:06:26.871834 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70baa2b_2aa3_4860_9ca7_a174a932839f.slice/crio-a40c7e009833fbb4c0d59050e8e5e331097e644439aecef3065224c554c1924e WatchSource:0}: Error finding container a40c7e009833fbb4c0d59050e8e5e331097e644439aecef3065224c554c1924e: Status 404 returned error can't find the container with id a40c7e009833fbb4c0d59050e8e5e331097e644439aecef3065224c554c1924e Nov 03 23:06:26.942382 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.942347 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" event={"ID":"b70baa2b-2aa3-4860-9ca7-a174a932839f","Type":"ContainerStarted","Data":"a40c7e009833fbb4c0d59050e8e5e331097e644439aecef3065224c554c1924e"} Nov 03 23:06:26.943566 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.943534 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" event={"ID":"720c7b0d-cf39-431f-b0cf-f31bb721ec45","Type":"ContainerStarted","Data":"16097ede1b052463a7ee5a0178c1a98b6e605907f30b3cb0fdb60493cef5f38b"} Nov 03 23:06:26.944646 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:26.944619 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" event={"ID":"13f2ab9c-f199-4542-bfe7-95e712315f52","Type":"ContainerStarted","Data":"f49383c6521b7e57dbc30c5dd5cda498fcf5a7bc1027ba9298955b50b79eefc4"} Nov 03 23:06:27.952398 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:27.952339 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" event={"ID":"13f2ab9c-f199-4542-bfe7-95e712315f52","Type":"ContainerStarted","Data":"737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df"} Nov 03 23:06:27.968102 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:27.968050 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" podStartSLOduration=2.02405374 podStartE2EDuration="2.968034502s" totalImagesPullingTime="943.980762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:06:27.966450459 +0000 UTC m=+889.743419650" watchObservedRunningTime="2026-11-03 23:06:27.968034502 +0000 UTC m=+889.745003691" Nov 03 23:06:27.989461 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:27.989419 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-rz2w9"] Nov 03 23:06:27.989676 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:27.989633 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" podUID="544c608b-4e3e-4634-8f82-70dc6c178963" containerName="authorino" containerID="cri-o://91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0" gracePeriod=30 Nov 03 23:06:28.254952 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.254926 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 23:06:28.345047 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.345018 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74\" (UniqueName: \"kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74\") pod \"544c608b-4e3e-4634-8f82-70dc6c178963\" (UID: \"544c608b-4e3e-4634-8f82-70dc6c178963\") " Nov 03 23:06:28.347378 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.347348 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74" pod "544c608b-4e3e-4634-8f82-70dc6c178963" (UID: "544c608b-4e3e-4634-8f82-70dc6c178963"). InnerVolumeSpecName "kube-api-access-7lw74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:06:28.445594 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.445559 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lw74\" (UniqueName: \"kubernetes.io/projected/544c608b-4e3e-4634-8f82-70dc6c178963-kube-api-access-7lw74\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:06:28.958144 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.958111 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" event={"ID":"720c7b0d-cf39-431f-b0cf-f31bb721ec45","Type":"ContainerStarted","Data":"208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9"} Nov 03 23:06:28.958587 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.958275 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:28.959696 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.959649 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" event={"ID":"b70baa2b-2aa3-4860-9ca7-a174a932839f","Type":"ContainerStarted","Data":"b8458cd26793e57a58525639a1e0e58adaa3dfb23e92be37927e342d8dca60b1"} Nov 03 23:06:28.959801 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.959718 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:28.960792 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.960769 6394 generic.go:356] "Generic (PLEG): container finished" podID="544c608b-4e3e-4634-8f82-70dc6c178963" containerID="91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0" exitCode=0 Nov 03 23:06:28.960881 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.960803 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" Nov 03 23:06:28.960881 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.960856 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" event={"ID":"544c608b-4e3e-4634-8f82-70dc6c178963","Type":"ContainerDied","Data":"91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0"} Nov 03 23:06:28.960946 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.960885 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-rz2w9" event={"ID":"544c608b-4e3e-4634-8f82-70dc6c178963","Type":"ContainerDied","Data":"cf29022b2a6a35b9666f7900997c32062661b4e5a69b4bd594bbc94755d9ad27"} Nov 03 23:06:28.960946 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.960905 6394 scope.go:122] "RemoveContainer" containerID="91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0" Nov 03 23:06:28.969589 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.969570 6394 scope.go:122] "RemoveContainer" containerID="91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0" Nov 03 23:06:28.969905 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:06:28.969885 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0\": container with ID starting with 91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0 not found: ID does not exist" containerID="91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0" Nov 03 23:06:28.969978 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.969919 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0"} err="failed to get container status \"91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0\": rpc error: code = NotFound desc = could not find container \"91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0\": container with ID starting with 91497730c1c22a9dc5caac759d91413631588813c4d532d32b485b4ef8485da0 not found: ID does not exist" Nov 03 23:06:28.975399 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.975355 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" podStartSLOduration=2.368309673 podStartE2EDuration="3.975341509s" totalImagesPullingTime="1.607031836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:06:28.974652891 +0000 UTC m=+890.751622080" watchObservedRunningTime="2026-11-03 23:06:28.975341509 +0000 UTC m=+890.752310694" Nov 03 23:06:28.991292 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:28.991218 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" podStartSLOduration=1.597076183 podStartE2EDuration="2.991203061s" totalImagesPullingTime="1.394126878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:06:28.989943998 +0000 UTC m=+890.766913188" watchObservedRunningTime="2026-11-03 23:06:28.991203061 +0000 UTC m=+890.768172275" Nov 03 23:06:29.002378 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:29.002349 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-rz2w9"] Nov 03 23:06:29.008533 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:29.008508 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-rz2w9"] Nov 03 23:06:30.342566 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:30.342537 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="544c608b-4e3e-4634-8f82-70dc6c178963" path="/var/lib/kubelet/pods/544c608b-4e3e-4634-8f82-70dc6c178963/volumes" Nov 03 23:06:39.967265 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:39.967231 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-vf2qv" Nov 03 23:06:39.967682 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:39.967307 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:40.031711 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.031679 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:40.031885 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.031844 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" podUID="720c7b0d-cf39-431f-b0cf-f31bb721ec45" containerName="limitador" containerID="cri-o://208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9" gracePeriod=30 Nov 03 23:06:40.580181 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.580151 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:40.755034 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.754936 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2\" (UniqueName: \"kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2\") pod \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " Nov 03 23:06:40.755034 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.755031 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file\" (UniqueName: \"kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file\") pod \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\" (UID: \"720c7b0d-cf39-431f-b0cf-f31bb721ec45\") " Nov 03 23:06:40.755389 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.755365 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file" pod "720c7b0d-cf39-431f-b0cf-f31bb721ec45" (UID: "720c7b0d-cf39-431f-b0cf-f31bb721ec45"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:06:40.757251 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.757230 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2" pod "720c7b0d-cf39-431f-b0cf-f31bb721ec45" (UID: "720c7b0d-cf39-431f-b0cf-f31bb721ec45"). InnerVolumeSpecName "kube-api-access-zdmt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:06:40.856377 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.856330 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdmt2\" (UniqueName: \"kubernetes.io/projected/720c7b0d-cf39-431f-b0cf-f31bb721ec45-kube-api-access-zdmt2\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:06:40.856377 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:40.856369 6394 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/720c7b0d-cf39-431f-b0cf-f31bb721ec45-config-file\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:06:41.013801 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.013712 6394 generic.go:356] "Generic (PLEG): container finished" podID="720c7b0d-cf39-431f-b0cf-f31bb721ec45" containerID="208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9" exitCode=0 Nov 03 23:06:41.013801 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.013761 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" Nov 03 23:06:41.014243 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.013802 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" event={"ID":"720c7b0d-cf39-431f-b0cf-f31bb721ec45","Type":"ContainerDied","Data":"208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9"} Nov 03 23:06:41.014243 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.013852 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-dnwfl" event={"ID":"720c7b0d-cf39-431f-b0cf-f31bb721ec45","Type":"ContainerDied","Data":"16097ede1b052463a7ee5a0178c1a98b6e605907f30b3cb0fdb60493cef5f38b"} Nov 03 23:06:41.014243 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.013876 6394 scope.go:122] "RemoveContainer" containerID="208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9" Nov 03 23:06:41.022374 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.022356 6394 scope.go:122] "RemoveContainer" containerID="208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9" Nov 03 23:06:41.022694 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:06:41.022647 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9\": container with ID starting with 208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9 not found: ID does not exist" containerID="208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9" Nov 03 23:06:41.022738 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.022705 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9"} err="failed to get container status \"208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9\": rpc error: code = NotFound desc = could not find container \"208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9\": container with ID starting with 208cc87f5602a36b9483619a91832006e1fc9ff42936b358e8aeb3edba3aa9f9 not found: ID does not exist" Nov 03 23:06:41.035542 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.035518 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:41.042484 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:41.042463 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-dnwfl"] Nov 03 23:06:42.342936 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:42.342905 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="720c7b0d-cf39-431f-b0cf-f31bb721ec45" path="/var/lib/kubelet/pods/720c7b0d-cf39-431f-b0cf-f31bb721ec45/volumes" Nov 03 23:06:45.883848 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.883816 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr"] Nov 03 23:06:45.884233 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.884150 6394 cpu_manager.go:414] "containerMap: removing container" podUID="720c7b0d-cf39-431f-b0cf-f31bb721ec45" containerName="limitador" Nov 03 23:06:45.884233 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.884161 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="720c7b0d-cf39-431f-b0cf-f31bb721ec45" containerName="limitador" Nov 03 23:06:45.884233 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.884173 6394 cpu_manager.go:414] "containerMap: removing container" podUID="544c608b-4e3e-4634-8f82-70dc6c178963" containerName="authorino" Nov 03 23:06:45.884233 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.884178 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="544c608b-4e3e-4634-8f82-70dc6c178963" containerName="authorino" Nov 03 23:06:45.884233 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.884231 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="720c7b0d-cf39-431f-b0cf-f31bb721ec45" containerName="limitador" Nov 03 23:06:45.884384 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.884239 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="544c608b-4e3e-4634-8f82-70dc6c178963" containerName="authorino" Nov 03 23:06:45.888510 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.888494 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:45.893855 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.893830 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr"] Nov 03 23:06:45.894316 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.894297 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 23:06:45.894442 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.894373 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 23:06:45.980863 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.980833 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Nov 03 23:06:45.981048 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.980900 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-fhhtg\"" Nov 03 23:06:45.996242 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.996207 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8deafbb8-884d-432d-94df-6a4be72d6492-data\") pod \"postgres-7cdbf6dc44-qkckr\" (UID: \"8deafbb8-884d-432d-94df-6a4be72d6492\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:45.996410 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:45.996285 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sckss\" (UniqueName: \"kubernetes.io/projected/8deafbb8-884d-432d-94df-6a4be72d6492-kube-api-access-sckss\") pod \"postgres-7cdbf6dc44-qkckr\" (UID: \"8deafbb8-884d-432d-94df-6a4be72d6492\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:46.097028 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:46.096989 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8deafbb8-884d-432d-94df-6a4be72d6492-data\") pod \"postgres-7cdbf6dc44-qkckr\" (UID: \"8deafbb8-884d-432d-94df-6a4be72d6492\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:46.097209 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:46.097052 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sckss\" (UniqueName: \"kubernetes.io/projected/8deafbb8-884d-432d-94df-6a4be72d6492-kube-api-access-sckss\") pod \"postgres-7cdbf6dc44-qkckr\" (UID: \"8deafbb8-884d-432d-94df-6a4be72d6492\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:46.097376 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:46.097357 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8deafbb8-884d-432d-94df-6a4be72d6492-data\") pod \"postgres-7cdbf6dc44-qkckr\" (UID: \"8deafbb8-884d-432d-94df-6a4be72d6492\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:46.106691 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:46.106652 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sckss\" (UniqueName: \"kubernetes.io/projected/8deafbb8-884d-432d-94df-6a4be72d6492-kube-api-access-sckss\") pod \"postgres-7cdbf6dc44-qkckr\" (UID: \"8deafbb8-884d-432d-94df-6a4be72d6492\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:46.201930 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:46.201829 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:46.473685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:46.473644 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr"] Nov 03 23:06:46.476192 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:06:46.476162 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8deafbb8_884d_432d_94df_6a4be72d6492.slice/crio-8f85a045e7f4700595389b8fae6b0dcc98af7169a2d7608a5e78664669605076 WatchSource:0}: Error finding container 8f85a045e7f4700595389b8fae6b0dcc98af7169a2d7608a5e78664669605076: Status 404 returned error can't find the container with id 8f85a045e7f4700595389b8fae6b0dcc98af7169a2d7608a5e78664669605076 Nov 03 23:06:47.040139 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:47.040097 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" event={"ID":"8deafbb8-884d-432d-94df-6a4be72d6492","Type":"ContainerStarted","Data":"8f85a045e7f4700595389b8fae6b0dcc98af7169a2d7608a5e78664669605076"} Nov 03 23:06:48.890561 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:06:48.890471 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:06:54.073621 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:54.073589 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" event={"ID":"8deafbb8-884d-432d-94df-6a4be72d6492","Type":"ContainerStarted","Data":"c3bf5fa931c8559eca1259bc8bf87ef7596a9160e31a1bd59f0ed46ec0a69a29"} Nov 03 23:06:54.074046 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:54.073772 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:06:54.092370 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:06:54.092300 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" podStartSLOduration=2.222223937 podStartE2EDuration="9.092285944s" totalImagesPullingTime="6.870062007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:06:54.091479365 +0000 UTC m=+915.868448555" watchObservedRunningTime="2026-11-03 23:06:54.092285944 +0000 UTC m=+915.869255129" Nov 03 23:07:00.108682 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:00.108630 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-qkckr" Nov 03 23:07:02.052780 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.052746 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb"] Nov 03 23:07:02.059796 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.059767 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.065209 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.065178 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 23:07:02.065379 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.065234 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 23:07:02.065379 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.065347 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"84daa8c4ed0405edc11b3a6589e0458f830ec2-28b1df78-dockercfg-kzzjz\"" Nov 03 23:07:02.066632 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.066605 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb"] Nov 03 23:07:02.126826 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.126788 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7gls\" (UniqueName: \"kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.127041 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.126841 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.127041 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.126941 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.227863 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.227828 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.228048 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.227894 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7gls\" (UniqueName: \"kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.228048 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.227934 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.228310 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.228285 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.228380 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.228294 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.236442 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.236406 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7gls\" (UniqueName: \"kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.381538 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.381497 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:02.662541 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:02.662338 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb"] Nov 03 23:07:02.665470 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:07:02.665429 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48fa79e_f0a8_47d9_b8d4_7120801bbd7c.slice/crio-88ab69a4b5fa5eed16f2d836de9aaf2db4751ce7277885cdf19e5ae47969539b WatchSource:0}: Error finding container 88ab69a4b5fa5eed16f2d836de9aaf2db4751ce7277885cdf19e5ae47969539b: Status 404 returned error can't find the container with id 88ab69a4b5fa5eed16f2d836de9aaf2db4751ce7277885cdf19e5ae47969539b Nov 03 23:07:03.112551 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:03.112511 6394 generic.go:356] "Generic (PLEG): container finished" podID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerID="d1d45b6257b83bc2f0886ace39ae4e07ba9850d7485e4be30aaa7dd37486bec7" exitCode=0 Nov 03 23:07:03.112963 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:03.112603 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" event={"ID":"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c","Type":"ContainerDied","Data":"d1d45b6257b83bc2f0886ace39ae4e07ba9850d7485e4be30aaa7dd37486bec7"} Nov 03 23:07:03.112963 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:03.112644 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" event={"ID":"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c","Type":"ContainerStarted","Data":"88ab69a4b5fa5eed16f2d836de9aaf2db4751ce7277885cdf19e5ae47969539b"} Nov 03 23:07:04.118645 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:04.118613 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" event={"ID":"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c","Type":"ContainerStarted","Data":"aca3897d29680b8a5ed32b3f95426d5a29d64da991907a3790926952832c7b60"} Nov 03 23:07:05.124583 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:05.124550 6394 generic.go:356] "Generic (PLEG): container finished" podID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerID="aca3897d29680b8a5ed32b3f95426d5a29d64da991907a3790926952832c7b60" exitCode=0 Nov 03 23:07:05.125022 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:05.124631 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" event={"ID":"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c","Type":"ContainerDied","Data":"aca3897d29680b8a5ed32b3f95426d5a29d64da991907a3790926952832c7b60"} Nov 03 23:07:06.131067 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:06.131024 6394 generic.go:356] "Generic (PLEG): container finished" podID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerID="edf626364803cdf945a6fd33037927c0ede04ed8bb2bf5d175a6b6f475cfee30" exitCode=0 Nov 03 23:07:06.131511 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:06.131104 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" event={"ID":"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c","Type":"ContainerDied","Data":"edf626364803cdf945a6fd33037927c0ede04ed8bb2bf5d175a6b6f475cfee30"} Nov 03 23:07:07.254361 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.254338 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:07.374942 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.374905 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle\") pod \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " Nov 03 23:07:07.375115 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.375001 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls\" (UniqueName: \"kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls\") pod \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " Nov 03 23:07:07.375115 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.375026 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util\") pod \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\" (UID: \"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c\") " Nov 03 23:07:07.375487 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.375458 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle" pod "c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" (UID: "c48fa79e-f0a8-47d9-b8d4-7120801bbd7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:07:07.377366 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.377346 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls" pod "c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" (UID: "c48fa79e-f0a8-47d9-b8d4-7120801bbd7c"). InnerVolumeSpecName "kube-api-access-n7gls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:07:07.380487 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.380462 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util" pod "c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" (UID: "c48fa79e-f0a8-47d9-b8d4-7120801bbd7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:07:07.476014 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.475936 6394 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-bundle\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:07:07.476014 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.475964 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7gls\" (UniqueName: \"kubernetes.io/projected/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-kube-api-access-n7gls\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:07:07.476014 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:07.475975 6394 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48fa79e-f0a8-47d9-b8d4-7120801bbd7c-util\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:07:08.140056 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:08.140026 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" Nov 03 23:07:08.140056 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:08.140038 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08e9ppjb" event={"ID":"c48fa79e-f0a8-47d9-b8d4-7120801bbd7c","Type":"ContainerDied","Data":"88ab69a4b5fa5eed16f2d836de9aaf2db4751ce7277885cdf19e5ae47969539b"} Nov 03 23:07:08.140265 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:08.140087 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88ab69a4b5fa5eed16f2d836de9aaf2db4751ce7277885cdf19e5ae47969539b" Nov 03 23:07:15.609501 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609468 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dfdcb6669-wqvrs"] Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609808 6394 cpu_manager.go:414] "containerMap: removing container" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="extract" Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609820 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="extract" Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609831 6394 cpu_manager.go:414] "containerMap: removing container" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="pull" Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609836 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="pull" Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609862 6394 cpu_manager.go:414] "containerMap: removing container" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="util" Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609867 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="util" Nov 03 23:07:15.609934 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.609922 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="c48fa79e-f0a8-47d9-b8d4-7120801bbd7c" containerName="extract" Nov 03 23:07:15.612652 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.612634 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" Nov 03 23:07:15.616412 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.616384 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-fr5p7\"" Nov 03 23:07:15.617918 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.617891 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Nov 03 23:07:15.618040 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.617964 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Nov 03 23:07:15.622687 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.622634 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dfdcb6669-wqvrs"] Nov 03 23:07:15.742268 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.742224 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clgx\" (UniqueName: \"kubernetes.io/projected/4562ab7d-33a5-4125-9292-db1cfd626f7d-kube-api-access-2clgx\") pod \"keycloak-operator-dfdcb6669-wqvrs\" (UID: \"4562ab7d-33a5-4125-9292-db1cfd626f7d\") " pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" Nov 03 23:07:15.843572 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.843537 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clgx\" (UniqueName: \"kubernetes.io/projected/4562ab7d-33a5-4125-9292-db1cfd626f7d-kube-api-access-2clgx\") pod \"keycloak-operator-dfdcb6669-wqvrs\" (UID: \"4562ab7d-33a5-4125-9292-db1cfd626f7d\") " pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" Nov 03 23:07:15.853441 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.853399 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clgx\" (UniqueName: \"kubernetes.io/projected/4562ab7d-33a5-4125-9292-db1cfd626f7d-kube-api-access-2clgx\") pod \"keycloak-operator-dfdcb6669-wqvrs\" (UID: \"4562ab7d-33a5-4125-9292-db1cfd626f7d\") " pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" Nov 03 23:07:15.934030 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:15.933926 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" Nov 03 23:07:16.208296 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:16.208219 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dfdcb6669-wqvrs"] Nov 03 23:07:16.211478 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:07:16.211450 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4562ab7d_33a5_4125_9292_db1cfd626f7d.slice/crio-8b0a593b912283164b4b654aa65659a7faebce85bd0c8ff17e77aadbf5db8412 WatchSource:0}: Error finding container 8b0a593b912283164b4b654aa65659a7faebce85bd0c8ff17e77aadbf5db8412: Status 404 returned error can't find the container with id 8b0a593b912283164b4b654aa65659a7faebce85bd0c8ff17e77aadbf5db8412 Nov 03 23:07:17.180948 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:17.180829 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" event={"ID":"4562ab7d-33a5-4125-9292-db1cfd626f7d","Type":"ContainerStarted","Data":"8b0a593b912283164b4b654aa65659a7faebce85bd0c8ff17e77aadbf5db8412"} Nov 03 23:07:18.889170 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:07:18.889125 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:07:21.200497 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:21.200462 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" event={"ID":"4562ab7d-33a5-4125-9292-db1cfd626f7d","Type":"ContainerStarted","Data":"7a32adc8d6948df30ff239af2b17dc8c24f71f91dd783e28aa94c979ba3ef976"} Nov 03 23:07:21.218733 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:21.218582 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dfdcb6669-wqvrs" podStartSLOduration=1.463191173 podStartE2EDuration="6.21856386s" totalImagesPullingTime="4.755372687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:07:21.217500983 +0000 UTC m=+942.994470173" watchObservedRunningTime="2026-11-03 23:07:21.21856386 +0000 UTC m=+942.995533052" Nov 03 23:07:30.577096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.577063 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:07:30.580636 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.580617 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:30.589436 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.589414 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ggnqw\"" Nov 03 23:07:30.589436 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.589417 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Nov 03 23:07:30.590396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.590378 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:07:30.678383 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.678334 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc5b5\" (UniqueName: \"kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5\") pod \"maas-keycloak-0\" (UID: \"f6667767-763f-4fc1-b116-f9e5f4d12d26\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:30.779644 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.779597 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc5b5\" (UniqueName: \"kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5\") pod \"maas-keycloak-0\" (UID: \"f6667767-763f-4fc1-b116-f9e5f4d12d26\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:30.787986 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.787959 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc5b5\" (UniqueName: \"kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5\") pod \"maas-keycloak-0\" (UID: \"f6667767-763f-4fc1-b116-f9e5f4d12d26\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:30.892327 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:30.892225 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:31.167432 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:31.167319 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:07:31.170092 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:07:31.170066 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6667767_763f_4fc1_b116_f9e5f4d12d26.slice/crio-a9697593a12b34d89636894ff9ef658a9806444d5241ba378f08e0f3ea139a13 WatchSource:0}: Error finding container a9697593a12b34d89636894ff9ef658a9806444d5241ba378f08e0f3ea139a13: Status 404 returned error can't find the container with id a9697593a12b34d89636894ff9ef658a9806444d5241ba378f08e0f3ea139a13 Nov 03 23:07:31.247722 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:31.247684 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6667767-763f-4fc1-b116-f9e5f4d12d26","Type":"ContainerStarted","Data":"a9697593a12b34d89636894ff9ef658a9806444d5241ba378f08e0f3ea139a13"} Nov 03 23:07:36.275727 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:36.275695 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6667767-763f-4fc1-b116-f9e5f4d12d26","Type":"ContainerStarted","Data":"7d5c2000d91569191eace35b0c4fe2c1573229500a8cd79f19ab79ccc1d9a2c5"} Nov 03 23:07:36.311113 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:36.311046 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.373643533 podStartE2EDuration="6.311027155s" totalImagesPullingTime="4.937383622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:07:36.30845568 +0000 UTC m=+958.085424868" watchObservedRunningTime="2026-11-03 23:07:36.311027155 +0000 UTC m=+958.087996344" Nov 03 23:07:36.892606 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:36.892567 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:36.894363 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:36.894330 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:37.892810 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:37.892756 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:38.892951 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:38.892899 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:39.893008 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:39.892953 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:40.892888 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:40.892837 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:40.896819 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:40.896781 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:41.893378 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:41.893316 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:42.894540 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:42.894095 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:43.893151 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:43.893100 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:44.893284 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:44.893232 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:45.895185 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:45.895140 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:46.893171 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:46.893125 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:47.892806 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:47.892755 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:48.893290 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:48.893240 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:48.896653 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:07:48.896613 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:07:49.893755 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:49.893710 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:50.892791 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:50.892734 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused" Nov 03 23:07:51.990730 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:51.990686 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Nov 03 23:07:52.007909 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:07:52.007860 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 23:08:01.997091 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:01.997052 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Nov 03 23:08:18.887123 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:08:18.887041 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:08:47.409726 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:47.409644 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:08:48.887252 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:08:48.887218 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:08:58.231961 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.231924 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dd76875b5-jghnb"] Nov 03 23:08:58.235282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.235259 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.241384 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.241358 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-jghnb"] Nov 03 23:08:58.243316 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.243294 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 03 23:08:58.275622 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.275588 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-jghnb"] Nov 03 23:08:58.275845 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:08:58.275824 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hd4v5 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6dd76875b5-jghnb" podUID="6f767638-5e6c-4baa-b6bc-6c3babe5980e" Nov 03 23:08:58.276694 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.276672 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert\") pod \"authorino-6dd76875b5-jghnb\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.276801 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.276788 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd4v5\" (UniqueName: \"kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5\") pod \"authorino-6dd76875b5-jghnb\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.296181 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.296149 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ql6v4"] Nov 03 23:08:58.299553 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.299528 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.307011 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.306984 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ql6v4"] Nov 03 23:08:58.377838 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.377799 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert\") pod \"authorino-6dd76875b5-jghnb\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.378036 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.377866 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert\") pod \"authorino-6889cbd8c4-ql6v4\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.378036 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.377926 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvh2\" (UniqueName: \"kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2\") pod \"authorino-6889cbd8c4-ql6v4\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.378036 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.378011 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd4v5\" (UniqueName: \"kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5\") pod \"authorino-6dd76875b5-jghnb\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.380471 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.380442 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert\") pod \"authorino-6dd76875b5-jghnb\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.385845 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.385822 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd4v5\" (UniqueName: \"kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5\") pod \"authorino-6dd76875b5-jghnb\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.479039 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.479005 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert\") pod \"authorino-6889cbd8c4-ql6v4\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.479039 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.479045 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvh2\" (UniqueName: \"kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2\") pod \"authorino-6889cbd8c4-ql6v4\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.481654 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.481619 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert\") pod \"authorino-6889cbd8c4-ql6v4\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.489561 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.489500 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvh2\" (UniqueName: \"kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2\") pod \"authorino-6889cbd8c4-ql6v4\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.612034 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.611995 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:08:58.630161 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.630132 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ql6v4"] Nov 03 23:08:58.653310 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.653276 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64545899bb-nsg72"] Nov 03 23:08:58.656912 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.656889 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.667014 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.666957 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64545899bb-nsg72"] Nov 03 23:08:58.676397 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.676367 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.687961 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.687936 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:58.781941 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.781853 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5\" (UniqueName: \"kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5\") pod \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " Nov 03 23:08:58.782125 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.781944 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert\" (UniqueName: \"kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert\") pod \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\" (UID: \"6f767638-5e6c-4baa-b6bc-6c3babe5980e\") " Nov 03 23:08:58.782125 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.782056 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs8jf\" (UniqueName: \"kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf\") pod \"authorino-64545899bb-nsg72\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.782125 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.782080 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert\") pod \"authorino-64545899bb-nsg72\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.784113 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.784087 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5" pod "6f767638-5e6c-4baa-b6bc-6c3babe5980e" (UID: "6f767638-5e6c-4baa-b6bc-6c3babe5980e"). InnerVolumeSpecName "kube-api-access-hd4v5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:08:58.784113 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.784101 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert" pod "6f767638-5e6c-4baa-b6bc-6c3babe5980e" (UID: "6f767638-5e6c-4baa-b6bc-6c3babe5980e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:08:58.883201 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.883162 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8jf\" (UniqueName: \"kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf\") pod \"authorino-64545899bb-nsg72\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.883395 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.883218 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert\") pod \"authorino-64545899bb-nsg72\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.883395 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.883347 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd4v5\" (UniqueName: \"kubernetes.io/projected/6f767638-5e6c-4baa-b6bc-6c3babe5980e-kube-api-access-hd4v5\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:08:58.883395 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.883363 6394 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f767638-5e6c-4baa-b6bc-6c3babe5980e-tls-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:08:58.884303 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.884285 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ql6v4"] Nov 03 23:08:58.885922 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.885900 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert\") pod \"authorino-64545899bb-nsg72\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.887092 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:08:58.887065 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90e8eeed_e9a7_41ba_8032_a2ec006f5c38.slice/crio-d6964a31a42d09cd696a93f8df4a9e8a4325f654696dc8bdee43422194e19533 WatchSource:0}: Error finding container d6964a31a42d09cd696a93f8df4a9e8a4325f654696dc8bdee43422194e19533: Status 404 returned error can't find the container with id d6964a31a42d09cd696a93f8df4a9e8a4325f654696dc8bdee43422194e19533 Nov 03 23:08:58.891333 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.891315 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8jf\" (UniqueName: \"kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf\") pod \"authorino-64545899bb-nsg72\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:58.984422 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:58.984385 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:08:59.257751 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:59.257713 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64545899bb-nsg72"] Nov 03 23:08:59.261718 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:08:59.261687 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3588d123_3684_4b7b_b4ce_e5b37ae3a4d2.slice/crio-fa322ad85b3c9c9b0c183774cb2fb7d95915f9a10e67015f3f01de55aa2c5885 WatchSource:0}: Error finding container fa322ad85b3c9c9b0c183774cb2fb7d95915f9a10e67015f3f01de55aa2c5885: Status 404 returned error can't find the container with id fa322ad85b3c9c9b0c183774cb2fb7d95915f9a10e67015f3f01de55aa2c5885 Nov 03 23:08:59.681858 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:59.681758 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64545899bb-nsg72" event={"ID":"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2","Type":"ContainerStarted","Data":"fa322ad85b3c9c9b0c183774cb2fb7d95915f9a10e67015f3f01de55aa2c5885"} Nov 03 23:08:59.682895 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:59.682870 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dd76875b5-jghnb" Nov 03 23:08:59.682895 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:59.682890 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" event={"ID":"90e8eeed-e9a7-41ba-8032-a2ec006f5c38","Type":"ContainerStarted","Data":"d6964a31a42d09cd696a93f8df4a9e8a4325f654696dc8bdee43422194e19533"} Nov 03 23:08:59.713677 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:59.713620 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-jghnb"] Nov 03 23:08:59.718883 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:08:59.718858 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dd76875b5-jghnb"] Nov 03 23:09:00.345082 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.345049 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f767638-5e6c-4baa-b6bc-6c3babe5980e" path="/var/lib/kubelet/pods/6f767638-5e6c-4baa-b6bc-6c3babe5980e/volumes" Nov 03 23:09:00.690390 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.690282 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64545899bb-nsg72" event={"ID":"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2","Type":"ContainerStarted","Data":"58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0"} Nov 03 23:09:00.692187 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.692160 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" event={"ID":"90e8eeed-e9a7-41ba-8032-a2ec006f5c38","Type":"ContainerStarted","Data":"6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5"} Nov 03 23:09:00.692307 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.692220 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" podUID="90e8eeed-e9a7-41ba-8032-a2ec006f5c38" containerName="authorino" containerID="cri-o://6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5" gracePeriod=30 Nov 03 23:09:00.705652 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.705599 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-64545899bb-nsg72" podStartSLOduration=2.044359894 podStartE2EDuration="2.705581765s" totalImagesPullingTime="661.221871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:09:00.705318862 +0000 UTC m=+1042.482288051" watchObservedRunningTime="2026-11-03 23:09:00.705581765 +0000 UTC m=+1042.482550955" Nov 03 23:09:00.721074 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.721012 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" podStartSLOduration=1.770953083 podStartE2EDuration="2.720994737s" totalImagesPullingTime="950.041654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:08:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:09:00.719929821 +0000 UTC m=+1042.496899010" watchObservedRunningTime="2026-11-03 23:09:00.720994737 +0000 UTC m=+1042.497963927" Nov 03 23:09:00.739523 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.739492 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cps9r"] Nov 03 23:09:00.739696 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.739671 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" podUID="13f2ab9c-f199-4542-bfe7-95e712315f52" containerName="authorino" containerID="cri-o://737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df" gracePeriod=30 Nov 03 23:09:00.976269 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:00.976242 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:09:01.001548 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.001520 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:09:01.106291 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.106257 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert\" (UniqueName: \"kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert\") pod \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " Nov 03 23:09:01.106459 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.106308 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2\" (UniqueName: \"kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2\") pod \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\" (UID: \"90e8eeed-e9a7-41ba-8032-a2ec006f5c38\") " Nov 03 23:09:01.106459 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.106367 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2\" (UniqueName: \"kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2\") pod \"13f2ab9c-f199-4542-bfe7-95e712315f52\" (UID: \"13f2ab9c-f199-4542-bfe7-95e712315f52\") " Nov 03 23:09:01.108517 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.108486 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2" pod "13f2ab9c-f199-4542-bfe7-95e712315f52" (UID: "13f2ab9c-f199-4542-bfe7-95e712315f52"). InnerVolumeSpecName "kube-api-access-6f9d2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:09:01.108640 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.108513 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2" pod "90e8eeed-e9a7-41ba-8032-a2ec006f5c38" (UID: "90e8eeed-e9a7-41ba-8032-a2ec006f5c38"). InnerVolumeSpecName "kube-api-access-4cvh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:09:01.116373 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.116347 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert" pod "90e8eeed-e9a7-41ba-8032-a2ec006f5c38" (UID: "90e8eeed-e9a7-41ba-8032-a2ec006f5c38"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:09:01.207097 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.207019 6394 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-tls-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:09:01.207097 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.207050 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cvh2\" (UniqueName: \"kubernetes.io/projected/90e8eeed-e9a7-41ba-8032-a2ec006f5c38-kube-api-access-4cvh2\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:09:01.207097 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.207063 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f9d2\" (UniqueName: \"kubernetes.io/projected/13f2ab9c-f199-4542-bfe7-95e712315f52-kube-api-access-6f9d2\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:09:01.697921 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.697887 6394 generic.go:356] "Generic (PLEG): container finished" podID="90e8eeed-e9a7-41ba-8032-a2ec006f5c38" containerID="6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5" exitCode=0 Nov 03 23:09:01.698385 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.697932 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" Nov 03 23:09:01.698385 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.697964 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" event={"ID":"90e8eeed-e9a7-41ba-8032-a2ec006f5c38","Type":"ContainerDied","Data":"6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5"} Nov 03 23:09:01.698385 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.697998 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6889cbd8c4-ql6v4" event={"ID":"90e8eeed-e9a7-41ba-8032-a2ec006f5c38","Type":"ContainerDied","Data":"d6964a31a42d09cd696a93f8df4a9e8a4325f654696dc8bdee43422194e19533"} Nov 03 23:09:01.698385 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.698020 6394 scope.go:122] "RemoveContainer" containerID="6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5" Nov 03 23:09:01.699262 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.699230 6394 generic.go:356] "Generic (PLEG): container finished" podID="13f2ab9c-f199-4542-bfe7-95e712315f52" containerID="737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df" exitCode=0 Nov 03 23:09:01.699396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.699284 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" Nov 03 23:09:01.699396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.699295 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" event={"ID":"13f2ab9c-f199-4542-bfe7-95e712315f52","Type":"ContainerDied","Data":"737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df"} Nov 03 23:09:01.699396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.699329 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cps9r" event={"ID":"13f2ab9c-f199-4542-bfe7-95e712315f52","Type":"ContainerDied","Data":"f49383c6521b7e57dbc30c5dd5cda498fcf5a7bc1027ba9298955b50b79eefc4"} Nov 03 23:09:01.707072 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.706766 6394 scope.go:122] "RemoveContainer" containerID="6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5" Nov 03 23:09:01.707162 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:09:01.707136 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5\": container with ID starting with 6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5 not found: ID does not exist" containerID="6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5" Nov 03 23:09:01.707221 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.707176 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5"} err="failed to get container status \"6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5\": rpc error: code = NotFound desc = could not find container \"6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5\": container with ID starting with 6c599a261966a06dbb26004440e1e852bdda30ff5788517358f719900bdb50a5 not found: ID does not exist" Nov 03 23:09:01.707221 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.707193 6394 scope.go:122] "RemoveContainer" containerID="737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df" Nov 03 23:09:01.715329 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.715304 6394 scope.go:122] "RemoveContainer" containerID="737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df" Nov 03 23:09:01.715606 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:09:01.715585 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df\": container with ID starting with 737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df not found: ID does not exist" containerID="737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df" Nov 03 23:09:01.715718 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.715619 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df"} err="failed to get container status \"737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df\": rpc error: code = NotFound desc = could not find container \"737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df\": container with ID starting with 737c9f72372658ae214d41861a1cc5f9f64319b94cd45e39b7433d29582af3df not found: ID does not exist" Nov 03 23:09:01.724010 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.723982 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ql6v4"] Nov 03 23:09:01.729359 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.729330 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-ql6v4"] Nov 03 23:09:01.739507 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.739475 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cps9r"] Nov 03 23:09:01.743052 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.743027 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cps9r"] Nov 03 23:09:01.856376 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.856335 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:09:01.856581 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.856559 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" containerID="cri-o://7d5c2000d91569191eace35b0c4fe2c1573229500a8cd79f19ab79ccc1d9a2c5" gracePeriod=30 Nov 03 23:09:01.995214 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:01.995119 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 23:09:02.342423 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:02.342389 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="13f2ab9c-f199-4542-bfe7-95e712315f52" path="/var/lib/kubelet/pods/13f2ab9c-f199-4542-bfe7-95e712315f52/volumes" Nov 03 23:09:02.342770 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:02.342756 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="90e8eeed-e9a7-41ba-8032-a2ec006f5c38" path="/var/lib/kubelet/pods/90e8eeed-e9a7-41ba-8032-a2ec006f5c38/volumes" Nov 03 23:09:03.711165 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:03.711125 6394 generic.go:356] "Generic (PLEG): container finished" podID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerID="7d5c2000d91569191eace35b0c4fe2c1573229500a8cd79f19ab79ccc1d9a2c5" exitCode=143 Nov 03 23:09:03.711536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:03.711198 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6667767-763f-4fc1-b116-f9e5f4d12d26","Type":"ContainerDied","Data":"7d5c2000d91569191eace35b0c4fe2c1573229500a8cd79f19ab79ccc1d9a2c5"} Nov 03 23:09:03.892858 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:03.892836 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.031992 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.031887 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5\" (UniqueName: \"kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5\") pod \"f6667767-763f-4fc1-b116-f9e5f4d12d26\" (UID: \"f6667767-763f-4fc1-b116-f9e5f4d12d26\") " Nov 03 23:09:04.034289 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.034258 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5" pod "f6667767-763f-4fc1-b116-f9e5f4d12d26" (UID: "f6667767-763f-4fc1-b116-f9e5f4d12d26"). InnerVolumeSpecName "kube-api-access-qc5b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:09:04.132897 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.132857 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc5b5\" (UniqueName: \"kubernetes.io/projected/f6667767-763f-4fc1-b116-f9e5f4d12d26-kube-api-access-qc5b5\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:09:04.716564 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.716485 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.716564 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.716502 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f6667767-763f-4fc1-b116-f9e5f4d12d26","Type":"ContainerDied","Data":"a9697593a12b34d89636894ff9ef658a9806444d5241ba378f08e0f3ea139a13"} Nov 03 23:09:04.716564 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.716560 6394 scope.go:122] "RemoveContainer" containerID="7d5c2000d91569191eace35b0c4fe2c1573229500a8cd79f19ab79ccc1d9a2c5" Nov 03 23:09:04.735004 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.734981 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:09:04.739343 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.739321 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:09:04.761870 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.761833 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:09:04.762276 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762257 6394 cpu_manager.go:414] "containerMap: removing container" podUID="13f2ab9c-f199-4542-bfe7-95e712315f52" containerName="authorino" Nov 03 23:09:04.762353 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762277 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="13f2ab9c-f199-4542-bfe7-95e712315f52" containerName="authorino" Nov 03 23:09:04.762353 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762299 6394 cpu_manager.go:414] "containerMap: removing container" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" Nov 03 23:09:04.762353 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762307 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" Nov 03 23:09:04.762353 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762317 6394 cpu_manager.go:414] "containerMap: removing container" podUID="90e8eeed-e9a7-41ba-8032-a2ec006f5c38" containerName="authorino" Nov 03 23:09:04.762353 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762325 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90e8eeed-e9a7-41ba-8032-a2ec006f5c38" containerName="authorino" Nov 03 23:09:04.762598 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762407 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="13f2ab9c-f199-4542-bfe7-95e712315f52" containerName="authorino" Nov 03 23:09:04.762598 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762420 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" containerName="keycloak" Nov 03 23:09:04.762598 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.762431 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="90e8eeed-e9a7-41ba-8032-a2ec006f5c38" containerName="authorino" Nov 03 23:09:04.770021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.769991 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.773653 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.773621 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:09:04.774054 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.774028 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Nov 03 23:09:04.774321 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.774301 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ggnqw\"" Nov 03 23:09:04.774798 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.774778 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Nov 03 23:09:04.839421 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.839373 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9q5k\" (UniqueName: \"kubernetes.io/projected/72b27232-9f16-481d-9183-0221eb1864de-kube-api-access-m9q5k\") pod \"maas-keycloak-0\" (UID: \"72b27232-9f16-481d-9183-0221eb1864de\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.839604 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.839437 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/72b27232-9f16-481d-9183-0221eb1864de-test-realms\") pod \"maas-keycloak-0\" (UID: \"72b27232-9f16-481d-9183-0221eb1864de\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.940415 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.940385 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/72b27232-9f16-481d-9183-0221eb1864de-test-realms\") pod \"maas-keycloak-0\" (UID: \"72b27232-9f16-481d-9183-0221eb1864de\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.940582 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.940435 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9q5k\" (UniqueName: \"kubernetes.io/projected/72b27232-9f16-481d-9183-0221eb1864de-kube-api-access-m9q5k\") pod \"maas-keycloak-0\" (UID: \"72b27232-9f16-481d-9183-0221eb1864de\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.941138 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.941112 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/72b27232-9f16-481d-9183-0221eb1864de-test-realms\") pod \"maas-keycloak-0\" (UID: \"72b27232-9f16-481d-9183-0221eb1864de\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:04.949267 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:04.949235 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9q5k\" (UniqueName: \"kubernetes.io/projected/72b27232-9f16-481d-9183-0221eb1864de-kube-api-access-m9q5k\") pod \"maas-keycloak-0\" (UID: \"72b27232-9f16-481d-9183-0221eb1864de\") " pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:05.092962 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:05.092929 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:05.383939 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:05.383870 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 23:09:05.387271 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:09:05.387235 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72b27232_9f16_481d_9183_0221eb1864de.slice/crio-5a704f802f013e4af09400d939966ef3f9ba497f866ddf7e0772afd6975e6dd5 WatchSource:0}: Error finding container 5a704f802f013e4af09400d939966ef3f9ba497f866ddf7e0772afd6975e6dd5: Status 404 returned error can't find the container with id 5a704f802f013e4af09400d939966ef3f9ba497f866ddf7e0772afd6975e6dd5 Nov 03 23:09:05.724305 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:05.724221 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"72b27232-9f16-481d-9183-0221eb1864de","Type":"ContainerStarted","Data":"5a704f802f013e4af09400d939966ef3f9ba497f866ddf7e0772afd6975e6dd5"} Nov 03 23:09:06.345423 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:06.345383 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6667767-763f-4fc1-b116-f9e5f4d12d26" path="/var/lib/kubelet/pods/f6667767-763f-4fc1-b116-f9e5f4d12d26/volumes" Nov 03 23:09:06.744494 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:06.744392 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"72b27232-9f16-481d-9183-0221eb1864de","Type":"ContainerStarted","Data":"94bec2d459baf375b3bc5cb0378ba7887ed92ce845fa4066a37340763cedb311"} Nov 03 23:09:06.763410 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:06.763346 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.317763638 podStartE2EDuration="2.763326766s" totalImagesPullingTime="445.563128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:09:06.762494313 +0000 UTC m=+1048.539463524" watchObservedRunningTime="2026-11-03 23:09:06.763326766 +0000 UTC m=+1048.540295967" Nov 03 23:09:07.093573 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:07.093539 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:07.095273 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:07.095235 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:08.093739 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:08.093686 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:09.094339 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:09.094284 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:10.094114 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:10.094072 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:11.093557 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:11.093516 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:12.098149 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:12.098100 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:13.095096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:13.095047 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:14.094108 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:14.094059 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:15.093253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:15.093215 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:15.093899 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:15.093859 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:16.094444 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:16.094398 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:17.094105 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:17.094004 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:18.093894 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:18.093836 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:18.889460 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:09:18.889406 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:09:19.093591 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:19.093540 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:20.093892 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:20.093846 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:21.094306 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:21.094260 6394 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.37:9000/health/started\": dial tcp 10.134.0.37:9000: connect: connection refused" Nov 03 23:09:22.217844 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:22.217812 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:22.238769 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:22.238722 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 23:09:32.223706 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:32.223636 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="72b27232-9f16-481d-9183-0221eb1864de" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 23:09:42.226156 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:42.226108 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Nov 03 23:09:43.412003 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.411970 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cd48575b8-lbldd"] Nov 03 23:09:43.416994 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.416975 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.424184 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.424097 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Nov 03 23:09:43.425740 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.425717 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd48575b8-lbldd"] Nov 03 23:09:43.520522 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.520484 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.520752 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.520528 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssc4s\" (UniqueName: \"kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.520752 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.520702 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.621579 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.621533 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.621579 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.621580 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssc4s\" (UniqueName: \"kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.621829 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.621712 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.622375 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.622357 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.624176 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.624158 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.631497 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.631473 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssc4s\" (UniqueName: \"kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s\") pod \"authorino-5cd48575b8-lbldd\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.729551 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.729464 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:09:43.997494 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:43.997403 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cd48575b8-lbldd"] Nov 03 23:09:44.000730 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:09:44.000700 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2454b487_509c_4d65_83e8_7f66ac78673d.slice/crio-b255ddebeccb1f49b4827b7f60abccfb631881c30f9b2c5abac8d12bc0629827 WatchSource:0}: Error finding container b255ddebeccb1f49b4827b7f60abccfb631881c30f9b2c5abac8d12bc0629827: Status 404 returned error can't find the container with id b255ddebeccb1f49b4827b7f60abccfb631881c30f9b2c5abac8d12bc0629827 Nov 03 23:09:44.952421 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:44.952383 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd48575b8-lbldd" event={"ID":"2454b487-509c-4d65-83e8-7f66ac78673d","Type":"ContainerStarted","Data":"b255ddebeccb1f49b4827b7f60abccfb631881c30f9b2c5abac8d12bc0629827"} Nov 03 23:09:45.957606 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:45.957569 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd48575b8-lbldd" event={"ID":"2454b487-509c-4d65-83e8-7f66ac78673d","Type":"ContainerStarted","Data":"401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3"} Nov 03 23:09:45.974840 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:45.974789 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5cd48575b8-lbldd" podStartSLOduration=2.071663876 podStartE2EDuration="2.974773544s" totalImagesPullingTime="903.109668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:09:45.973571981 +0000 UTC m=+1087.750541171" watchObservedRunningTime="2026-11-03 23:09:45.974773544 +0000 UTC m=+1087.751742711" Nov 03 23:09:45.996377 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:45.996344 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64545899bb-nsg72"] Nov 03 23:09:45.996550 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:45.996528 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-64545899bb-nsg72" podUID="3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" containerName="authorino" containerID="cri-o://58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0" gracePeriod=30 Nov 03 23:09:46.242256 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.242230 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:09:46.355004 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.354971 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf\" (UniqueName: \"kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf\") pod \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " Nov 03 23:09:46.355185 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.355049 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert\" (UniqueName: \"kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert\") pod \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\" (UID: \"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2\") " Nov 03 23:09:46.357156 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.357129 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf" pod "3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" (UID: "3588d123-3684-4b7b-b4ce-e5b37ae3a4d2"). InnerVolumeSpecName "kube-api-access-zs8jf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:09:46.366913 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.366888 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert" pod "3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" (UID: "3588d123-3684-4b7b-b4ce-e5b37ae3a4d2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:09:46.456548 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.456494 6394 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-tls-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:09:46.456548 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.456546 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs8jf\" (UniqueName: \"kubernetes.io/projected/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2-kube-api-access-zs8jf\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:09:46.969282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.969244 6394 generic.go:356] "Generic (PLEG): container finished" podID="3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" containerID="58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0" exitCode=0 Nov 03 23:09:46.969783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.969307 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64545899bb-nsg72" Nov 03 23:09:46.969783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.969326 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64545899bb-nsg72" event={"ID":"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2","Type":"ContainerDied","Data":"58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0"} Nov 03 23:09:46.969783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.969374 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64545899bb-nsg72" event={"ID":"3588d123-3684-4b7b-b4ce-e5b37ae3a4d2","Type":"ContainerDied","Data":"fa322ad85b3c9c9b0c183774cb2fb7d95915f9a10e67015f3f01de55aa2c5885"} Nov 03 23:09:46.969783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.969395 6394 scope.go:122] "RemoveContainer" containerID="58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0" Nov 03 23:09:46.978915 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.978897 6394 scope.go:122] "RemoveContainer" containerID="58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0" Nov 03 23:09:46.979296 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:09:46.979276 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0\": container with ID starting with 58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0 not found: ID does not exist" containerID="58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0" Nov 03 23:09:46.979350 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.979308 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0"} err="failed to get container status \"58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0\": rpc error: code = NotFound desc = could not find container \"58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0\": container with ID starting with 58c13641c768cba5ef02e2a5db7009987e335080174b489a0cf7f38d24e95ad0 not found: ID does not exist" Nov 03 23:09:46.989978 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.989952 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64545899bb-nsg72"] Nov 03 23:09:46.993630 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:46.993603 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64545899bb-nsg72"] Nov 03 23:09:48.342133 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:09:48.342059 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" path="/var/lib/kubelet/pods/3588d123-3684-4b7b-b4ce-e5b37ae3a4d2/volumes" Nov 03 23:09:48.888639 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:09:48.888606 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:10:18.886988 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:10:18.886951 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:10:22.185932 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.185897 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-pnbq9"] Nov 03 23:10:22.186322 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.186239 6394 cpu_manager.go:414] "containerMap: removing container" podUID="3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" containerName="authorino" Nov 03 23:10:22.186322 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.186249 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" containerName="authorino" Nov 03 23:10:22.186322 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.186307 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="3588d123-3684-4b7b-b4ce-e5b37ae3a4d2" containerName="authorino" Nov 03 23:10:22.190829 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.190812 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.197519 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.197490 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-pnbq9"] Nov 03 23:10:22.198615 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.198591 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 23:10:22.198615 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.198611 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Nov 03 23:10:22.198813 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.198647 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 23:10:22.198813 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.198755 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-wmn4x\"" Nov 03 23:10:22.198918 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.198817 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Nov 03 23:10:22.282917 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.282885 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqmg\" (UniqueName: \"kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg\") pod \"ai-gateway-controller-5d8dddb676-pnbq9\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.283117 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.282933 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-pnbq9\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.384291 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.384245 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqmg\" (UniqueName: \"kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg\") pod \"ai-gateway-controller-5d8dddb676-pnbq9\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.384482 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.384309 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-pnbq9\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.386918 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.386895 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-pnbq9\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.392349 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.392326 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqmg\" (UniqueName: \"kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg\") pod \"ai-gateway-controller-5d8dddb676-pnbq9\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.505874 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.505788 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:22.781806 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:22.781783 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-pnbq9"] Nov 03 23:10:22.784032 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:10:22.784005 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406500b2_b458_44ed_8009_96a8a1696cbb.slice/crio-219db89ce37034417debfb9c499e268076fbbdd30cc69ddbb2876df2463b7396 WatchSource:0}: Error finding container 219db89ce37034417debfb9c499e268076fbbdd30cc69ddbb2876df2463b7396: Status 404 returned error can't find the container with id 219db89ce37034417debfb9c499e268076fbbdd30cc69ddbb2876df2463b7396 Nov 03 23:10:23.126509 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:23.126467 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" event={"ID":"406500b2-b458-44ed-8009-96a8a1696cbb","Type":"ContainerStarted","Data":"219db89ce37034417debfb9c499e268076fbbdd30cc69ddbb2876df2463b7396"} Nov 03 23:10:27.145901 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:27.145866 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" event={"ID":"406500b2-b458-44ed-8009-96a8a1696cbb","Type":"ContainerStarted","Data":"996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf"} Nov 03 23:10:27.146305 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:27.146089 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:27.162735 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:27.162684 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" podStartSLOduration=1.286399943 podStartE2EDuration="5.162651416s" totalImagesPullingTime="3.876251473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:10:27.161434826 +0000 UTC m=+1128.938404015" watchObservedRunningTime="2026-11-03 23:10:27.162651416 +0000 UTC m=+1128.939620604" Nov 03 23:10:28.448488 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.448447 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-59ml8"] Nov 03 23:10:28.452094 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.452069 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.465813 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.465790 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-n6kdt\"" Nov 03 23:10:28.476151 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.476127 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-59ml8"] Nov 03 23:10:28.537715 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.537676 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llhdf\" (UniqueName: \"kubernetes.io/projected/5ba53a6a-4b41-4970-9f27-244c7cef856d-kube-api-access-llhdf\") pod \"payload-processing-7bb9489676-59ml8\" (UID: \"5ba53a6a-4b41-4970-9f27-244c7cef856d\") " pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.537897 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.537760 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba53a6a-4b41-4970-9f27-244c7cef856d-plugins-config-volume\") pod \"payload-processing-7bb9489676-59ml8\" (UID: \"5ba53a6a-4b41-4970-9f27-244c7cef856d\") " pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.537976 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.537961 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Nov 03 23:10:28.538035 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.538019 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 23:10:28.538069 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.538020 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 23:10:28.638387 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.638346 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llhdf\" (UniqueName: \"kubernetes.io/projected/5ba53a6a-4b41-4970-9f27-244c7cef856d-kube-api-access-llhdf\") pod \"payload-processing-7bb9489676-59ml8\" (UID: \"5ba53a6a-4b41-4970-9f27-244c7cef856d\") " pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.638598 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.638415 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba53a6a-4b41-4970-9f27-244c7cef856d-plugins-config-volume\") pod \"payload-processing-7bb9489676-59ml8\" (UID: \"5ba53a6a-4b41-4970-9f27-244c7cef856d\") " pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.639208 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.639182 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ba53a6a-4b41-4970-9f27-244c7cef856d-plugins-config-volume\") pod \"payload-processing-7bb9489676-59ml8\" (UID: \"5ba53a6a-4b41-4970-9f27-244c7cef856d\") " pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.646922 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.646900 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llhdf\" (UniqueName: \"kubernetes.io/projected/5ba53a6a-4b41-4970-9f27-244c7cef856d-kube-api-access-llhdf\") pod \"payload-processing-7bb9489676-59ml8\" (UID: \"5ba53a6a-4b41-4970-9f27-244c7cef856d\") " pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:28.766236 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:28.766119 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:29.042087 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:29.042064 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bb9489676-59ml8"] Nov 03 23:10:29.044190 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:10:29.044156 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba53a6a_4b41_4970_9f27_244c7cef856d.slice/crio-14a95d53add66d89510b289d9d48476416eefb5b05294ae17875adaf1c9a0ae7 WatchSource:0}: Error finding container 14a95d53add66d89510b289d9d48476416eefb5b05294ae17875adaf1c9a0ae7: Status 404 returned error can't find the container with id 14a95d53add66d89510b289d9d48476416eefb5b05294ae17875adaf1c9a0ae7 Nov 03 23:10:29.155387 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:29.155350 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" event={"ID":"5ba53a6a-4b41-4970-9f27-244c7cef856d","Type":"ContainerStarted","Data":"14a95d53add66d89510b289d9d48476416eefb5b05294ae17875adaf1c9a0ae7"} Nov 03 23:10:32.177090 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:32.177054 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" event={"ID":"5ba53a6a-4b41-4970-9f27-244c7cef856d","Type":"ContainerStarted","Data":"f241add82a38029ff2c8de428ba011e1f8cbcd8720083f534fa479b785511b03"} Nov 03 23:10:32.177505 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:32.177187 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:32.195493 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:32.195446 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" podStartSLOduration=2.082709235 podStartE2EDuration="4.195434197s" totalImagesPullingTime="2.112724962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:10:32.194310449 +0000 UTC m=+1133.971279638" watchObservedRunningTime="2026-11-03 23:10:32.195434197 +0000 UTC m=+1133.972403418" Nov 03 23:10:38.152521 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:38.152482 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:43.187719 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:43.187689 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bb9489676-59ml8" Nov 03 23:10:48.887552 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:10:48.887512 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:10:52.269711 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:52.269648 6394 generic.go:356] "Generic (PLEG): container finished" podID="28167517-0c84-4cec-ab5a-604765b61b91" containerID="99c7f78f6e42da5a049995432d13e7fdd89050288d4ba3e409b9333650fbd062" exitCode=1 Nov 03 23:10:52.270121 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:52.269724 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" event={"ID":"28167517-0c84-4cec-ab5a-604765b61b91","Type":"ContainerDied","Data":"99c7f78f6e42da5a049995432d13e7fdd89050288d4ba3e409b9333650fbd062"} Nov 03 23:10:52.270121 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:52.270076 6394 scope.go:122] "RemoveContainer" containerID="99c7f78f6e42da5a049995432d13e7fdd89050288d4ba3e409b9333650fbd062" Nov 03 23:10:52.289646 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:52.289619 6394 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 23:10:52.939677 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:52.939631 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-pnbq9"] Nov 03 23:10:52.939903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:52.939883 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" podUID="406500b2-b458-44ed-8009-96a8a1696cbb" containerName="manager" containerID="cri-o://996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf" gracePeriod=30 Nov 03 23:10:53.186240 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.186216 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:53.248938 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.248842 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs\" (UniqueName: \"kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs\") pod \"406500b2-b458-44ed-8009-96a8a1696cbb\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " Nov 03 23:10:53.249118 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.248939 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg\" (UniqueName: \"kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg\") pod \"406500b2-b458-44ed-8009-96a8a1696cbb\" (UID: \"406500b2-b458-44ed-8009-96a8a1696cbb\") " Nov 03 23:10:53.251346 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.251314 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg" pod "406500b2-b458-44ed-8009-96a8a1696cbb" (UID: "406500b2-b458-44ed-8009-96a8a1696cbb"). InnerVolumeSpecName "kube-api-access-rqqmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:10:53.251472 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.251319 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs" pod "406500b2-b458-44ed-8009-96a8a1696cbb" (UID: "406500b2-b458-44ed-8009-96a8a1696cbb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:10:53.276597 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.276555 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" event={"ID":"28167517-0c84-4cec-ab5a-604765b61b91","Type":"ContainerStarted","Data":"881df0cded9cf22488451c6f9324a9366637c44b826cc2f2d6ece9622717ce24"} Nov 03 23:10:53.277093 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.276618 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 23:10:53.277906 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.277872 6394 generic.go:356] "Generic (PLEG): container finished" podID="406500b2-b458-44ed-8009-96a8a1696cbb" containerID="996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf" exitCode=0 Nov 03 23:10:53.278021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.277907 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" Nov 03 23:10:53.278021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.277925 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" event={"ID":"406500b2-b458-44ed-8009-96a8a1696cbb","Type":"ContainerDied","Data":"996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf"} Nov 03 23:10:53.278021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.277972 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-pnbq9" event={"ID":"406500b2-b458-44ed-8009-96a8a1696cbb","Type":"ContainerDied","Data":"219db89ce37034417debfb9c499e268076fbbdd30cc69ddbb2876df2463b7396"} Nov 03 23:10:53.278021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.278003 6394 scope.go:122] "RemoveContainer" containerID="996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf" Nov 03 23:10:53.286911 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.286892 6394 scope.go:122] "RemoveContainer" containerID="996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf" Nov 03 23:10:53.287171 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:10:53.287153 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf\": container with ID starting with 996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf not found: ID does not exist" containerID="996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf" Nov 03 23:10:53.287209 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.287184 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf"} err="failed to get container status \"996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf\": rpc error: code = NotFound desc = could not find container \"996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf\": container with ID starting with 996afd984e27057dc4ecc354576a49e8ef49bc203af4d89ce27f01a4b36f46bf not found: ID does not exist" Nov 03 23:10:53.305396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.305367 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-pnbq9"] Nov 03 23:10:53.307107 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.307084 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-pnbq9"] Nov 03 23:10:53.350595 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.350555 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqqmg\" (UniqueName: \"kubernetes.io/projected/406500b2-b458-44ed-8009-96a8a1696cbb-kube-api-access-rqqmg\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:10:53.350595 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:53.350588 6394 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/406500b2-b458-44ed-8009-96a8a1696cbb-metrics-certs\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:10:54.342210 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:10:54.342178 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="406500b2-b458-44ed-8009-96a8a1696cbb" path="/var/lib/kubelet/pods/406500b2-b458-44ed-8009-96a8a1696cbb/volumes" Nov 03 23:11:04.288837 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:04.288808 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-7c646f4476-xp7tk" Nov 03 23:11:18.887375 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:11:18.887286 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:11:19.378577 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.378532 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt"] Nov 03 23:11:19.379179 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.379155 6394 cpu_manager.go:414] "containerMap: removing container" podUID="406500b2-b458-44ed-8009-96a8a1696cbb" containerName="manager" Nov 03 23:11:19.379179 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.379175 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="406500b2-b458-44ed-8009-96a8a1696cbb" containerName="manager" Nov 03 23:11:19.379379 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.379258 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="406500b2-b458-44ed-8009-96a8a1696cbb" containerName="manager" Nov 03 23:11:19.382674 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.382639 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.386466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.386443 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 03 23:11:19.386608 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.386564 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dsjx4\"" Nov 03 23:11:19.389415 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.389395 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 03 23:11:19.391816 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.391794 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt"] Nov 03 23:11:19.463861 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.463825 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.464061 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.463875 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vrm\" (UniqueName: \"kubernetes.io/projected/9c350b17-8658-47f0-a1f4-d83f0f1c9740-kube-api-access-p5vrm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.464061 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.463966 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c350b17-8658-47f0-a1f4-d83f0f1c9740-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.464061 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.463988 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.464061 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.464006 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.464232 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.464063 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.489722 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.489686 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Nov 03 23:11:19.565170 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565128 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565489 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565175 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565489 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565215 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565489 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565263 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vrm\" (UniqueName: \"kubernetes.io/projected/9c350b17-8658-47f0-a1f4-d83f0f1c9740-kube-api-access-p5vrm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565489 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565340 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c350b17-8658-47f0-a1f4-d83f0f1c9740-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565489 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565375 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565831 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565777 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565831 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565804 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.565920 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.565845 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.567819 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.567793 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c350b17-8658-47f0-a1f4-d83f0f1c9740-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.568087 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.568064 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c350b17-8658-47f0-a1f4-d83f0f1c9740-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.575763 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.575738 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vrm\" (UniqueName: \"kubernetes.io/projected/9c350b17-8658-47f0-a1f4-d83f0f1c9740-kube-api-access-p5vrm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt\" (UID: \"9c350b17-8658-47f0-a1f4-d83f0f1c9740\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.699016 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.698923 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:19.905537 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.905506 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:19.970790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:19.970764 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt"] Nov 03 23:11:19.972933 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:19.972893 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c350b17_8658_47f0_a1f4_d83f0f1c9740.slice/crio-17974e7d49fd179f282e5d3e4050c70b06b27ae6b1961b089f26e50fa10588d1 WatchSource:0}: Error finding container 17974e7d49fd179f282e5d3e4050c70b06b27ae6b1961b089f26e50fa10588d1: Status 404 returned error can't find the container with id 17974e7d49fd179f282e5d3e4050c70b06b27ae6b1961b089f26e50fa10588d1 Nov 03 23:11:20.398625 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:20.398588 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" event={"ID":"9c350b17-8658-47f0-a1f4-d83f0f1c9740","Type":"ContainerStarted","Data":"17974e7d49fd179f282e5d3e4050c70b06b27ae6b1961b089f26e50fa10588d1"} Nov 03 23:11:22.409933 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:22.409894 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" event={"ID":"9c350b17-8658-47f0-a1f4-d83f0f1c9740","Type":"ContainerStarted","Data":"7b6d212d889bb96a2dab15bc2d953e5731f4558e8e595298df04aaf10ae2a726"} Nov 03 23:11:22.426637 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:22.426575 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" podStartSLOduration=1.8950493210000001 podStartE2EDuration="3.426558028s" totalImagesPullingTime="1.531508707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:22.426374383 +0000 UTC m=+1184.203343584" watchObservedRunningTime="2026-11-03 23:11:22.426558028 +0000 UTC m=+1184.203527199" Nov 03 23:11:22.534931 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:22.534895 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:22.699209 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:22.699120 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:24.610460 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:24.610416 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:26.409053 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.409020 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr"] Nov 03 23:11:26.412443 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.412421 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.416067 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.416044 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Nov 03 23:11:26.420682 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.420639 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr"] Nov 03 23:11:26.433089 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.433066 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.433269 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.433095 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4lxv\" (UniqueName: \"kubernetes.io/projected/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-kube-api-access-p4lxv\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.433269 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.433117 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.433269 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.433195 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.433269 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.433248 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.433424 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.433309 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.534452 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534407 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4lxv\" (UniqueName: \"kubernetes.io/projected/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-kube-api-access-p4lxv\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.534452 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534452 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.534774 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534472 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.534774 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534487 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.534774 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534508 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.534774 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534579 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.535007 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534979 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.535063 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.534993 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.535063 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.535048 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.536970 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.536948 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.537237 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.537218 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.542416 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.542392 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4lxv\" (UniqueName: \"kubernetes.io/projected/a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463-kube-api-access-p4lxv\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-bcnjr\" (UID: \"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.726174 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.726083 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:26.998142 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:26.998071 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr"] Nov 03 23:11:27.001352 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:27.001321 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ca3f5e_fc96_4457_8bda_a5a2b8fc0463.slice/crio-95acb338a8444b76d93bab8b39c302a671ff840d05c694d6a192cd0b17b78052 WatchSource:0}: Error finding container 95acb338a8444b76d93bab8b39c302a671ff840d05c694d6a192cd0b17b78052: Status 404 returned error can't find the container with id 95acb338a8444b76d93bab8b39c302a671ff840d05c694d6a192cd0b17b78052 Nov 03 23:11:27.002778 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:27.002758 6394 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 23:11:27.154561 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:27.154511 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:27.442240 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:27.442201 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" event={"ID":"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463","Type":"ContainerStarted","Data":"74f292691e80b3698efe448d285bb4817d861d31cca1a64ce55bda0f23eda472"} Nov 03 23:11:27.442675 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:27.442256 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" event={"ID":"a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463","Type":"ContainerStarted","Data":"95acb338a8444b76d93bab8b39c302a671ff840d05c694d6a192cd0b17b78052"} Nov 03 23:11:27.464746 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:27.464696 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" podStartSLOduration=1.1801475319999999 podStartE2EDuration="1.464649248s" totalImagesPullingTime="284.501716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:27.463923211 +0000 UTC m=+1189.240892401" watchObservedRunningTime="2026-11-03 23:11:27.464649248 +0000 UTC m=+1189.241618454" Nov 03 23:11:27.726730 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:27.726687 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:29.699928 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.699888 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:29.713722 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.713697 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:29.724996 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.724964 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:29.957882 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.957780 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6q4sf"] Nov 03 23:11:29.961580 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.961556 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:29.968887 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.968860 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\"" Nov 03 23:11:29.976165 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:29.976136 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6q4sf"] Nov 03 23:11:30.066567 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.066522 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.066567 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.066566 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.066837 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.066585 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee13325-c9e5-4304-b9f3-dc6f5987103e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.066837 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.066782 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-home\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.066916 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.066833 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.066960 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.066913 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnrxv\" (UniqueName: \"kubernetes.io/projected/0ee13325-c9e5-4304-b9f3-dc6f5987103e-kube-api-access-jnrxv\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168277 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168242 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-home\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168469 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168292 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168469 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168321 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnrxv\" (UniqueName: \"kubernetes.io/projected/0ee13325-c9e5-4304-b9f3-dc6f5987103e-kube-api-access-jnrxv\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168469 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168413 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168469 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168436 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168469 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168460 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee13325-c9e5-4304-b9f3-dc6f5987103e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168808 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168786 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-home\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.168868 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.168825 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.169033 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.169013 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.170869 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.170841 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ee13325-c9e5-4304-b9f3-dc6f5987103e-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.171214 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.171189 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ee13325-c9e5-4304-b9f3-dc6f5987103e-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.179300 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.179262 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnrxv\" (UniqueName: \"kubernetes.io/projected/0ee13325-c9e5-4304-b9f3-dc6f5987103e-kube-api-access-jnrxv\") pod \"echo-simulator-kserve-64b6f8f96c-6q4sf\" (UID: \"0ee13325-c9e5-4304-b9f3-dc6f5987103e\") " pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.277348 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.277258 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:30.466841 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.466812 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt" Nov 03 23:11:30.558070 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:30.558041 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-6q4sf"] Nov 03 23:11:30.560698 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:30.560648 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee13325_c9e5_4304_b9f3_dc6f5987103e.slice/crio-628d0d935de9d4a9a920fc959eb037b6a70d81615c7f099e4b8d45159d1bb1ea WatchSource:0}: Error finding container 628d0d935de9d4a9a920fc959eb037b6a70d81615c7f099e4b8d45159d1bb1ea: Status 404 returned error can't find the container with id 628d0d935de9d4a9a920fc959eb037b6a70d81615c7f099e4b8d45159d1bb1ea Nov 03 23:11:31.176709 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.144927 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645"] Nov 03 23:11:31.178722 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.178698 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.183093 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.182291 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645"] Nov 03 23:11:31.192046 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.192024 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Nov 03 23:11:31.279054 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.279013 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.279255 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.279146 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.279255 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.279197 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.279378 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.279313 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.279378 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.279369 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwk2q\" (UniqueName: \"kubernetes.io/projected/3be911c1-1b8f-445e-981f-9a4da893d65d-kube-api-access-xwk2q\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.279500 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.279470 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3be911c1-1b8f-445e-981f-9a4da893d65d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.380379 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.380340 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.380536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.380387 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.380536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.380404 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.380536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.380445 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwk2q\" (UniqueName: \"kubernetes.io/projected/3be911c1-1b8f-445e-981f-9a4da893d65d-kube-api-access-xwk2q\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.380536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.380498 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3be911c1-1b8f-445e-981f-9a4da893d65d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.380536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.380524 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.381157 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.381048 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.381157 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.381087 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.381157 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.381122 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.384257 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.383967 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3be911c1-1b8f-445e-981f-9a4da893d65d-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.384257 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.384212 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3be911c1-1b8f-445e-981f-9a4da893d65d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.398690 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.398486 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwk2q\" (UniqueName: \"kubernetes.io/projected/3be911c1-1b8f-445e-981f-9a4da893d65d-kube-api-access-xwk2q\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-9d645\" (UID: \"3be911c1-1b8f-445e-981f-9a4da893d65d\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.464129 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.464049 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" event={"ID":"0ee13325-c9e5-4304-b9f3-dc6f5987103e","Type":"ContainerStarted","Data":"628d0d935de9d4a9a920fc959eb037b6a70d81615c7f099e4b8d45159d1bb1ea"} Nov 03 23:11:31.498542 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.498488 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:31.795764 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:31.795647 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645"] Nov 03 23:11:31.800527 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:31.800497 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be911c1_1b8f_445e_981f_9a4da893d65d.slice/crio-193c8214922ce4d6b5b1e6ad2507801d95b928bfc66d77833641f2c45ca0a54a WatchSource:0}: Error finding container 193c8214922ce4d6b5b1e6ad2507801d95b928bfc66d77833641f2c45ca0a54a: Status 404 returned error can't find the container with id 193c8214922ce4d6b5b1e6ad2507801d95b928bfc66d77833641f2c45ca0a54a Nov 03 23:11:32.469914 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.469875 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" event={"ID":"3be911c1-1b8f-445e-981f-9a4da893d65d","Type":"ContainerStarted","Data":"f9543c3d72386779ad871ee47fa7283e0d91b23bc2c239d619a9ef1718dcaca1"} Nov 03 23:11:32.470292 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.469936 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" event={"ID":"3be911c1-1b8f-445e-981f-9a4da893d65d","Type":"ContainerStarted","Data":"193c8214922ce4d6b5b1e6ad2507801d95b928bfc66d77833641f2c45ca0a54a"} Nov 03 23:11:32.489336 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.489290 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" podStartSLOduration=1.207733481 podStartE2EDuration="1.489271376s" totalImagesPullingTime="281.537895ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:32.488584916 +0000 UTC m=+1194.265554118" watchObservedRunningTime="2026-11-03 23:11:32.489271376 +0000 UTC m=+1194.266240566" Nov 03 23:11:32.499227 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.499203 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:32.561928 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.561894 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn"] Nov 03 23:11:32.566213 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.566176 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.577085 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.576344 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn"] Nov 03 23:11:32.577085 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.576832 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Nov 03 23:11:32.592176 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.592127 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.592345 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.592187 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.592345 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.592274 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.592345 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.592325 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.592466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.592346 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5swg\" (UniqueName: \"kubernetes.io/projected/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-kube-api-access-b5swg\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.592466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.592373 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693420 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693332 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693420 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693372 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693420 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693392 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693420 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693424 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693786 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693451 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5swg\" (UniqueName: \"kubernetes.io/projected/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-kube-api-access-b5swg\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693786 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693476 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693907 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693884 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693956 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693922 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.693956 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.693938 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.695857 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.695836 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.695982 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.695965 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.701592 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.701562 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5swg\" (UniqueName: \"kubernetes.io/projected/ff9f5b44-2ce4-4dc5-9fac-1331a4e75862-kube-api-access-b5swg\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn\" (UID: \"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:32.843764 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.843728 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:32.885086 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:32.885052 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:33.167573 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:33.167534 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn"] Nov 03 23:11:33.171708 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:33.171651 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff9f5b44_2ce4_4dc5_9fac_1331a4e75862.slice/crio-1c6bc7b675448f18507a5def231a8f3766a65dff9b2451fd228c9fc5f674966e WatchSource:0}: Error finding container 1c6bc7b675448f18507a5def231a8f3766a65dff9b2451fd228c9fc5f674966e: Status 404 returned error can't find the container with id 1c6bc7b675448f18507a5def231a8f3766a65dff9b2451fd228c9fc5f674966e Nov 03 23:11:33.476817 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:33.476783 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" event={"ID":"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862","Type":"ContainerStarted","Data":"1c6bc7b675448f18507a5def231a8f3766a65dff9b2451fd228c9fc5f674966e"} Nov 03 23:11:33.478359 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:33.478333 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" event={"ID":"0ee13325-c9e5-4304-b9f3-dc6f5987103e","Type":"ContainerStarted","Data":"5b0021726a64eed23027157d2d83ba38c4b806e7e66e8bb00869fd8d7779c2bd"} Nov 03 23:11:33.496617 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:33.495280 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" podStartSLOduration=2.648671056 podStartE2EDuration="4.495261901s" totalImagesPullingTime="1.846590845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:33.494389798 +0000 UTC m=+1195.271358988" watchObservedRunningTime="2026-11-03 23:11:33.495261901 +0000 UTC m=+1195.272231090" Nov 03 23:11:34.277842 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:34.277802 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:34.484284 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:34.484243 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" event={"ID":"ff9f5b44-2ce4-4dc5-9fac-1331a4e75862","Type":"ContainerStarted","Data":"5a9dc4c3a7f09c85c7a2650b333f1db614fa179bb7fa088e50c8cf8f574cef8c"} Nov 03 23:11:34.501641 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:34.501593 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" podStartSLOduration=2.205949194 podStartE2EDuration="2.501578894s" totalImagesPullingTime="295.6297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:11:34.500951059 +0000 UTC m=+1196.277920250" watchObservedRunningTime="2026-11-03 23:11:34.501578894 +0000 UTC m=+1196.278548083" Nov 03 23:11:34.885983 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:34.885945 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:36.727204 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:36.727167 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:36.739603 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:36.739573 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:37.508859 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:37.508813 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-bcnjr" Nov 03 23:11:38.255199 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:38.255156 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:11:40.277865 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:40.277819 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:40.290133 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:40.290106 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:40.522611 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:40.522577 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-6q4sf" Nov 03 23:11:41.499141 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:41.499104 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:41.511818 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:41.511785 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:41.527217 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:41.527190 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9d645" Nov 03 23:11:42.885851 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:42.885807 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:42.898864 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:42.898834 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:43.538059 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:43.538033 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn" Nov 03 23:11:46.253604 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.253572 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6469b954d7-sd82d"] Nov 03 23:11:46.258480 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.258458 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.265823 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.265793 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6469b954d7-sd82d"] Nov 03 23:11:46.331355 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.331316 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e8763ba9-780a-4051-9595-5b957caa0ea0-oidc-ca\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.331517 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.331385 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bssss\" (UniqueName: \"kubernetes.io/projected/e8763ba9-780a-4051-9595-5b957caa0ea0-kube-api-access-bssss\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.331517 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.331457 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8763ba9-780a-4051-9595-5b957caa0ea0-tls-cert\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.432980 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.432938 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e8763ba9-780a-4051-9595-5b957caa0ea0-oidc-ca\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.433188 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.433034 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bssss\" (UniqueName: \"kubernetes.io/projected/e8763ba9-780a-4051-9595-5b957caa0ea0-kube-api-access-bssss\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.433188 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.433060 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8763ba9-780a-4051-9595-5b957caa0ea0-tls-cert\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.433764 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.433743 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e8763ba9-780a-4051-9595-5b957caa0ea0-oidc-ca\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.435601 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.435578 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8763ba9-780a-4051-9595-5b957caa0ea0-tls-cert\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.441361 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.441338 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bssss\" (UniqueName: \"kubernetes.io/projected/e8763ba9-780a-4051-9595-5b957caa0ea0-kube-api-access-bssss\") pod \"authorino-6469b954d7-sd82d\" (UID: \"e8763ba9-780a-4051-9595-5b957caa0ea0\") " pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.573278 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.573246 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6469b954d7-sd82d" Nov 03 23:11:46.844349 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:46.844324 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6469b954d7-sd82d"] Nov 03 23:11:46.846650 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:46.846616 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8763ba9_780a_4051_9595_5b957caa0ea0.slice/crio-617346dead43821299ebe7b78819c1692141fc6a58348ef7a0426d815c6448b0 WatchSource:0}: Error finding container 617346dead43821299ebe7b78819c1692141fc6a58348ef7a0426d815c6448b0: Status 404 returned error can't find the container with id 617346dead43821299ebe7b78819c1692141fc6a58348ef7a0426d815c6448b0 Nov 03 23:11:47.546317 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:47.546284 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6469b954d7-sd82d" event={"ID":"e8763ba9-780a-4051-9595-5b957caa0ea0","Type":"ContainerStarted","Data":"617346dead43821299ebe7b78819c1692141fc6a58348ef7a0426d815c6448b0"} Nov 03 23:11:48.888141 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:11:48.888109 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:11:54.420205 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.420173 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9"] Nov 03 23:11:54.423717 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.423699 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.428311 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.428280 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 03 23:11:54.428448 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.428342 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2wg6b\"" Nov 03 23:11:54.439194 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.439166 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9"] Nov 03 23:11:54.515496 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515462 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4nhx\" (UniqueName: \"kubernetes.io/projected/0925a8a5-1874-43a7-826b-3ddc041e5f88-kube-api-access-s4nhx\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.515496 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515505 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.515783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515577 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.515783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515652 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.515783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515689 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0925a8a5-1874-43a7-826b-3ddc041e5f88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.515783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515707 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.515783 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515728 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.516105 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515847 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.516105 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.515874 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616386 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616346 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616386 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616386 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616455 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616479 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0925a8a5-1874-43a7-826b-3ddc041e5f88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616510 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616535 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616599 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.616642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616623 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.617135 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616733 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4nhx\" (UniqueName: \"kubernetes.io/projected/0925a8a5-1874-43a7-826b-3ddc041e5f88-kube-api-access-s4nhx\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.617135 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.616878 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.617135 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.617003 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.617135 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.617061 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.617356 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.617150 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.617440 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.617419 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0925a8a5-1874-43a7-826b-3ddc041e5f88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.619249 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.619222 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.619635 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.619612 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.625167 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.625136 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0925a8a5-1874-43a7-826b-3ddc041e5f88-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.625282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.625201 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4nhx\" (UniqueName: \"kubernetes.io/projected/0925a8a5-1874-43a7-826b-3ddc041e5f88-kube-api-access-s4nhx\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-4wxx9\" (UID: \"0925a8a5-1874-43a7-826b-3ddc041e5f88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:54.738066 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:54.737966 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:11:55.016943 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:55.016917 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9"] Nov 03 23:11:55.019378 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:11:55.019352 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0925a8a5_1874_43a7_826b_3ddc041e5f88.slice/crio-2e71f71c91ea9efbb89a3847962a846782a131da6f434356a860f6e0eefaae64 WatchSource:0}: Error finding container 2e71f71c91ea9efbb89a3847962a846782a131da6f434356a860f6e0eefaae64: Status 404 returned error can't find the container with id 2e71f71c91ea9efbb89a3847962a846782a131da6f434356a860f6e0eefaae64 Nov 03 23:11:55.585668 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:55.585620 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" event={"ID":"0925a8a5-1874-43a7-826b-3ddc041e5f88","Type":"ContainerStarted","Data":"2e71f71c91ea9efbb89a3847962a846782a131da6f434356a860f6e0eefaae64"} Nov 03 23:11:59.908918 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:59.908880 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:11:59.909217 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:59.908977 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:11:59.909217 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:11:59.909026 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:00.611886 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.611849 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6469b954d7-sd82d" event={"ID":"e8763ba9-780a-4051-9595-5b957caa0ea0","Type":"ContainerStarted","Data":"490fe00ee725ba40eeca3dc3f444a0c0a9e64121a467b3031052cd5e547b6ecb"} Nov 03 23:12:00.614272 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.614233 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" event={"ID":"0925a8a5-1874-43a7-826b-3ddc041e5f88","Type":"ContainerStarted","Data":"ee8530d69e69604e38226bcfc2d3f49e26706226e9a1aa09d5b86c8a2b66f2c5"} Nov 03 23:12:00.643872 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.643812 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6469b954d7-sd82d" podStartSLOduration=1.5856545469999999 podStartE2EDuration="14.643794209s" totalImagesPullingTime="13.058139662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:00.642650748 +0000 UTC m=+1222.419619936" watchObservedRunningTime="2026-11-03 23:12:00.643794209 +0000 UTC m=+1222.420763399" Nov 03 23:12:00.662032 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.662000 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd48575b8-lbldd"] Nov 03 23:12:00.662494 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.662467 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5cd48575b8-lbldd" podUID="2454b487-509c-4d65-83e8-7f66ac78673d" containerName="authorino" containerID="cri-o://401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3" gracePeriod=30 Nov 03 23:12:00.704610 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.704562 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podStartSLOduration=1.818800521 podStartE2EDuration="6.704546438s" totalImagesPullingTime="4.885745917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:11:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:00.682649624 +0000 UTC m=+1222.459618814" watchObservedRunningTime="2026-11-03 23:12:00.704546438 +0000 UTC m=+1222.481515626" Nov 03 23:12:00.739158 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.739124 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:12:00.741792 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.741760 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:00.742036 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.742009 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:00.972490 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:00.972462 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:12:01.079357 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.079316 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca\") pod \"2454b487-509c-4d65-83e8-7f66ac78673d\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " Nov 03 23:12:01.079552 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.079428 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s\" (UniqueName: \"kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s\") pod \"2454b487-509c-4d65-83e8-7f66ac78673d\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " Nov 03 23:12:01.079552 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.079468 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert\" (UniqueName: \"kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert\") pod \"2454b487-509c-4d65-83e8-7f66ac78673d\" (UID: \"2454b487-509c-4d65-83e8-7f66ac78673d\") " Nov 03 23:12:01.081848 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.081796 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s" pod "2454b487-509c-4d65-83e8-7f66ac78673d" (UID: "2454b487-509c-4d65-83e8-7f66ac78673d"). InnerVolumeSpecName "kube-api-access-ssc4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:12:01.086128 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.086097 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca" pod "2454b487-509c-4d65-83e8-7f66ac78673d" (UID: "2454b487-509c-4d65-83e8-7f66ac78673d"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:12:01.090553 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.090528 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert" pod "2454b487-509c-4d65-83e8-7f66ac78673d" (UID: "2454b487-509c-4d65-83e8-7f66ac78673d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:12:01.180444 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.180401 6394 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2454b487-509c-4d65-83e8-7f66ac78673d-tls-cert\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:12:01.180444 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.180442 6394 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2454b487-509c-4d65-83e8-7f66ac78673d-oidc-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:12:01.180742 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.180458 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssc4s\" (UniqueName: \"kubernetes.io/projected/2454b487-509c-4d65-83e8-7f66ac78673d-kube-api-access-ssc4s\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:12:01.646835 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.646800 6394 generic.go:356] "Generic (PLEG): container finished" podID="2454b487-509c-4d65-83e8-7f66ac78673d" containerID="401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3" exitCode=0 Nov 03 23:12:01.647102 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.646861 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cd48575b8-lbldd" Nov 03 23:12:01.647733 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.646955 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd48575b8-lbldd" event={"ID":"2454b487-509c-4d65-83e8-7f66ac78673d","Type":"ContainerDied","Data":"401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3"} Nov 03 23:12:01.647859 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.647772 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cd48575b8-lbldd" event={"ID":"2454b487-509c-4d65-83e8-7f66ac78673d","Type":"ContainerDied","Data":"b255ddebeccb1f49b4827b7f60abccfb631881c30f9b2c5abac8d12bc0629827"} Nov 03 23:12:01.647859 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.647810 6394 scope.go:122] "RemoveContainer" containerID="401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3" Nov 03 23:12:01.657671 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.657637 6394 scope.go:122] "RemoveContainer" containerID="401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3" Nov 03 23:12:01.658098 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:12:01.658078 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3\": container with ID starting with 401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3 not found: ID does not exist" containerID="401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3" Nov 03 23:12:01.658170 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.658108 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3"} err="failed to get container status \"401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3\": rpc error: code = NotFound desc = could not find container \"401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3\": container with ID starting with 401efd05e02f27c815688f2d574215fb5a056bc64056ee48c1687cc75431a4c3 not found: ID does not exist" Nov 03 23:12:01.669422 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.669389 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cd48575b8-lbldd"] Nov 03 23:12:01.670599 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.670578 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cd48575b8-lbldd"] Nov 03 23:12:01.741680 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.741114 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:01.741680 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:01.741193 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:02.351736 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:02.351704 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2454b487-509c-4d65-83e8-7f66ac78673d" path="/var/lib/kubelet/pods/2454b487-509c-4d65-83e8-7f66ac78673d/volumes" Nov 03 23:12:02.741194 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:02.741097 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:02.741482 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:02.741450 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:03.746687 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:03.746570 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:03.747313 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:03.746705 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:04.740146 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:04.740096 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:04.741068 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:04.741017 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:05.742217 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:05.742170 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:05.742936 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:05.742900 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:06.739110 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:06.739052 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Nov 03 23:12:06.739355 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:06.739114 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Nov 03 23:12:08.537220 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:08.537186 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:12:08.538203 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:08.538181 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:12:08.539514 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:08.539495 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" Nov 03 23:12:09.450735 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.450691 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf"] Nov 03 23:12:09.451115 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.451101 6394 cpu_manager.go:414] "containerMap: removing container" podUID="2454b487-509c-4d65-83e8-7f66ac78673d" containerName="authorino" Nov 03 23:12:09.451115 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.451114 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2454b487-509c-4d65-83e8-7f66ac78673d" containerName="authorino" Nov 03 23:12:09.451253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.451182 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="2454b487-509c-4d65-83e8-7f66ac78673d" containerName="authorino" Nov 03 23:12:09.454653 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.454630 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.553904 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.553861 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf"] Nov 03 23:12:09.579228 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.579192 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l"] Nov 03 23:12:09.583521 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.583497 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.600637 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.600604 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.600637 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.600642 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.600840 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.600819 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9gkb\" (UniqueName: \"kubernetes.io/projected/dfbbce52-065b-4a15-9b5e-9cc5542b8101-kube-api-access-w9gkb\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.600875 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.600850 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.600913 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.600879 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.600961 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.600914 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.601100 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.601080 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.601167 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.601126 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.601242 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.601223 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.622557 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.622510 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l"] Nov 03 23:12:09.702349 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702262 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.702349 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702307 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9gkb\" (UniqueName: \"kubernetes.io/projected/dfbbce52-065b-4a15-9b5e-9cc5542b8101-kube-api-access-w9gkb\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702349 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702332 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702597 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702402 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.702688 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702672 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702749 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702730 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702802 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702771 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702864 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702802 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.702864 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702845 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702968 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702905 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.702968 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702938 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.703071 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.702978 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.703071 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703008 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.703186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703087 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.703186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703153 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nc6b\" (UniqueName: \"kubernetes.io/projected/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-kube-api-access-4nc6b\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.703291 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703214 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.703291 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703242 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.703291 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703113 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.703447 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703287 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.703447 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703289 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.703447 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703349 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.703447 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703407 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.703642 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.703522 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.706141 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.706109 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.706284 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.706231 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.711087 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.711061 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfbbce52-065b-4a15-9b5e-9cc5542b8101-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.711262 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.711244 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9gkb\" (UniqueName: \"kubernetes.io/projected/dfbbce52-065b-4a15-9b5e-9cc5542b8101-kube-api-access-w9gkb\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-g9ntf\" (UID: \"dfbbce52-065b-4a15-9b5e-9cc5542b8101\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.770381 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.770338 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:09.804330 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804279 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804531 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804352 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nc6b\" (UniqueName: \"kubernetes.io/projected/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-kube-api-access-4nc6b\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804531 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804385 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804531 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804409 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804531 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804433 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804531 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804481 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804556 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804621 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804770 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.804843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.804770 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-workload-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.805134 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.805106 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-credential-socket\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.805396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.805368 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-data\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.805742 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.805717 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-workload-certs\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.805971 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.805947 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.808022 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.807992 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.808371 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.808348 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.812774 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.812745 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nc6b\" (UniqueName: \"kubernetes.io/projected/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-kube-api-access-4nc6b\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.813101 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.813051 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64dd7ad4-183a-4f9b-8a77-d14636cffc3b-istio-token\") pod \"maas-default-gateway-openshift-default-68cb9b4b95-55s9l\" (UID: \"64dd7ad4-183a-4f9b-8a77-d14636cffc3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:09.902360 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:09.902311 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:10.059392 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.059269 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf"] Nov 03 23:12:10.064085 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:12:10.064044 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbbce52_065b_4a15_9b5e_9cc5542b8101.slice/crio-cd7777dc6dd108a6d69aa8fe9371af8545cc38822f4a7cd254a9d3b750264b76 WatchSource:0}: Error finding container cd7777dc6dd108a6d69aa8fe9371af8545cc38822f4a7cd254a9d3b750264b76: Status 404 returned error can't find the container with id cd7777dc6dd108a6d69aa8fe9371af8545cc38822f4a7cd254a9d3b750264b76 Nov 03 23:12:10.066347 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.066309 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.066476 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.066380 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.066476 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.066412 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.186097 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.186070 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l"] Nov 03 23:12:10.188571 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:12:10.188541 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64dd7ad4_183a_4f9b_8a77_d14636cffc3b.slice/crio-39552515f483f00dc67cb92fee0fc28dd2f6262f17cbc79acda6a3e773e50d19 WatchSource:0}: Error finding container 39552515f483f00dc67cb92fee0fc28dd2f6262f17cbc79acda6a3e773e50d19: Status 404 returned error can't find the container with id 39552515f483f00dc67cb92fee0fc28dd2f6262f17cbc79acda6a3e773e50d19 Nov 03 23:12:10.191085 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.191051 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.191194 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.191121 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.191194 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.191149 6394 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 23:12:10.703310 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.703270 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" event={"ID":"64dd7ad4-183a-4f9b-8a77-d14636cffc3b","Type":"ContainerStarted","Data":"e24f18fbb7d7b55ea92200eade72e5dcfb36943799b8d2a15125790e98edcafe"} Nov 03 23:12:10.703815 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.703345 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" event={"ID":"64dd7ad4-183a-4f9b-8a77-d14636cffc3b","Type":"ContainerStarted","Data":"39552515f483f00dc67cb92fee0fc28dd2f6262f17cbc79acda6a3e773e50d19"} Nov 03 23:12:10.704960 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.704936 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" event={"ID":"dfbbce52-065b-4a15-9b5e-9cc5542b8101","Type":"ContainerStarted","Data":"99a539f6aad3b09fbfcbb390796b8ca01827d938134c414873c869beef375534"} Nov 03 23:12:10.705079 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.704984 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" event={"ID":"dfbbce52-065b-4a15-9b5e-9cc5542b8101","Type":"ContainerStarted","Data":"cd7777dc6dd108a6d69aa8fe9371af8545cc38822f4a7cd254a9d3b750264b76"} Nov 03 23:12:10.729186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.727835 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podStartSLOduration=1.727814513 podStartE2EDuration="1.727814513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:10.725528916 +0000 UTC m=+1232.502498104" watchObservedRunningTime="2026-11-03 23:12:10.727814513 +0000 UTC m=+1232.504783703" Nov 03 23:12:10.752431 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.752370 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podStartSLOduration=1.752352723 podStartE2EDuration="1.752352723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:12:10.750978954 +0000 UTC m=+1232.527948144" watchObservedRunningTime="2026-11-03 23:12:10.752352723 +0000 UTC m=+1232.529321913" Nov 03 23:12:10.772813 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.772752 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:10.902946 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:10.902902 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:11.773943 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:11.773910 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:11.774486 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:11.773965 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:11.903843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:11.903812 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:11.904023 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:11.903860 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:12.771684 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:12.771604 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:12.771893 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:12.771708 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:12.902854 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:12.902819 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:12.903271 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:12.902872 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:13.772454 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:13.772134 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:13.772454 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:13.772197 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:13.904699 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:13.903992 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:13.904699 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:13.904051 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:14.771059 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:14.771026 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:14.771334 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:14.771312 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:14.903480 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:14.903430 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:14.903644 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:14.903495 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:15.773400 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:15.773092 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:15.773400 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:15.773176 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:15.903394 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:15.903353 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:15.903776 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:15.903422 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:16.771168 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:16.771129 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:16.771373 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:16.771212 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:16.903192 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:16.903146 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:16.903586 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:16.903208 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:17.771004 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:17.770974 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Nov 03 23:12:17.771225 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:17.771033 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" podUID="dfbbce52-065b-4a15-9b5e-9cc5542b8101" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Nov 03 23:12:17.903095 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:17.903051 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Nov 03 23:12:17.903306 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:17.903124 6394 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Nov 03 23:12:18.776432 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:18.776403 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:18.776787 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:18.776764 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:18.777848 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:18.777825 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-g9ntf" Nov 03 23:12:18.889923 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:12:18.889889 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:12:18.907795 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:18.907762 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:18.908245 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:18.908180 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:18.909206 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:18.909179 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" Nov 03 23:12:40.432133 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:40.432091 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:12:45.650478 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:12:45.650445 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:12:48.919022 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:12:48.918933 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:13:08.828262 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:08.828218 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:13:18.887317 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:13:18.887280 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:13:48.888400 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:13:48.888361 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:13:49.124124 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:49.124084 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:13:55.841350 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:55.841309 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:13:58.371597 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.371562 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm"] Nov 03 23:13:58.420647 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.420620 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.498679 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.421470 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm"] Nov 03 23:13:58.507789 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.507736 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-a485b453-unmatched-kserve-self-signed-certs\"" Nov 03 23:13:58.525021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.524935 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.525021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.524985 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.525021 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.525016 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.525341 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.525041 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.525341 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.525092 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.525341 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.525156 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv2m6\" (UniqueName: \"kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.626790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.626160 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.626790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.626223 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.626790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.626252 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.626790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.626277 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.626790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.626327 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.626790 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.626383 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv2m6\" (UniqueName: \"kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.627274 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.627105 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.641040 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.641004 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.641545 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.641484 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.665553 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.665515 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv2m6\" (UniqueName: \"kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.670725 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.666460 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.670725 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.666823 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm\") pod \"grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:58.820343 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:58.820312 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:13:59.205960 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:59.205010 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm"] Nov 03 23:13:59.208334 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:13:59.208298 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22870719_3b8c_4fc5_a1f5_819f45449cf1.slice/crio-a5a49ef95b6c0572bfe2b7b766f899b1841974fa48197a843680515b23ff9b54 WatchSource:0}: Error finding container a5a49ef95b6c0572bfe2b7b766f899b1841974fa48197a843680515b23ff9b54: Status 404 returned error can't find the container with id a5a49ef95b6c0572bfe2b7b766f899b1841974fa48197a843680515b23ff9b54 Nov 03 23:13:59.431676 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:59.431617 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" event={"ID":"22870719-3b8c-4fc5-a1f5-819f45449cf1","Type":"ContainerStarted","Data":"14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63"} Nov 03 23:13:59.432202 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:59.431685 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" event={"ID":"22870719-3b8c-4fc5-a1f5-819f45449cf1","Type":"ContainerStarted","Data":"a5a49ef95b6c0572bfe2b7b766f899b1841974fa48197a843680515b23ff9b54"} Nov 03 23:13:59.451042 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:59.450957 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" podStartSLOduration=1.450935799 podStartE2EDuration="1.450935799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:13:59.448405447 +0000 UTC m=+1341.225374648" watchObservedRunningTime="2026-11-03 23:13:59.450935799 +0000 UTC m=+1341.227904993" Nov 03 23:13:59.821282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:13:59.821236 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:14:03.023062 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:03.023030 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:14:08.821257 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:08.821227 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:14:08.833938 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:08.833908 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:14:09.528944 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:09.528914 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:14:18.888707 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:14:18.888613 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:14:28.457392 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:28.457361 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:14:45.442253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.442217 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b"] Nov 03 23:14:45.446134 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.446119 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.456040 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.455580 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-main-8235df\"" Nov 03 23:14:45.456792 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.456725 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b"] Nov 03 23:14:45.477768 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.477736 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2"] Nov 03 23:14:45.481240 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.481224 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.486891 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.486866 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n\") pod \"payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.487032 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.487012 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.488806 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.488783 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-main-8235df-dockercfg-5sf8p\"" Nov 03 23:14:45.491087 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.491063 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2"] Nov 03 23:14:45.588769 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.588732 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.589464 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.589421 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhgkn\" (UniqueName: \"kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn\") pod \"payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.589632 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.589484 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n\") pod \"payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.589632 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.589586 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.589942 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.589924 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.599295 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.599259 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n\") pod \"payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.690929 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.690892 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhgkn\" (UniqueName: \"kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn\") pod \"payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.691149 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.690954 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.691691 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.691634 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.699536 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.699470 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhgkn\" (UniqueName: \"kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn\") pod \"payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:45.767602 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.767570 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:45.795340 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:45.795307 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:46.049436 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.049407 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b"] Nov 03 23:14:46.051502 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:14:46.051480 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9480ff7b_5073_47df_9228_a3524e0d3bdf.slice/crio-21edad3f0aa78ff50edd41b5661a10043190f11f6eb9eb0b98dc699feb9cb455 WatchSource:0}: Error finding container 21edad3f0aa78ff50edd41b5661a10043190f11f6eb9eb0b98dc699feb9cb455: Status 404 returned error can't find the container with id 21edad3f0aa78ff50edd41b5661a10043190f11f6eb9eb0b98dc699feb9cb455 Nov 03 23:14:46.087232 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.087211 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2"] Nov 03 23:14:46.099737 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:14:46.099710 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25990174_a394_488f_b1bd_51dd9f9c735f.slice/crio-f41cbeee66b600dc57b304360108f5619600bd8f5982ae19645e1c2617c2f344 WatchSource:0}: Error finding container f41cbeee66b600dc57b304360108f5619600bd8f5982ae19645e1c2617c2f344: Status 404 returned error can't find the container with id f41cbeee66b600dc57b304360108f5619600bd8f5982ae19645e1c2617c2f344 Nov 03 23:14:46.702817 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.702786 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" event={"ID":"25990174-a394-488f-b1bd-51dd9f9c735f","Type":"ContainerStarted","Data":"eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524"} Nov 03 23:14:46.703223 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.702836 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" event={"ID":"25990174-a394-488f-b1bd-51dd9f9c735f","Type":"ContainerStarted","Data":"f41cbeee66b600dc57b304360108f5619600bd8f5982ae19645e1c2617c2f344"} Nov 03 23:14:46.703223 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.702913 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:14:46.704440 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.704408 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" event={"ID":"9480ff7b-5073-47df-9228-a3524e0d3bdf","Type":"ContainerStarted","Data":"77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c"} Nov 03 23:14:46.704440 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.704442 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" event={"ID":"9480ff7b-5073-47df-9228-a3524e0d3bdf","Type":"ContainerStarted","Data":"21edad3f0aa78ff50edd41b5661a10043190f11f6eb9eb0b98dc699feb9cb455"} Nov 03 23:14:46.704622 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.704536 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:46.724203 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.724152 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" podStartSLOduration=1.724140985 podStartE2EDuration="1.724140985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:46.721370851 +0000 UTC m=+1388.498340041" watchObservedRunningTime="2026-11-03 23:14:46.724140985 +0000 UTC m=+1388.501110173" Nov 03 23:14:46.737077 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:46.737033 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" podStartSLOduration=1.73702068 podStartE2EDuration="1.73702068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:14:46.736077094 +0000 UTC m=+1388.513046285" watchObservedRunningTime="2026-11-03 23:14:46.73702068 +0000 UTC m=+1388.513989868" Nov 03 23:14:48.886876 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:14:48.886843 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:14:49.645520 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:49.645488 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:14:57.712007 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:57.711969 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:14:57.712520 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:14:57.712050 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:15:00.144763 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.144732 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg"] Nov 03 23:15:00.148098 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.148069 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.151482 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.151458 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246"] Nov 03 23:15:00.157257 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.155307 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.157257 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.157206 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg"] Nov 03 23:15:00.158158 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.158140 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:15:00.166322 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.164747 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246"] Nov 03 23:15:00.252971 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.252929 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895795-njcbg\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.253147 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.252978 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxdm\" (UniqueName: \"kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm\") pod \"maas-api-key-cleanup-29895795-njcbg\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.253147 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.253103 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9txd\" (UniqueName: \"kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd\") pod \"maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.253221 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.253159 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.353993 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.353952 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895795-njcbg\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.353993 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.353996 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxdm\" (UniqueName: \"kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm\") pod \"maas-api-key-cleanup-29895795-njcbg\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.354219 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.354019 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9txd\" (UniqueName: \"kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd\") pod \"maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.354219 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.354055 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.354685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.354644 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.354755 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.354736 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895795-njcbg\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.363455 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.363410 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxdm\" (UniqueName: \"kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm\") pod \"maas-api-key-cleanup-29895795-njcbg\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.363455 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.363438 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9txd\" (UniqueName: \"kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd\") pod \"maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.467513 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.467426 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:00.476735 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.476704 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:00.758616 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.758584 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg"] Nov 03 23:15:00.760736 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:15:00.760697 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c91a7b_0610_408a_a81f_7fbb8d5484dc.slice/crio-977d5d92597094eda730f813d772aaa606f7bbc418b0e82e9c43d52a0109366c WatchSource:0}: Error finding container 977d5d92597094eda730f813d772aaa606f7bbc418b0e82e9c43d52a0109366c: Status 404 returned error can't find the container with id 977d5d92597094eda730f813d772aaa606f7bbc418b0e82e9c43d52a0109366c Nov 03 23:15:00.775579 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.775553 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246"] Nov 03 23:15:00.777952 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:15:00.777921 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda031b67d_4392_496f_a127_4a7be4abcee3.slice/crio-1aa293a1dbad1c6a25a5f049fc7658ab8ce15818df1c2b9fb267aca268ff06f9 WatchSource:0}: Error finding container 1aa293a1dbad1c6a25a5f049fc7658ab8ce15818df1c2b9fb267aca268ff06f9: Status 404 returned error can't find the container with id 1aa293a1dbad1c6a25a5f049fc7658ab8ce15818df1c2b9fb267aca268ff06f9 Nov 03 23:15:00.783465 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:00.783442 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" event={"ID":"49c91a7b-0610-408a-a81f-7fbb8d5484dc","Type":"ContainerStarted","Data":"977d5d92597094eda730f813d772aaa606f7bbc418b0e82e9c43d52a0109366c"} Nov 03 23:15:01.790212 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:01.790177 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" event={"ID":"a031b67d-4392-496f-a127-4a7be4abcee3","Type":"ContainerStarted","Data":"1aa293a1dbad1c6a25a5f049fc7658ab8ce15818df1c2b9fb267aca268ff06f9"} Nov 03 23:15:03.614411 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:03.614369 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:15:04.816346 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:04.816252 6394 generic.go:356] "Generic (PLEG): container finished" podID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerID="974a47cd22d80606193a0d69e62b4737ac96b4feb7465d38e39006106f1ccc48" exitCode=60 Nov 03 23:15:04.816762 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:04.816334 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" event={"ID":"49c91a7b-0610-408a-a81f-7fbb8d5484dc","Type":"ContainerDied","Data":"974a47cd22d80606193a0d69e62b4737ac96b4feb7465d38e39006106f1ccc48"} Nov 03 23:15:04.816762 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:04.816573 6394 scope.go:122] "RemoveContainer" containerID="974a47cd22d80606193a0d69e62b4737ac96b4feb7465d38e39006106f1ccc48" Nov 03 23:15:04.817969 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:04.817945 6394 generic.go:356] "Generic (PLEG): container finished" podID="a031b67d-4392-496f-a127-4a7be4abcee3" containerID="81832a33bc2ff6b70401fcb8b0bfef50b89595b42c73ca36306505ca89529c28" exitCode=60 Nov 03 23:15:04.818089 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:04.817974 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" event={"ID":"a031b67d-4392-496f-a127-4a7be4abcee3","Type":"ContainerDied","Data":"81832a33bc2ff6b70401fcb8b0bfef50b89595b42c73ca36306505ca89529c28"} Nov 03 23:15:04.818258 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:04.818241 6394 scope.go:122] "RemoveContainer" containerID="81832a33bc2ff6b70401fcb8b0bfef50b89595b42c73ca36306505ca89529c28" Nov 03 23:15:05.825860 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.825831 6394 generic.go:356] "Generic (PLEG): container finished" podID="a031b67d-4392-496f-a127-4a7be4abcee3" containerID="6df69dd20ad468cbf23a39fac055accf7e28e1394eaa6c7fcfa227dedb8b49d4" exitCode=60 Nov 03 23:15:05.826309 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.825926 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" event={"ID":"a031b67d-4392-496f-a127-4a7be4abcee3","Type":"ContainerDied","Data":"6df69dd20ad468cbf23a39fac055accf7e28e1394eaa6c7fcfa227dedb8b49d4"} Nov 03 23:15:05.826309 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.825988 6394 scope.go:122] "RemoveContainer" containerID="81832a33bc2ff6b70401fcb8b0bfef50b89595b42c73ca36306505ca89529c28" Nov 03 23:15:05.826309 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.826211 6394 scope.go:122] "RemoveContainer" containerID="6df69dd20ad468cbf23a39fac055accf7e28e1394eaa6c7fcfa227dedb8b49d4" Nov 03 23:15:05.826491 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:05.826465 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246_odh-ai-gateway-infra(a031b67d-4392-496f-a127-4a7be4abcee3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" Nov 03 23:15:05.828032 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.828008 6394 generic.go:356] "Generic (PLEG): container finished" podID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerID="1a96c6d7ace5f51099ed6a337c7482805eda30ae0141bc19d6a2b0de6693c4d7" exitCode=60 Nov 03 23:15:05.828112 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.828039 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" event={"ID":"49c91a7b-0610-408a-a81f-7fbb8d5484dc","Type":"ContainerDied","Data":"1a96c6d7ace5f51099ed6a337c7482805eda30ae0141bc19d6a2b0de6693c4d7"} Nov 03 23:15:05.828277 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.828263 6394 scope.go:122] "RemoveContainer" containerID="1a96c6d7ace5f51099ed6a337c7482805eda30ae0141bc19d6a2b0de6693c4d7" Nov 03 23:15:05.828488 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:05.828466 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895795-njcbg_odh-ai-gateway-infra(49c91a7b-0610-408a-a81f-7fbb8d5484dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" Nov 03 23:15:05.837831 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:05.837808 6394 scope.go:122] "RemoveContainer" containerID="974a47cd22d80606193a0d69e62b4737ac96b4feb7465d38e39006106f1ccc48" Nov 03 23:15:06.835545 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:06.835513 6394 scope.go:122] "RemoveContainer" containerID="1a96c6d7ace5f51099ed6a337c7482805eda30ae0141bc19d6a2b0de6693c4d7" Nov 03 23:15:06.836014 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:06.835831 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895795-njcbg_odh-ai-gateway-infra(49c91a7b-0610-408a-a81f-7fbb8d5484dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" Nov 03 23:15:06.837071 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:06.837052 6394 scope.go:122] "RemoveContainer" containerID="6df69dd20ad468cbf23a39fac055accf7e28e1394eaa6c7fcfa227dedb8b49d4" Nov 03 23:15:06.837246 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:06.837228 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246_odh-ai-gateway-infra(a031b67d-4392-496f-a127-4a7be4abcee3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" Nov 03 23:15:18.341012 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:18.340975 6394 scope.go:122] "RemoveContainer" containerID="6df69dd20ad468cbf23a39fac055accf7e28e1394eaa6c7fcfa227dedb8b49d4" Nov 03 23:15:18.889586 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:18.889502 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:15:18.898559 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:18.898525 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" event={"ID":"a031b67d-4392-496f-a127-4a7be4abcee3","Type":"ContainerStarted","Data":"bae1020030fe15c4704114e195fd1459e3f32a546a5b3810deac4b9d7726d5e9"} Nov 03 23:15:18.916775 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:18.916712 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" podStartSLOduration=16.214830767 podStartE2EDuration="18.916699237s" totalImagesPullingTime="2.70186847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:15:18.914820375 +0000 UTC m=+1420.691789578" watchObservedRunningTime="2026-11-03 23:15:18.916699237 +0000 UTC m=+1420.693668426" Nov 03 23:15:19.909913 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:19.909877 6394 generic.go:356] "Generic (PLEG): container finished" podID="a031b67d-4392-496f-a127-4a7be4abcee3" containerID="bae1020030fe15c4704114e195fd1459e3f32a546a5b3810deac4b9d7726d5e9" exitCode=60 Nov 03 23:15:19.910384 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:19.909936 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" event={"ID":"a031b67d-4392-496f-a127-4a7be4abcee3","Type":"ContainerDied","Data":"bae1020030fe15c4704114e195fd1459e3f32a546a5b3810deac4b9d7726d5e9"} Nov 03 23:15:19.910384 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:19.909983 6394 scope.go:122] "RemoveContainer" containerID="6df69dd20ad468cbf23a39fac055accf7e28e1394eaa6c7fcfa227dedb8b49d4" Nov 03 23:15:19.910384 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:19.910307 6394 scope.go:122] "RemoveContainer" containerID="bae1020030fe15c4704114e195fd1459e3f32a546a5b3810deac4b9d7726d5e9" Nov 03 23:15:19.910608 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:19.910567 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246_odh-ai-gateway-infra(a031b67d-4392-496f-a127-4a7be4abcee3)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" Nov 03 23:15:19.924576 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:19.924552 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246"] Nov 03 23:15:20.020064 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:20.020032 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:15:20.338206 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:20.338176 6394 scope.go:122] "RemoveContainer" containerID="1a96c6d7ace5f51099ed6a337c7482805eda30ae0141bc19d6a2b0de6693c4d7" Nov 03 23:15:20.916935 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:20.916843 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" event={"ID":"49c91a7b-0610-408a-a81f-7fbb8d5484dc","Type":"ContainerStarted","Data":"311a4b4b62906ec735c65588437678e3dd1411fabe1c77480fdbf5a4d0dcbcd3"} Nov 03 23:15:20.934016 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:20.933959 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" podStartSLOduration=18.210408306 podStartE2EDuration="20.933940912s" totalImagesPullingTime="2.723532606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:15:20.93318574 +0000 UTC m=+1422.710154949" watchObservedRunningTime="2026-11-03 23:15:20.933940912 +0000 UTC m=+1422.710910103" Nov 03 23:15:21.072491 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.072464 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:21.152415 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.152385 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd\" (UniqueName: \"kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd\") pod \"a031b67d-4392-496f-a127-4a7be4abcee3\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " Nov 03 23:15:21.152578 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.152477 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca\") pod \"a031b67d-4392-496f-a127-4a7be4abcee3\" (UID: \"a031b67d-4392-496f-a127-4a7be4abcee3\") " Nov 03 23:15:21.152895 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.152873 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca" pod "a031b67d-4392-496f-a127-4a7be4abcee3" (UID: "a031b67d-4392-496f-a127-4a7be4abcee3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:15:21.154580 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.154553 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd" pod "a031b67d-4392-496f-a127-4a7be4abcee3" (UID: "a031b67d-4392-496f-a127-4a7be4abcee3"). InnerVolumeSpecName "kube-api-access-g9txd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:15:21.253582 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.253545 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a031b67d-4392-496f-a127-4a7be4abcee3-maas-api-service-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:21.253582 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.253578 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9txd\" (UniqueName: \"kubernetes.io/projected/a031b67d-4392-496f-a127-4a7be4abcee3-kube-api-access-g9txd\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:21.924614 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.924581 6394 generic.go:356] "Generic (PLEG): container finished" podID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerID="311a4b4b62906ec735c65588437678e3dd1411fabe1c77480fdbf5a4d0dcbcd3" exitCode=60 Nov 03 23:15:21.925117 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.924680 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" event={"ID":"49c91a7b-0610-408a-a81f-7fbb8d5484dc","Type":"ContainerDied","Data":"311a4b4b62906ec735c65588437678e3dd1411fabe1c77480fdbf5a4d0dcbcd3"} Nov 03 23:15:21.925117 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.924761 6394 scope.go:122] "RemoveContainer" containerID="1a96c6d7ace5f51099ed6a337c7482805eda30ae0141bc19d6a2b0de6693c4d7" Nov 03 23:15:21.925270 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.925138 6394 scope.go:122] "RemoveContainer" containerID="311a4b4b62906ec735c65588437678e3dd1411fabe1c77480fdbf5a4d0dcbcd3" Nov 03 23:15:21.925441 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:21.925418 6394 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895795-njcbg_odh-ai-gateway-infra(49c91a7b-0610-408a-a81f-7fbb8d5484dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" Nov 03 23:15:21.926028 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.925946 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" Nov 03 23:15:21.926028 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.925989 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246" event={"ID":"a031b67d-4392-496f-a127-4a7be4abcee3","Type":"ContainerDied","Data":"1aa293a1dbad1c6a25a5f049fc7658ab8ce15818df1c2b9fb267aca268ff06f9"} Nov 03 23:15:21.937283 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.937260 6394 scope.go:122] "RemoveContainer" containerID="bae1020030fe15c4704114e195fd1459e3f32a546a5b3810deac4b9d7726d5e9" Nov 03 23:15:21.952601 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.952560 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg"] Nov 03 23:15:21.956057 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.956033 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246"] Nov 03 23:15:21.964713 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:21.964683 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-main-70a7bf-29895795-rq246"] Nov 03 23:15:22.343278 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:22.343244 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" path="/var/lib/kubelet/pods/a031b67d-4392-496f-a127-4a7be4abcee3/volumes" Nov 03 23:15:23.081441 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.081408 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:23.171195 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.171162 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm\" (UniqueName: \"kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm\") pod \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " Nov 03 23:15:23.171387 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.171298 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca\") pod \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\" (UID: \"49c91a7b-0610-408a-a81f-7fbb8d5484dc\") " Nov 03 23:15:23.171696 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.171652 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca" pod "49c91a7b-0610-408a-a81f-7fbb8d5484dc" (UID: "49c91a7b-0610-408a-a81f-7fbb8d5484dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:15:23.173556 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.173534 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm" pod "49c91a7b-0610-408a-a81f-7fbb8d5484dc" (UID: "49c91a7b-0610-408a-a81f-7fbb8d5484dc"). InnerVolumeSpecName "kube-api-access-tvxdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:15:23.273194 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.273103 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c91a7b-0610-408a-a81f-7fbb8d5484dc-maas-api-service-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:23.273194 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.273137 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvxdm\" (UniqueName: \"kubernetes.io/projected/49c91a7b-0610-408a-a81f-7fbb8d5484dc-kube-api-access-tvxdm\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:23.939590 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.939561 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" Nov 03 23:15:23.939800 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.939558 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg" event={"ID":"49c91a7b-0610-408a-a81f-7fbb8d5484dc","Type":"ContainerDied","Data":"977d5d92597094eda730f813d772aaa606f7bbc418b0e82e9c43d52a0109366c"} Nov 03 23:15:23.939800 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.939722 6394 scope.go:122] "RemoveContainer" containerID="311a4b4b62906ec735c65588437678e3dd1411fabe1c77480fdbf5a4d0dcbcd3" Nov 03 23:15:23.962902 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.962869 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg"] Nov 03 23:15:23.967728 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:23.967706 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895795-njcbg"] Nov 03 23:15:24.343515 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:24.343483 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" path="/var/lib/kubelet/pods/49c91a7b-0610-408a-a81f-7fbb8d5484dc/volumes" Nov 03 23:15:35.825007 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.824973 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2"] Nov 03 23:15:35.825406 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825387 6394 cpu_manager.go:414] "containerMap: removing container" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:35.825406 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825398 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:35.825492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825408 6394 cpu_manager.go:414] "containerMap: removing container" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:35.825492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825414 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:35.825492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825427 6394 cpu_manager.go:414] "containerMap: removing container" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:35.825492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825431 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:35.825492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825455 6394 cpu_manager.go:414] "containerMap: removing container" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:35.825492 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825460 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:35.825680 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825522 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:35.825680 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825532 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:35.825680 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825537 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:35.825680 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.825546 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:35.828774 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.828758 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.836800 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.836775 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:15:35.836989 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.836799 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:15:35.838797 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.838774 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2"] Nov 03 23:15:35.896480 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.896443 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.896480 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.896487 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.896731 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.896626 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qdj\" (UniqueName: \"kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.997235 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.997203 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qdj\" (UniqueName: \"kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.997418 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.997270 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.997418 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.997291 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.997939 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.997919 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:35.999755 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:35.999733 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:36.005313 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:36.005278 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qdj\" (UniqueName: \"kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj\") pod \"maas-api-revoke-sub-10c34597-bmhm2\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:36.143422 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:36.143336 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:36.419064 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:36.419037 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2"] Nov 03 23:15:36.420840 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:15:36.420815 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3fabb5_42d4_433d_97b6_3609f3abc9b0.slice/crio-decbba4f6331035b7ab2149cf114face82b2b747102055d8f8eca6ab5e904d49 WatchSource:0}: Error finding container decbba4f6331035b7ab2149cf114face82b2b747102055d8f8eca6ab5e904d49: Status 404 returned error can't find the container with id decbba4f6331035b7ab2149cf114face82b2b747102055d8f8eca6ab5e904d49 Nov 03 23:15:37.004360 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:37.004271 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" event={"ID":"eb3fabb5-42d4-433d-97b6-3609f3abc9b0","Type":"ContainerStarted","Data":"fdd4d9473e72674aac443a2bd4af236e5800220f88d21203d57efbade4b7e16a"} Nov 03 23:15:37.004360 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:37.004343 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" event={"ID":"eb3fabb5-42d4-433d-97b6-3609f3abc9b0","Type":"ContainerStarted","Data":"decbba4f6331035b7ab2149cf114face82b2b747102055d8f8eca6ab5e904d49"} Nov 03 23:15:37.022612 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:37.022557 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" podStartSLOduration=2.022537537 podStartE2EDuration="2.022537537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:15:37.021095888 +0000 UTC m=+1438.798065076" watchObservedRunningTime="2026-11-03 23:15:37.022537537 +0000 UTC m=+1438.799506727" Nov 03 23:15:38.011121 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:38.011086 6394 generic.go:356] "Generic (PLEG): container finished" podID="eb3fabb5-42d4-433d-97b6-3609f3abc9b0" containerID="fdd4d9473e72674aac443a2bd4af236e5800220f88d21203d57efbade4b7e16a" exitCode=0 Nov 03 23:15:38.011539 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:38.011159 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" event={"ID":"eb3fabb5-42d4-433d-97b6-3609f3abc9b0","Type":"ContainerDied","Data":"fdd4d9473e72674aac443a2bd4af236e5800220f88d21203d57efbade4b7e16a"} Nov 03 23:15:39.158640 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.158615 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:39.227986 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.227950 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca\") pod \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " Nov 03 23:15:39.228192 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.228034 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj\" (UniqueName: \"kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj\") pod \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " Nov 03 23:15:39.228192 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.228103 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca\") pod \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\" (UID: \"eb3fabb5-42d4-433d-97b6-3609f3abc9b0\") " Nov 03 23:15:39.228453 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.228429 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca" pod "eb3fabb5-42d4-433d-97b6-3609f3abc9b0" (UID: "eb3fabb5-42d4-433d-97b6-3609f3abc9b0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:15:39.230419 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.230387 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj" pod "eb3fabb5-42d4-433d-97b6-3609f3abc9b0" (UID: "eb3fabb5-42d4-433d-97b6-3609f3abc9b0"). InnerVolumeSpecName "kube-api-access-z5qdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:15:39.230525 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.230438 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca" pod "eb3fabb5-42d4-433d-97b6-3609f3abc9b0" (UID: "eb3fabb5-42d4-433d-97b6-3609f3abc9b0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:15:39.329761 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.329731 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:39.329761 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.329759 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:39.329955 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:39.329769 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5qdj\" (UniqueName: \"kubernetes.io/projected/eb3fabb5-42d4-433d-97b6-3609f3abc9b0-kube-api-access-z5qdj\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:40.022079 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:40.022050 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" Nov 03 23:15:40.022280 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:40.022087 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-10c34597-bmhm2" event={"ID":"eb3fabb5-42d4-433d-97b6-3609f3abc9b0","Type":"ContainerDied","Data":"decbba4f6331035b7ab2149cf114face82b2b747102055d8f8eca6ab5e904d49"} Nov 03 23:15:40.022280 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:40.022131 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="decbba4f6331035b7ab2149cf114face82b2b747102055d8f8eca6ab5e904d49" Nov 03 23:15:48.295165 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295078 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls"] Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295511 6394 cpu_manager.go:414] "containerMap: removing container" podUID="eb3fabb5-42d4-433d-97b6-3609f3abc9b0" containerName="revoke-keys" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295523 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb3fabb5-42d4-433d-97b6-3609f3abc9b0" containerName="revoke-keys" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295542 6394 cpu_manager.go:414] "containerMap: removing container" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295547 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295560 6394 cpu_manager.go:414] "containerMap: removing container" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295565 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295625 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="49c91a7b-0610-408a-a81f-7fbb8d5484dc" containerName="cleanup" Nov 03 23:15:48.295638 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295638 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="a031b67d-4392-496f-a127-4a7be4abcee3" containerName="cleanup" Nov 03 23:15:48.295910 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.295644 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb3fabb5-42d4-433d-97b6-3609f3abc9b0" containerName="revoke-keys" Nov 03 23:15:48.299103 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.299087 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.305451 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.305067 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:15:48.305451 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.305131 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:15:48.305961 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.305943 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls"] Nov 03 23:15:48.424081 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.424041 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.424081 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.424085 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.424324 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.424106 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfgwp\" (UniqueName: \"kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.525580 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.525546 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.525806 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.525593 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.525806 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.525612 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfgwp\" (UniqueName: \"kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.526368 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.526330 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.528248 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.528220 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.533907 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.533883 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfgwp\" (UniqueName: \"kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp\") pod \"maas-api-revoke-sub-07e9e6f1-qlsls\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.613355 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.613318 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:48.853298 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.853258 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:15:48.886812 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:48.886780 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls"] Nov 03 23:15:48.893692 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:15:48.890619 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba66f12_febd_488b_b21b_c60642c42abd.slice/crio-895ffe43ecfedb1cb02ccd00b48f71a52755dc3a66717c2a80896665f6df8b4b WatchSource:0}: Error finding container 895ffe43ecfedb1cb02ccd00b48f71a52755dc3a66717c2a80896665f6df8b4b: Status 404 returned error can't find the container with id 895ffe43ecfedb1cb02ccd00b48f71a52755dc3a66717c2a80896665f6df8b4b Nov 03 23:15:48.896084 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:15:48.896046 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:15:49.067969 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:49.067928 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" event={"ID":"dba66f12-febd-488b-b21b-c60642c42abd","Type":"ContainerStarted","Data":"895ffe43ecfedb1cb02ccd00b48f71a52755dc3a66717c2a80896665f6df8b4b"} Nov 03 23:15:50.075299 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:50.075212 6394 generic.go:356] "Generic (PLEG): container finished" podID="dba66f12-febd-488b-b21b-c60642c42abd" containerID="ecae36e45022342a1593358339c681cc2ab025929e8ddf975c6b9e93951858f8" exitCode=0 Nov 03 23:15:50.075299 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:50.075288 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" event={"ID":"dba66f12-febd-488b-b21b-c60642c42abd","Type":"ContainerDied","Data":"ecae36e45022342a1593358339c681cc2ab025929e8ddf975c6b9e93951858f8"} Nov 03 23:15:51.217793 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.217765 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:51.362596 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.362510 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca\") pod \"dba66f12-febd-488b-b21b-c60642c42abd\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " Nov 03 23:15:51.362788 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.362606 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp\" (UniqueName: \"kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp\") pod \"dba66f12-febd-488b-b21b-c60642c42abd\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " Nov 03 23:15:51.362788 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.362650 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca\") pod \"dba66f12-febd-488b-b21b-c60642c42abd\" (UID: \"dba66f12-febd-488b-b21b-c60642c42abd\") " Nov 03 23:15:51.362928 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.362910 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca" pod "dba66f12-febd-488b-b21b-c60642c42abd" (UID: "dba66f12-febd-488b-b21b-c60642c42abd"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:15:51.364851 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.364815 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca" pod "dba66f12-febd-488b-b21b-c60642c42abd" (UID: "dba66f12-febd-488b-b21b-c60642c42abd"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:15:51.364851 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.364833 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp" pod "dba66f12-febd-488b-b21b-c60642c42abd" (UID: "dba66f12-febd-488b-b21b-c60642c42abd"). InnerVolumeSpecName "kube-api-access-vfgwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:15:51.464034 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.463990 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfgwp\" (UniqueName: \"kubernetes.io/projected/dba66f12-febd-488b-b21b-c60642c42abd-kube-api-access-vfgwp\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:51.464034 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.464027 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:51.464034 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:51.464041 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/dba66f12-febd-488b-b21b-c60642c42abd-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:15:52.087196 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:52.087163 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" Nov 03 23:15:52.087379 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:52.087193 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-07e9e6f1-qlsls" event={"ID":"dba66f12-febd-488b-b21b-c60642c42abd","Type":"ContainerDied","Data":"895ffe43ecfedb1cb02ccd00b48f71a52755dc3a66717c2a80896665f6df8b4b"} Nov 03 23:15:52.087379 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:52.087245 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="895ffe43ecfedb1cb02ccd00b48f71a52755dc3a66717c2a80896665f6df8b4b" Nov 03 23:15:58.576265 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.576226 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w"] Nov 03 23:15:58.576695 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.576646 6394 cpu_manager.go:414] "containerMap: removing container" podUID="dba66f12-febd-488b-b21b-c60642c42abd" containerName="revoke-keys" Nov 03 23:15:58.576695 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.576674 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dba66f12-febd-488b-b21b-c60642c42abd" containerName="revoke-keys" Nov 03 23:15:58.576773 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.576749 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="dba66f12-febd-488b-b21b-c60642c42abd" containerName="revoke-keys" Nov 03 23:15:58.579793 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.579778 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.586704 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.586676 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:15:58.586846 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.586720 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:15:58.587491 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.587468 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w"] Nov 03 23:15:58.643903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.643857 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.644105 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.643917 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzt8f\" (UniqueName: \"kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.644105 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.644062 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.744795 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.744758 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.744985 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.744826 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.744985 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.744855 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzt8f\" (UniqueName: \"kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.745527 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.745508 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.747348 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.747327 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.752784 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.752761 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzt8f\" (UniqueName: \"kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f\") pod \"maas-api-revoke-sub-88c33545-6574w\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:58.896452 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:58.896362 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:15:59.169047 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:59.168968 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w"] Nov 03 23:15:59.171674 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:15:59.171627 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3392ca03_1402_409d_93b2_2824f072c735.slice/crio-723d122bd6168a3092848a82afc431efc53cf4c437837c6e90fb93bcefc08646 WatchSource:0}: Error finding container 723d122bd6168a3092848a82afc431efc53cf4c437837c6e90fb93bcefc08646: Status 404 returned error can't find the container with id 723d122bd6168a3092848a82afc431efc53cf4c437837c6e90fb93bcefc08646 Nov 03 23:15:59.616462 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:15:59.616426 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:16:00.143804 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:00.143757 6394 generic.go:356] "Generic (PLEG): container finished" podID="3392ca03-1402-409d-93b2-2824f072c735" containerID="49b288d025b9a1d37cec728d01ac741b5c2df90f13debad63342637e57c26fee" exitCode=0 Nov 03 23:16:00.144010 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:00.143822 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" event={"ID":"3392ca03-1402-409d-93b2-2824f072c735","Type":"ContainerDied","Data":"49b288d025b9a1d37cec728d01ac741b5c2df90f13debad63342637e57c26fee"} Nov 03 23:16:00.144010 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:00.143876 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" event={"ID":"3392ca03-1402-409d-93b2-2824f072c735","Type":"ContainerStarted","Data":"723d122bd6168a3092848a82afc431efc53cf4c437837c6e90fb93bcefc08646"} Nov 03 23:16:01.550066 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.550033 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:16:01.708832 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.708789 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca\") pod \"3392ca03-1402-409d-93b2-2824f072c735\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " Nov 03 23:16:01.709003 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.708874 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f\" (UniqueName: \"kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f\") pod \"3392ca03-1402-409d-93b2-2824f072c735\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " Nov 03 23:16:01.709003 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.708932 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca\") pod \"3392ca03-1402-409d-93b2-2824f072c735\" (UID: \"3392ca03-1402-409d-93b2-2824f072c735\") " Nov 03 23:16:01.709299 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.709273 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca" pod "3392ca03-1402-409d-93b2-2824f072c735" (UID: "3392ca03-1402-409d-93b2-2824f072c735"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:16:01.711069 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.711039 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca" pod "3392ca03-1402-409d-93b2-2824f072c735" (UID: "3392ca03-1402-409d-93b2-2824f072c735"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:16:01.711187 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.711162 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f" pod "3392ca03-1402-409d-93b2-2824f072c735" (UID: "3392ca03-1402-409d-93b2-2824f072c735"). InnerVolumeSpecName "kube-api-access-fzt8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:16:01.809733 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.809626 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzt8f\" (UniqueName: \"kubernetes.io/projected/3392ca03-1402-409d-93b2-2824f072c735-kube-api-access-fzt8f\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:01.809733 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.809694 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3392ca03-1402-409d-93b2-2824f072c735-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:01.809733 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:01.809705 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3392ca03-1402-409d-93b2-2824f072c735-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:02.195781 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:02.191495 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" event={"ID":"3392ca03-1402-409d-93b2-2824f072c735","Type":"ContainerDied","Data":"723d122bd6168a3092848a82afc431efc53cf4c437837c6e90fb93bcefc08646"} Nov 03 23:16:02.195781 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:02.191561 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="723d122bd6168a3092848a82afc431efc53cf4c437837c6e90fb93bcefc08646" Nov 03 23:16:02.195781 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:02.191637 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-88c33545-6574w" Nov 03 23:16:08.778082 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.778049 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49"] Nov 03 23:16:08.778495 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.778481 6394 cpu_manager.go:414] "containerMap: removing container" podUID="3392ca03-1402-409d-93b2-2824f072c735" containerName="revoke-keys" Nov 03 23:16:08.778559 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.778495 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3392ca03-1402-409d-93b2-2824f072c735" containerName="revoke-keys" Nov 03 23:16:08.778604 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.778576 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="3392ca03-1402-409d-93b2-2824f072c735" containerName="revoke-keys" Nov 03 23:16:08.782011 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.781992 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.789961 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.789934 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:16:08.790416 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.790397 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:16:08.794612 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.794582 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49"] Nov 03 23:16:08.825885 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.825850 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l258\" (UniqueName: \"kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.826051 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.825979 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.826051 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.826006 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.927298 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.927256 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l258\" (UniqueName: \"kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.927488 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.927332 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.927488 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.927358 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.928142 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.928123 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.929885 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.929860 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:08.935982 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:08.935963 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l258\" (UniqueName: \"kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258\") pod \"maas-api-revoke-sub-ca78f09b-p2w49\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:09.096013 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:09.095981 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:09.376096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:09.376068 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49"] Nov 03 23:16:09.377618 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:16:09.377592 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ffe9c4a_b1a3_4c07_b755_29ae3f2030c9.slice/crio-0e9a27dabe50d25f8a3f5691eaf8aaa763ba45f7f4f0ba8f2bae43ad6c4b16c1 WatchSource:0}: Error finding container 0e9a27dabe50d25f8a3f5691eaf8aaa763ba45f7f4f0ba8f2bae43ad6c4b16c1: Status 404 returned error can't find the container with id 0e9a27dabe50d25f8a3f5691eaf8aaa763ba45f7f4f0ba8f2bae43ad6c4b16c1 Nov 03 23:16:10.236426 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:10.236397 6394 generic.go:356] "Generic (PLEG): container finished" podID="9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" containerID="affee416259133591e374c182826c86c99eb7786ab08123417b7f5804ca36954" exitCode=0 Nov 03 23:16:10.236792 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:10.236455 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" event={"ID":"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9","Type":"ContainerDied","Data":"affee416259133591e374c182826c86c99eb7786ab08123417b7f5804ca36954"} Nov 03 23:16:10.236792 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:10.236515 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" event={"ID":"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9","Type":"ContainerStarted","Data":"0e9a27dabe50d25f8a3f5691eaf8aaa763ba45f7f4f0ba8f2bae43ad6c4b16c1"} Nov 03 23:16:11.380846 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.380819 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:11.459494 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.459461 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca\") pod \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " Nov 03 23:16:11.459737 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.459531 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca\") pod \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " Nov 03 23:16:11.459737 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.459610 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258\" (UniqueName: \"kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258\") pod \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\" (UID: \"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9\") " Nov 03 23:16:11.459949 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.459920 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca" pod "9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" (UID: "9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:16:11.460224 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.460198 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:11.462494 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.462470 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258" pod "9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" (UID: "9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9"). InnerVolumeSpecName "kube-api-access-7l258". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:16:11.462577 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.462469 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca" pod "9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" (UID: "9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:16:11.561130 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.561042 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:11.561130 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:11.561076 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l258\" (UniqueName: \"kubernetes.io/projected/9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9-kube-api-access-7l258\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:12.247309 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:12.247273 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" event={"ID":"9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9","Type":"ContainerDied","Data":"0e9a27dabe50d25f8a3f5691eaf8aaa763ba45f7f4f0ba8f2bae43ad6c4b16c1"} Nov 03 23:16:12.247309 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:12.247312 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ca78f09b-p2w49" Nov 03 23:16:12.247538 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:12.247322 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e9a27dabe50d25f8a3f5691eaf8aaa763ba45f7f4f0ba8f2bae43ad6c4b16c1" Nov 03 23:16:18.887056 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:16:18.887021 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:16:18.992190 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:18.992151 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt"] Nov 03 23:16:18.992595 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:18.992582 6394 cpu_manager.go:414] "containerMap: removing container" podUID="9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" containerName="revoke-keys" Nov 03 23:16:18.992649 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:18.992595 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" containerName="revoke-keys" Nov 03 23:16:18.992718 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:18.992680 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9" containerName="revoke-keys" Nov 03 23:16:18.995905 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:18.995888 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.002169 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.002146 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:16:19.003766 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.003745 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:16:19.005971 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.005947 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt"] Nov 03 23:16:19.138541 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.138443 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.138865 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.138629 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.138865 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.138740 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccxx4\" (UniqueName: \"kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.240112 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.240076 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.240279 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.240126 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccxx4\" (UniqueName: \"kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.240279 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.240261 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.240754 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.240731 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.242924 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.242904 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.249383 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.249364 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccxx4\" (UniqueName: \"kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4\") pod \"maas-api-revoke-sub-ce2956b7-h9rzt\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.309853 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.309814 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:19.587006 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:19.586977 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt"] Nov 03 23:16:19.588910 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:16:19.588881 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9712202f_2705_4db9_93da_ec5824f99697.slice/crio-a8b68c8ae8f995d70e7419892dc223e3f5fa357e30d5f2081ab9c879e5ef12f3 WatchSource:0}: Error finding container a8b68c8ae8f995d70e7419892dc223e3f5fa357e30d5f2081ab9c879e5ef12f3: Status 404 returned error can't find the container with id a8b68c8ae8f995d70e7419892dc223e3f5fa357e30d5f2081ab9c879e5ef12f3 Nov 03 23:16:20.292007 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:20.291970 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" event={"ID":"9712202f-2705-4db9-93da-ec5824f99697","Type":"ContainerStarted","Data":"eaf8872c79e91de7e0c3924e24c13868872667507375320900513a54ca55165b"} Nov 03 23:16:20.292437 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:20.292032 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" event={"ID":"9712202f-2705-4db9-93da-ec5824f99697","Type":"ContainerStarted","Data":"a8b68c8ae8f995d70e7419892dc223e3f5fa357e30d5f2081ab9c879e5ef12f3"} Nov 03 23:16:20.308462 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:20.308409 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" podStartSLOduration=2.3083939620000002 podStartE2EDuration="2.308393962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:16:20.307597566 +0000 UTC m=+1482.084566754" watchObservedRunningTime="2026-11-03 23:16:20.308393962 +0000 UTC m=+1482.085363209" Nov 03 23:16:21.300077 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:21.300034 6394 generic.go:356] "Generic (PLEG): container finished" podID="9712202f-2705-4db9-93da-ec5824f99697" containerID="eaf8872c79e91de7e0c3924e24c13868872667507375320900513a54ca55165b" exitCode=0 Nov 03 23:16:21.300601 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:21.300077 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" event={"ID":"9712202f-2705-4db9-93da-ec5824f99697","Type":"ContainerDied","Data":"eaf8872c79e91de7e0c3924e24c13868872667507375320900513a54ca55165b"} Nov 03 23:16:22.710216 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.710186 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:22.714726 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.714695 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca\") pod \"9712202f-2705-4db9-93da-ec5824f99697\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " Nov 03 23:16:22.714877 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.714788 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca\") pod \"9712202f-2705-4db9-93da-ec5824f99697\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " Nov 03 23:16:22.714877 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.714833 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4\" (UniqueName: \"kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4\") pod \"9712202f-2705-4db9-93da-ec5824f99697\" (UID: \"9712202f-2705-4db9-93da-ec5824f99697\") " Nov 03 23:16:22.715129 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.715103 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca" pod "9712202f-2705-4db9-93da-ec5824f99697" (UID: "9712202f-2705-4db9-93da-ec5824f99697"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:16:22.715246 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.715227 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9712202f-2705-4db9-93da-ec5824f99697-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:22.717111 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.717081 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca" pod "9712202f-2705-4db9-93da-ec5824f99697" (UID: "9712202f-2705-4db9-93da-ec5824f99697"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:16:22.717243 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.717205 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4" pod "9712202f-2705-4db9-93da-ec5824f99697" (UID: "9712202f-2705-4db9-93da-ec5824f99697"). InnerVolumeSpecName "kube-api-access-ccxx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:16:22.816613 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.816569 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9712202f-2705-4db9-93da-ec5824f99697-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:22.816613 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:22.816607 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccxx4\" (UniqueName: \"kubernetes.io/projected/9712202f-2705-4db9-93da-ec5824f99697-kube-api-access-ccxx4\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:23.311046 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:23.311005 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" event={"ID":"9712202f-2705-4db9-93da-ec5824f99697","Type":"ContainerDied","Data":"a8b68c8ae8f995d70e7419892dc223e3f5fa357e30d5f2081ab9c879e5ef12f3"} Nov 03 23:16:23.311046 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:23.311042 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ce2956b7-h9rzt" Nov 03 23:16:23.311253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:23.311067 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8b68c8ae8f995d70e7419892dc223e3f5fa357e30d5f2081ab9c879e5ef12f3" Nov 03 23:16:29.282312 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.282280 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4"] Nov 03 23:16:29.282862 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.282845 6394 cpu_manager.go:414] "containerMap: removing container" podUID="9712202f-2705-4db9-93da-ec5824f99697" containerName="revoke-keys" Nov 03 23:16:29.282912 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.282864 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9712202f-2705-4db9-93da-ec5824f99697" containerName="revoke-keys" Nov 03 23:16:29.282958 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.282949 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="9712202f-2705-4db9-93da-ec5824f99697" containerName="revoke-keys" Nov 03 23:16:29.286024 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.286008 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.291096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.291069 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:16:29.292853 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.292806 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:16:29.293898 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.293641 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4"] Nov 03 23:16:29.406816 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.406772 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.406816 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.406819 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s87m\" (UniqueName: \"kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.407043 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.406910 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.508013 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.507976 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.508013 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.508016 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s87m\" (UniqueName: \"kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.508234 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.508045 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.508765 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.508742 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.510558 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.510519 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.516106 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.516084 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s87m\" (UniqueName: \"kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m\") pod \"maas-api-revoke-sub-53b8b738-7xwj4\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.601431 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.601399 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:29.874008 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:29.873981 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4"] Nov 03 23:16:29.876337 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:16:29.876313 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4488a9d_13e4_4320_aa60_200be2f5bb9f.slice/crio-ca4c82d332b00c95c9acb24e95f328ebd1ee2d6631675fedf88f8ad48d5fa4df WatchSource:0}: Error finding container ca4c82d332b00c95c9acb24e95f328ebd1ee2d6631675fedf88f8ad48d5fa4df: Status 404 returned error can't find the container with id ca4c82d332b00c95c9acb24e95f328ebd1ee2d6631675fedf88f8ad48d5fa4df Nov 03 23:16:30.345393 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:30.345357 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" event={"ID":"d4488a9d-13e4-4320-aa60-200be2f5bb9f","Type":"ContainerStarted","Data":"3a6a2f93b44e3689fba03b1fab189fe414bf0825032eda094c679fce4b431297"} Nov 03 23:16:30.345807 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:30.345419 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" event={"ID":"d4488a9d-13e4-4320-aa60-200be2f5bb9f","Type":"ContainerStarted","Data":"ca4c82d332b00c95c9acb24e95f328ebd1ee2d6631675fedf88f8ad48d5fa4df"} Nov 03 23:16:30.361467 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:30.361422 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" podStartSLOduration=1.361408194 podStartE2EDuration="1.361408194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:16:30.360956472 +0000 UTC m=+1492.137925680" watchObservedRunningTime="2026-11-03 23:16:30.361408194 +0000 UTC m=+1492.138377383" Nov 03 23:16:31.354678 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:31.354627 6394 generic.go:356] "Generic (PLEG): container finished" podID="d4488a9d-13e4-4320-aa60-200be2f5bb9f" containerID="3a6a2f93b44e3689fba03b1fab189fe414bf0825032eda094c679fce4b431297" exitCode=0 Nov 03 23:16:31.355188 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:31.354705 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" event={"ID":"d4488a9d-13e4-4320-aa60-200be2f5bb9f","Type":"ContainerDied","Data":"3a6a2f93b44e3689fba03b1fab189fe414bf0825032eda094c679fce4b431297"} Nov 03 23:16:32.802159 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.802123 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:32.901822 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.901772 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca\") pod \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " Nov 03 23:16:32.902207 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.902183 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca\") pod \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " Nov 03 23:16:32.902386 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.902366 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m\" (UniqueName: \"kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m\") pod \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\" (UID: \"d4488a9d-13e4-4320-aa60-200be2f5bb9f\") " Nov 03 23:16:32.905780 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.905747 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m" pod "d4488a9d-13e4-4320-aa60-200be2f5bb9f" (UID: "d4488a9d-13e4-4320-aa60-200be2f5bb9f"). InnerVolumeSpecName "kube-api-access-4s87m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:16:32.906049 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.906028 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca" pod "d4488a9d-13e4-4320-aa60-200be2f5bb9f" (UID: "d4488a9d-13e4-4320-aa60-200be2f5bb9f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:16:32.908053 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:32.908025 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca" pod "d4488a9d-13e4-4320-aa60-200be2f5bb9f" (UID: "d4488a9d-13e4-4320-aa60-200be2f5bb9f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:16:33.004411 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:33.004317 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:33.004411 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:33.004352 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4488a9d-13e4-4320-aa60-200be2f5bb9f-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:33.004411 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:33.004363 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s87m\" (UniqueName: \"kubernetes.io/projected/d4488a9d-13e4-4320-aa60-200be2f5bb9f-kube-api-access-4s87m\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:33.406466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:33.406422 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" event={"ID":"d4488a9d-13e4-4320-aa60-200be2f5bb9f","Type":"ContainerDied","Data":"ca4c82d332b00c95c9acb24e95f328ebd1ee2d6631675fedf88f8ad48d5fa4df"} Nov 03 23:16:33.406466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:33.406439 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53b8b738-7xwj4" Nov 03 23:16:33.406466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:33.406470 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca4c82d332b00c95c9acb24e95f328ebd1ee2d6631675fedf88f8ad48d5fa4df" Nov 03 23:16:40.547154 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:40.547116 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:16:42.882683 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:42.882259 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm"] Nov 03 23:16:48.888809 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:16:48.888771 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:16:49.043974 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.043937 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:16:49.913784 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.913737 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q"] Nov 03 23:16:49.914981 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.914954 6394 cpu_manager.go:414] "containerMap: removing container" podUID="d4488a9d-13e4-4320-aa60-200be2f5bb9f" containerName="revoke-keys" Nov 03 23:16:49.914981 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.914981 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4488a9d-13e4-4320-aa60-200be2f5bb9f" containerName="revoke-keys" Nov 03 23:16:49.915262 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.915245 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4488a9d-13e4-4320-aa60-200be2f5bb9f" containerName="revoke-keys" Nov 03 23:16:49.920945 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.920916 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q"] Nov 03 23:16:49.921267 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.921197 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:49.927529 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:49.927502 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-395bb97b-unmatched-kserve-self-signed-certs\"" Nov 03 23:16:50.020601 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.020553 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.020847 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.020718 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.020847 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.020796 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.020988 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.020906 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.021053 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.020993 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.021114 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.021060 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.122866 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.122824 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123075 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.122891 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123075 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.122961 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123075 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.123006 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123075 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.123061 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123331 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.123091 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123493 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.123464 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123581 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.123491 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.123741 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.123715 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.126246 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.126212 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.126409 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.126389 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.131457 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.131432 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk\") pod \"grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.238628 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.238518 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:50.552297 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:50.552270 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q"] Nov 03 23:16:51.548684 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:51.547549 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" event={"ID":"e09ce00d-5b36-4c93-9414-dc6723afd008","Type":"ContainerStarted","Data":"fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f"} Nov 03 23:16:51.548684 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:51.547616 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" event={"ID":"e09ce00d-5b36-4c93-9414-dc6723afd008","Type":"ContainerStarted","Data":"5c47405d79bb60ed86516ebea32d9466d242ca4a73513cd277d11e23218a25aa"} Nov 03 23:16:51.566685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:51.565138 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" podStartSLOduration=2.565119402 podStartE2EDuration="2.565119402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:16:51.564676363 +0000 UTC m=+1513.341645545" watchObservedRunningTime="2026-11-03 23:16:51.565119402 +0000 UTC m=+1513.342088597" Nov 03 23:16:52.253686 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:52.240935 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:16:56.898500 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:56.898459 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:16:57.984181 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:57.984138 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" podUID="22870719-3b8c-4fc5-a1f5-819f45449cf1" containerName="main" containerID="cri-o://14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63" gracePeriod=45 Nov 03 23:16:58.243453 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.243383 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:16:58.378584 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378549 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs\" (UniqueName: \"kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs\") pod \"22870719-3b8c-4fc5-a1f5-819f45449cf1\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " Nov 03 23:16:58.378584 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378590 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache\") pod \"22870719-3b8c-4fc5-a1f5-819f45449cf1\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " Nov 03 23:16:58.378872 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378615 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6\" (UniqueName: \"kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6\") pod \"22870719-3b8c-4fc5-a1f5-819f45449cf1\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " Nov 03 23:16:58.378872 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378725 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir\") pod \"22870719-3b8c-4fc5-a1f5-819f45449cf1\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " Nov 03 23:16:58.378872 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378747 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home\") pod \"22870719-3b8c-4fc5-a1f5-819f45449cf1\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " Nov 03 23:16:58.378872 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378809 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm\") pod \"22870719-3b8c-4fc5-a1f5-819f45449cf1\" (UID: \"22870719-3b8c-4fc5-a1f5-819f45449cf1\") " Nov 03 23:16:58.379096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.378911 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache" pod "22870719-3b8c-4fc5-a1f5-819f45449cf1" (UID: "22870719-3b8c-4fc5-a1f5-819f45449cf1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:16:58.379096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.379022 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home" pod "22870719-3b8c-4fc5-a1f5-819f45449cf1" (UID: "22870719-3b8c-4fc5-a1f5-819f45449cf1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:16:58.379096 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.379034 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir" pod "22870719-3b8c-4fc5-a1f5-819f45449cf1" (UID: "22870719-3b8c-4fc5-a1f5-819f45449cf1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:16:58.379253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.379182 6394 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-model-cache\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:58.379253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.379194 6394 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-tmp-dir\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:58.379253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.379203 6394 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-home\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:58.381093 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.381060 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm" pod "22870719-3b8c-4fc5-a1f5-819f45449cf1" (UID: "22870719-3b8c-4fc5-a1f5-819f45449cf1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:16:58.381222 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.381158 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs" pod "22870719-3b8c-4fc5-a1f5-819f45449cf1" (UID: "22870719-3b8c-4fc5-a1f5-819f45449cf1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:16:58.381222 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.381186 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6" pod "22870719-3b8c-4fc5-a1f5-819f45449cf1" (UID: "22870719-3b8c-4fc5-a1f5-819f45449cf1"). InnerVolumeSpecName "kube-api-access-hv2m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:16:58.479839 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.479807 6394 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22870719-3b8c-4fc5-a1f5-819f45449cf1-tls-certs\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:58.479839 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.479835 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv2m6\" (UniqueName: \"kubernetes.io/projected/22870719-3b8c-4fc5-a1f5-819f45449cf1-kube-api-access-hv2m6\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:58.479839 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.479845 6394 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22870719-3b8c-4fc5-a1f5-819f45449cf1-dshm\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:16:58.613357 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.613320 6394 generic.go:356] "Generic (PLEG): container finished" podID="22870719-3b8c-4fc5-a1f5-819f45449cf1" containerID="14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63" exitCode=0 Nov 03 23:16:58.613535 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.613370 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" Nov 03 23:16:58.613535 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.613409 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" event={"ID":"22870719-3b8c-4fc5-a1f5-819f45449cf1","Type":"ContainerDied","Data":"14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63"} Nov 03 23:16:58.613535 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.613454 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm" event={"ID":"22870719-3b8c-4fc5-a1f5-819f45449cf1","Type":"ContainerDied","Data":"a5a49ef95b6c0572bfe2b7b766f899b1841974fa48197a843680515b23ff9b54"} Nov 03 23:16:58.613535 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.613472 6394 scope.go:122] "RemoveContainer" containerID="14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63" Nov 03 23:16:58.625063 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.624940 6394 scope.go:122] "RemoveContainer" containerID="14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63" Nov 03 23:16:58.625401 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:16:58.625362 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63\": container with ID starting with 14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63 not found: ID does not exist" containerID="14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63" Nov 03 23:16:58.625477 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.625415 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63"} err="failed to get container status \"14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63\": rpc error: code = NotFound desc = could not find container \"14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63\": container with ID starting with 14f625d844444c0aec48efdc2429716f0c2a159b79ab04a3cc8608a4fd3a2a63 not found: ID does not exist" Nov 03 23:16:58.639412 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.639383 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm"] Nov 03 23:16:58.642296 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:16:58.642271 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-a485b453-unmatched-kserve-57c6dfb7cd-8vsqm"] Nov 03 23:17:00.239754 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:00.239710 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:17:00.252703 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:00.252646 6394 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:17:00.344418 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:00.344385 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="22870719-3b8c-4fc5-a1f5-819f45449cf1" path="/var/lib/kubelet/pods/22870719-3b8c-4fc5-a1f5-819f45449cf1/volumes" Nov 03 23:17:00.637749 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:00.637721 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:17:18.890079 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:17:18.889995 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:17:34.306120 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.306085 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj"] Nov 03 23:17:34.306817 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.306798 6394 cpu_manager.go:414] "containerMap: removing container" podUID="22870719-3b8c-4fc5-a1f5-819f45449cf1" containerName="main" Nov 03 23:17:34.306916 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.306820 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="22870719-3b8c-4fc5-a1f5-819f45449cf1" containerName="main" Nov 03 23:17:34.306978 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.306956 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="22870719-3b8c-4fc5-a1f5-819f45449cf1" containerName="main" Nov 03 23:17:34.310432 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.310405 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.314272 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.314246 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:17:34.316112 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.316077 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:17:34.317979 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.317947 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj"] Nov 03 23:17:34.432925 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.432878 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.433110 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.433029 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khsz\" (UniqueName: \"kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.433190 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.433172 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.534281 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.534250 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.534436 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.534304 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khsz\" (UniqueName: \"kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.534436 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.534356 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.535201 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.535175 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.536830 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.536805 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.542247 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.542225 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khsz\" (UniqueName: \"kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz\") pod \"maas-api-revoke-sub-53c20305-m5rhj\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.626313 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.626277 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:34.912030 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:34.912002 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj"] Nov 03 23:17:34.914210 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:17:34.914181 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f13c389_662c_48f1_837c_7a59240a99e0.slice/crio-8df5d30498443d2331e3bc8d2b857506bce835778db4fbc85b08caa7601544bb WatchSource:0}: Error finding container 8df5d30498443d2331e3bc8d2b857506bce835778db4fbc85b08caa7601544bb: Status 404 returned error can't find the container with id 8df5d30498443d2331e3bc8d2b857506bce835778db4fbc85b08caa7601544bb Nov 03 23:17:35.818214 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:35.818177 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" event={"ID":"8f13c389-662c-48f1-837c-7a59240a99e0","Type":"ContainerStarted","Data":"b4fbc4d0829f93673860bc67cfb07a91ff1afc8f63504a984ef196f3c446a4b7"} Nov 03 23:17:35.818636 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:35.818237 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" event={"ID":"8f13c389-662c-48f1-837c-7a59240a99e0","Type":"ContainerStarted","Data":"8df5d30498443d2331e3bc8d2b857506bce835778db4fbc85b08caa7601544bb"} Nov 03 23:17:35.835847 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:35.835804 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" podStartSLOduration=1.835789801 podStartE2EDuration="1.835789801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:17:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:17:35.834988951 +0000 UTC m=+1557.611958140" watchObservedRunningTime="2026-11-03 23:17:35.835789801 +0000 UTC m=+1557.612758989" Nov 03 23:17:36.825462 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:36.825421 6394 generic.go:356] "Generic (PLEG): container finished" podID="8f13c389-662c-48f1-837c-7a59240a99e0" containerID="b4fbc4d0829f93673860bc67cfb07a91ff1afc8f63504a984ef196f3c446a4b7" exitCode=0 Nov 03 23:17:36.825932 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:36.825510 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" event={"ID":"8f13c389-662c-48f1-837c-7a59240a99e0","Type":"ContainerDied","Data":"b4fbc4d0829f93673860bc67cfb07a91ff1afc8f63504a984ef196f3c446a4b7"} Nov 03 23:17:37.973671 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:37.973635 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:38.071616 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.071579 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca\") pod \"8f13c389-662c-48f1-837c-7a59240a99e0\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " Nov 03 23:17:38.071843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.071635 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz\" (UniqueName: \"kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz\") pod \"8f13c389-662c-48f1-837c-7a59240a99e0\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " Nov 03 23:17:38.071843 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.071750 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca\") pod \"8f13c389-662c-48f1-837c-7a59240a99e0\" (UID: \"8f13c389-662c-48f1-837c-7a59240a99e0\") " Nov 03 23:17:38.072117 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.072082 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca" pod "8f13c389-662c-48f1-837c-7a59240a99e0" (UID: "8f13c389-662c-48f1-837c-7a59240a99e0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:17:38.073967 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.073933 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca" pod "8f13c389-662c-48f1-837c-7a59240a99e0" (UID: "8f13c389-662c-48f1-837c-7a59240a99e0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:17:38.074071 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.074016 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz" pod "8f13c389-662c-48f1-837c-7a59240a99e0" (UID: "8f13c389-662c-48f1-837c-7a59240a99e0"). InnerVolumeSpecName "kube-api-access-5khsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:17:38.172975 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.172876 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:38.172975 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.172913 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5khsz\" (UniqueName: \"kubernetes.io/projected/8f13c389-662c-48f1-837c-7a59240a99e0-kube-api-access-5khsz\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:38.172975 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.172928 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8f13c389-662c-48f1-837c-7a59240a99e0-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:38.837891 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.837861 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" Nov 03 23:17:38.838074 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.837894 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-53c20305-m5rhj" event={"ID":"8f13c389-662c-48f1-837c-7a59240a99e0","Type":"ContainerDied","Data":"8df5d30498443d2331e3bc8d2b857506bce835778db4fbc85b08caa7601544bb"} Nov 03 23:17:38.838074 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:38.837944 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8df5d30498443d2331e3bc8d2b857506bce835778db4fbc85b08caa7601544bb" Nov 03 23:17:44.611854 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.611819 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh"] Nov 03 23:17:44.612337 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.612307 6394 cpu_manager.go:414] "containerMap: removing container" podUID="8f13c389-662c-48f1-837c-7a59240a99e0" containerName="revoke-keys" Nov 03 23:17:44.612337 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.612322 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f13c389-662c-48f1-837c-7a59240a99e0" containerName="revoke-keys" Nov 03 23:17:44.612418 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.612407 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f13c389-662c-48f1-837c-7a59240a99e0" containerName="revoke-keys" Nov 03 23:17:44.616931 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.616916 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.621466 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.621442 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:17:44.622952 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.622924 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:17:44.628967 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.627055 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh"] Nov 03 23:17:44.740311 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.740254 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql6sz\" (UniqueName: \"kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.740311 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.740322 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.740600 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.740436 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.841740 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.841698 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql6sz\" (UniqueName: \"kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.841925 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.841750 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.841925 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.841771 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.842389 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.842372 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.844397 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.844373 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.849724 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.849697 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql6sz\" (UniqueName: \"kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz\") pod \"maas-api-revoke-sub-154859f2-9hwrh\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:44.947506 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:44.947415 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:45.219560 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:45.219535 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh"] Nov 03 23:17:45.221522 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:17:45.221483 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400703c1_494b_4753_94fa_ee0762fd4ca4.slice/crio-cdc5f657f2f99fe81cfe3446894791556e5e95add0d25d8e62450e73fd771576 WatchSource:0}: Error finding container cdc5f657f2f99fe81cfe3446894791556e5e95add0d25d8e62450e73fd771576: Status 404 returned error can't find the container with id cdc5f657f2f99fe81cfe3446894791556e5e95add0d25d8e62450e73fd771576 Nov 03 23:17:45.877031 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:45.876994 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" event={"ID":"400703c1-494b-4753-94fa-ee0762fd4ca4","Type":"ContainerStarted","Data":"cb1dff0f80e6034abbb6cd3d660d4408337b10ded36128cea0609c6a53a6e072"} Nov 03 23:17:45.877520 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:45.877048 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" event={"ID":"400703c1-494b-4753-94fa-ee0762fd4ca4","Type":"ContainerStarted","Data":"cdc5f657f2f99fe81cfe3446894791556e5e95add0d25d8e62450e73fd771576"} Nov 03 23:17:45.895489 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:45.895440 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" podStartSLOduration=1.8954257079999999 podStartE2EDuration="1.895425708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:17:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:17:45.893298427 +0000 UTC m=+1567.670267615" watchObservedRunningTime="2026-11-03 23:17:45.895425708 +0000 UTC m=+1567.672394896" Nov 03 23:17:46.234623 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:46.234587 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:17:46.886153 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:46.886114 6394 generic.go:356] "Generic (PLEG): container finished" podID="400703c1-494b-4753-94fa-ee0762fd4ca4" containerID="cb1dff0f80e6034abbb6cd3d660d4408337b10ded36128cea0609c6a53a6e072" exitCode=0 Nov 03 23:17:46.886725 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:46.886192 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" event={"ID":"400703c1-494b-4753-94fa-ee0762fd4ca4","Type":"ContainerDied","Data":"cb1dff0f80e6034abbb6cd3d660d4408337b10ded36128cea0609c6a53a6e072"} Nov 03 23:17:48.285771 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.285734 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:48.394079 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.394039 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz\" (UniqueName: \"kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz\") pod \"400703c1-494b-4753-94fa-ee0762fd4ca4\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " Nov 03 23:17:48.397073 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.397046 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca\") pod \"400703c1-494b-4753-94fa-ee0762fd4ca4\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " Nov 03 23:17:48.397624 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.397602 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca\") pod \"400703c1-494b-4753-94fa-ee0762fd4ca4\" (UID: \"400703c1-494b-4753-94fa-ee0762fd4ca4\") " Nov 03 23:17:48.398557 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.398523 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca" pod "400703c1-494b-4753-94fa-ee0762fd4ca4" (UID: "400703c1-494b-4753-94fa-ee0762fd4ca4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:17:48.403685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.403372 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz" pod "400703c1-494b-4753-94fa-ee0762fd4ca4" (UID: "400703c1-494b-4753-94fa-ee0762fd4ca4"). InnerVolumeSpecName "kube-api-access-ql6sz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:17:48.403685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.403464 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca" pod "400703c1-494b-4753-94fa-ee0762fd4ca4" (UID: "400703c1-494b-4753-94fa-ee0762fd4ca4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:17:48.499186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.499075 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ql6sz\" (UniqueName: \"kubernetes.io/projected/400703c1-494b-4753-94fa-ee0762fd4ca4-kube-api-access-ql6sz\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:48.499186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.499119 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:48.499186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.499135 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/400703c1-494b-4753-94fa-ee0762fd4ca4-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:48.911461 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.911423 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" event={"ID":"400703c1-494b-4753-94fa-ee0762fd4ca4","Type":"ContainerDied","Data":"cdc5f657f2f99fe81cfe3446894791556e5e95add0d25d8e62450e73fd771576"} Nov 03 23:17:48.911694 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.911486 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdc5f657f2f99fe81cfe3446894791556e5e95add0d25d8e62450e73fd771576" Nov 03 23:17:48.911694 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:48.911541 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-154859f2-9hwrh" Nov 03 23:17:48.971709 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:17:48.941896 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:17:49.946890 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:49.946837 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-55s9l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:17:49.947478 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:49.946907 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-55s9l" podUID="64dd7ad4-183a-4f9b-8a77-d14636cffc3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:17:54.828422 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.828375 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6"] Nov 03 23:17:54.828870 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.828857 6394 cpu_manager.go:414] "containerMap: removing container" podUID="400703c1-494b-4753-94fa-ee0762fd4ca4" containerName="revoke-keys" Nov 03 23:17:54.828916 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.828872 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="400703c1-494b-4753-94fa-ee0762fd4ca4" containerName="revoke-keys" Nov 03 23:17:54.828990 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.828980 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="400703c1-494b-4753-94fa-ee0762fd4ca4" containerName="revoke-keys" Nov 03 23:17:54.832419 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.832404 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:54.836574 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.836544 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:17:54.838055 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.838036 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:17:54.852458 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.852423 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6"] Nov 03 23:17:54.917508 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.917470 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gprk\" (UniqueName: \"kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:54.917704 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.917531 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:54.917797 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:54.917702 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.018583 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.018532 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.018778 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.018618 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.018778 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.018690 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gprk\" (UniqueName: \"kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.019375 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.019349 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.021094 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.021075 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.027396 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.027370 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gprk\" (UniqueName: \"kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk\") pod \"maas-api-revoke-sub-2b791430-htvn6\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.154717 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.154616 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:55.429970 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:55.429938 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6"] Nov 03 23:17:55.435644 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:17:55.434910 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d2f022_5b09_41b8_8b2e_c92a0807791e.slice/crio-b1017b89d6a3dc1a22d5ca21343e4258937c43bb51ccac38ac3f4145f95ce8c3 WatchSource:0}: Error finding container b1017b89d6a3dc1a22d5ca21343e4258937c43bb51ccac38ac3f4145f95ce8c3: Status 404 returned error can't find the container with id b1017b89d6a3dc1a22d5ca21343e4258937c43bb51ccac38ac3f4145f95ce8c3 Nov 03 23:17:56.003236 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:56.003155 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" event={"ID":"d4d2f022-5b09-41b8-8b2e-c92a0807791e","Type":"ContainerStarted","Data":"cc37132866f8257463f0759c897cb41b33e2bb18e1149f96e5567b13be1a14a3"} Nov 03 23:17:56.003236 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:56.003205 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" event={"ID":"d4d2f022-5b09-41b8-8b2e-c92a0807791e","Type":"ContainerStarted","Data":"b1017b89d6a3dc1a22d5ca21343e4258937c43bb51ccac38ac3f4145f95ce8c3"} Nov 03 23:17:56.023933 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:56.023880 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" podStartSLOduration=2.023866396 podStartE2EDuration="2.023866396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:17:56.021893452 +0000 UTC m=+1577.798862642" watchObservedRunningTime="2026-11-03 23:17:56.023866396 +0000 UTC m=+1577.800835584" Nov 03 23:17:57.010118 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:57.010086 6394 generic.go:356] "Generic (PLEG): container finished" podID="d4d2f022-5b09-41b8-8b2e-c92a0807791e" containerID="cc37132866f8257463f0759c897cb41b33e2bb18e1149f96e5567b13be1a14a3" exitCode=0 Nov 03 23:17:57.010553 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:57.010176 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" event={"ID":"d4d2f022-5b09-41b8-8b2e-c92a0807791e","Type":"ContainerDied","Data":"cc37132866f8257463f0759c897cb41b33e2bb18e1149f96e5567b13be1a14a3"} Nov 03 23:17:58.150503 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.150476 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:17:58.252035 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.251996 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk\" (UniqueName: \"kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk\") pod \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " Nov 03 23:17:58.252219 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.252079 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca\") pod \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " Nov 03 23:17:58.252219 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.252119 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca\") pod \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\" (UID: \"d4d2f022-5b09-41b8-8b2e-c92a0807791e\") " Nov 03 23:17:58.252420 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.252397 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca" pod "d4d2f022-5b09-41b8-8b2e-c92a0807791e" (UID: "d4d2f022-5b09-41b8-8b2e-c92a0807791e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:17:58.254277 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.254254 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk" pod "d4d2f022-5b09-41b8-8b2e-c92a0807791e" (UID: "d4d2f022-5b09-41b8-8b2e-c92a0807791e"). InnerVolumeSpecName "kube-api-access-4gprk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:17:58.254363 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.254282 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca" pod "d4d2f022-5b09-41b8-8b2e-c92a0807791e" (UID: "d4d2f022-5b09-41b8-8b2e-c92a0807791e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:17:58.352866 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.352830 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:58.352866 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.352857 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gprk\" (UniqueName: \"kubernetes.io/projected/d4d2f022-5b09-41b8-8b2e-c92a0807791e-kube-api-access-4gprk\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:58.352866 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:58.352868 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d2f022-5b09-41b8-8b2e-c92a0807791e-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:17:59.022614 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:59.022569 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" event={"ID":"d4d2f022-5b09-41b8-8b2e-c92a0807791e","Type":"ContainerDied","Data":"b1017b89d6a3dc1a22d5ca21343e4258937c43bb51ccac38ac3f4145f95ce8c3"} Nov 03 23:17:59.022799 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:59.022636 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1017b89d6a3dc1a22d5ca21343e4258937c43bb51ccac38ac3f4145f95ce8c3" Nov 03 23:17:59.022799 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:17:59.022579 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2b791430-htvn6" Nov 03 23:18:05.039478 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.039441 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz"] Nov 03 23:18:05.039892 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.039884 6394 cpu_manager.go:414] "containerMap: removing container" podUID="d4d2f022-5b09-41b8-8b2e-c92a0807791e" containerName="revoke-keys" Nov 03 23:18:05.039950 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.039896 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4d2f022-5b09-41b8-8b2e-c92a0807791e" containerName="revoke-keys" Nov 03 23:18:05.039988 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.039977 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4d2f022-5b09-41b8-8b2e-c92a0807791e" containerName="revoke-keys" Nov 03 23:18:05.043253 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.043233 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.051382 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.051359 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:18:05.051588 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.051550 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:18:05.054120 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.054095 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz"] Nov 03 23:18:05.123497 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.123463 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.123713 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.123517 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.123819 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.123707 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66rbz\" (UniqueName: \"kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.225242 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.225199 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66rbz\" (UniqueName: \"kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.225416 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.225279 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.225416 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.225319 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.226122 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.226057 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.227955 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.227930 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.233817 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.233791 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66rbz\" (UniqueName: \"kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz\") pod \"maas-api-revoke-sub-d5160392-4xgnz\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.358537 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.358493 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:05.631697 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:05.631647 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz"] Nov 03 23:18:05.633578 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:18:05.633550 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf22e18_965a_46a1_a3f4_4074419a54ac.slice/crio-0b671eaa5e02f55c5727bccd225d3224ca9aaec4f1a8d30c087abe59f32022ba WatchSource:0}: Error finding container 0b671eaa5e02f55c5727bccd225d3224ca9aaec4f1a8d30c087abe59f32022ba: Status 404 returned error can't find the container with id 0b671eaa5e02f55c5727bccd225d3224ca9aaec4f1a8d30c087abe59f32022ba Nov 03 23:18:06.064291 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:06.064255 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" event={"ID":"bdf22e18-965a-46a1-a3f4-4074419a54ac","Type":"ContainerStarted","Data":"09be3d5e67134224674bf98f7e9b623eb40d1817b09f1e780d1786456e68afce"} Nov 03 23:18:06.064675 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:06.064318 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" event={"ID":"bdf22e18-965a-46a1-a3f4-4074419a54ac","Type":"ContainerStarted","Data":"0b671eaa5e02f55c5727bccd225d3224ca9aaec4f1a8d30c087abe59f32022ba"} Nov 03 23:18:06.081317 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:06.081276 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" podStartSLOduration=1.081261647 podStartE2EDuration="1.081261647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:18:06.080263482 +0000 UTC m=+1587.857232668" watchObservedRunningTime="2026-11-03 23:18:06.081261647 +0000 UTC m=+1587.858230854" Nov 03 23:18:07.073193 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:07.073153 6394 generic.go:356] "Generic (PLEG): container finished" podID="bdf22e18-965a-46a1-a3f4-4074419a54ac" containerID="09be3d5e67134224674bf98f7e9b623eb40d1817b09f1e780d1786456e68afce" exitCode=0 Nov 03 23:18:07.073610 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:07.073252 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" event={"ID":"bdf22e18-965a-46a1-a3f4-4074419a54ac","Type":"ContainerDied","Data":"09be3d5e67134224674bf98f7e9b623eb40d1817b09f1e780d1786456e68afce"} Nov 03 23:18:08.494391 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.494345 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:08.607138 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.607102 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz\" (UniqueName: \"kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz\") pod \"bdf22e18-965a-46a1-a3f4-4074419a54ac\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " Nov 03 23:18:08.607421 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.607400 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca\") pod \"bdf22e18-965a-46a1-a3f4-4074419a54ac\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " Nov 03 23:18:08.607779 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.607753 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca" pod "bdf22e18-965a-46a1-a3f4-4074419a54ac" (UID: "bdf22e18-965a-46a1-a3f4-4074419a54ac"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:18:08.607937 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.607918 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca\") pod \"bdf22e18-965a-46a1-a3f4-4074419a54ac\" (UID: \"bdf22e18-965a-46a1-a3f4-4074419a54ac\") " Nov 03 23:18:08.608358 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.608339 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:08.610284 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.610264 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca" pod "bdf22e18-965a-46a1-a3f4-4074419a54ac" (UID: "bdf22e18-965a-46a1-a3f4-4074419a54ac"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:18:08.611474 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.611454 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz" pod "bdf22e18-965a-46a1-a3f4-4074419a54ac" (UID: "bdf22e18-965a-46a1-a3f4-4074419a54ac"). InnerVolumeSpecName "kube-api-access-66rbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:18:08.709227 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.709146 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bdf22e18-965a-46a1-a3f4-4074419a54ac-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:08.709227 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:08.709172 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66rbz\" (UniqueName: \"kubernetes.io/projected/bdf22e18-965a-46a1-a3f4-4074419a54ac-kube-api-access-66rbz\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:09.102442 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:09.102409 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" Nov 03 23:18:09.102648 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:09.102446 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d5160392-4xgnz" event={"ID":"bdf22e18-965a-46a1-a3f4-4074419a54ac","Type":"ContainerDied","Data":"0b671eaa5e02f55c5727bccd225d3224ca9aaec4f1a8d30c087abe59f32022ba"} Nov 03 23:18:09.102648 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:09.102497 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b671eaa5e02f55c5727bccd225d3224ca9aaec4f1a8d30c087abe59f32022ba" Nov 03 23:18:09.644685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:09.641760 6394 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 23:18:09.644685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:09.641836 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-68cb9b4b95-4wxx9" podUID="0925a8a5-1874-43a7-826b-3ddc041e5f88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 23:18:15.246266 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.246230 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq"] Nov 03 23:18:15.246739 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.246718 6394 cpu_manager.go:414] "containerMap: removing container" podUID="bdf22e18-965a-46a1-a3f4-4074419a54ac" containerName="revoke-keys" Nov 03 23:18:15.246739 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.246731 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bdf22e18-965a-46a1-a3f4-4074419a54ac" containerName="revoke-keys" Nov 03 23:18:15.246828 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.246807 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="bdf22e18-965a-46a1-a3f4-4074419a54ac" containerName="revoke-keys" Nov 03 23:18:15.250152 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.250129 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.256592 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.256559 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 23:18:15.256758 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.256610 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-54hnx\"" Nov 03 23:18:15.260478 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.260452 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq"] Nov 03 23:18:15.265203 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.265168 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42lxp\" (UniqueName: \"kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.265356 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.265242 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.265484 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.265376 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.366725 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.366653 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42lxp\" (UniqueName: \"kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.366892 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.366752 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.366892 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.366813 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.367392 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.367360 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.369295 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.369267 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.378899 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.378875 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42lxp\" (UniqueName: \"kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp\") pod \"maas-api-revoke-sub-15ac438b-qltpq\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.567110 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.567003 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:15.842218 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:15.842191 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq"] Nov 03 23:18:15.844824 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:18:15.844787 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a0872e_0c78_4372_96dd_2b026fdfde6b.slice/crio-95285afcdd8fe1bd0097a427cd0f7b11663ddade82e49f2dbea70918ca4e55f3 WatchSource:0}: Error finding container 95285afcdd8fe1bd0097a427cd0f7b11663ddade82e49f2dbea70918ca4e55f3: Status 404 returned error can't find the container with id 95285afcdd8fe1bd0097a427cd0f7b11663ddade82e49f2dbea70918ca4e55f3 Nov 03 23:18:16.141768 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:16.141736 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" event={"ID":"72a0872e-0c78-4372-96dd-2b026fdfde6b","Type":"ContainerStarted","Data":"ffe215d5fd2d66cce82ed1fc0200bb1ab8676c32f5447b0556500b47b999ef84"} Nov 03 23:18:16.141895 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:16.141784 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" event={"ID":"72a0872e-0c78-4372-96dd-2b026fdfde6b","Type":"ContainerStarted","Data":"95285afcdd8fe1bd0097a427cd0f7b11663ddade82e49f2dbea70918ca4e55f3"} Nov 03 23:18:16.162255 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:16.162201 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" podStartSLOduration=1.162184297 podStartE2EDuration="1.162184297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:18:16.160442044 +0000 UTC m=+1597.937411245" watchObservedRunningTime="2026-11-03 23:18:16.162184297 +0000 UTC m=+1597.939153495" Nov 03 23:18:17.150570 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:17.150530 6394 generic.go:356] "Generic (PLEG): container finished" podID="72a0872e-0c78-4372-96dd-2b026fdfde6b" containerID="ffe215d5fd2d66cce82ed1fc0200bb1ab8676c32f5447b0556500b47b999ef84" exitCode=0 Nov 03 23:18:17.151124 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:17.150629 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" event={"ID":"72a0872e-0c78-4372-96dd-2b026fdfde6b","Type":"ContainerDied","Data":"ffe215d5fd2d66cce82ed1fc0200bb1ab8676c32f5447b0556500b47b999ef84"} Nov 03 23:18:18.636687 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.632861 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:18.710317 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.710250 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp\" (UniqueName: \"kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp\") pod \"72a0872e-0c78-4372-96dd-2b026fdfde6b\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " Nov 03 23:18:18.710515 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.710394 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca\") pod \"72a0872e-0c78-4372-96dd-2b026fdfde6b\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " Nov 03 23:18:18.710515 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.710443 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca\") pod \"72a0872e-0c78-4372-96dd-2b026fdfde6b\" (UID: \"72a0872e-0c78-4372-96dd-2b026fdfde6b\") " Nov 03 23:18:18.711020 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.710995 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca" pod "72a0872e-0c78-4372-96dd-2b026fdfde6b" (UID: "72a0872e-0c78-4372-96dd-2b026fdfde6b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:18:18.712994 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.712968 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca" pod "72a0872e-0c78-4372-96dd-2b026fdfde6b" (UID: "72a0872e-0c78-4372-96dd-2b026fdfde6b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:18:18.713106 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.713081 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp" pod "72a0872e-0c78-4372-96dd-2b026fdfde6b" (UID: "72a0872e-0c78-4372-96dd-2b026fdfde6b"). InnerVolumeSpecName "kube-api-access-42lxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:18:18.811628 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.811592 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-xks-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:18.811628 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.811621 6394 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/72a0872e-0c78-4372-96dd-2b026fdfde6b-maas-api-openshift-ca\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:18.811628 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:18.811632 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42lxp\" (UniqueName: \"kubernetes.io/projected/72a0872e-0c78-4372-96dd-2b026fdfde6b-kube-api-access-42lxp\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:18.919535 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:18:18.919441 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:18:19.206905 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:19.206825 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" Nov 03 23:18:19.206905 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:19.206834 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-15ac438b-qltpq" event={"ID":"72a0872e-0c78-4372-96dd-2b026fdfde6b","Type":"ContainerDied","Data":"95285afcdd8fe1bd0097a427cd0f7b11663ddade82e49f2dbea70918ca4e55f3"} Nov 03 23:18:19.206905 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:19.206885 6394 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95285afcdd8fe1bd0097a427cd0f7b11663ddade82e49f2dbea70918ca4e55f3" Nov 03 23:18:26.531652 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:26.531620 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:18:30.597275 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:30.597239 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q"] Nov 03 23:18:34.615119 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:34.615080 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:18:45.619279 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:45.619233 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" podUID="e09ce00d-5b36-4c93-9414-dc6723afd008" containerName="main" containerID="cri-o://fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f" gracePeriod=45 Nov 03 23:18:45.626596 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:45.626555 6394 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" podUID="e09ce00d-5b36-4c93-9414-dc6723afd008" containerName="main" probeResult="failure" output="Get \"https://10.134.0.61:8000/ready\": dial tcp 10.134.0.61:8000: connect: connection refused" Nov 03 23:18:45.888490 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:45.888464 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:18:46.083474 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083432 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk\") pod \"e09ce00d-5b36-4c93-9414-dc6723afd008\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " Nov 03 23:18:46.083474 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083476 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs\" (UniqueName: \"kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs\") pod \"e09ce00d-5b36-4c93-9414-dc6723afd008\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " Nov 03 23:18:46.083744 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083542 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir\") pod \"e09ce00d-5b36-4c93-9414-dc6723afd008\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " Nov 03 23:18:46.083744 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083594 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home\") pod \"e09ce00d-5b36-4c93-9414-dc6723afd008\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " Nov 03 23:18:46.083837 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083750 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache\") pod \"e09ce00d-5b36-4c93-9414-dc6723afd008\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " Nov 03 23:18:46.083837 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083800 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm\") pod \"e09ce00d-5b36-4c93-9414-dc6723afd008\" (UID: \"e09ce00d-5b36-4c93-9414-dc6723afd008\") " Nov 03 23:18:46.083920 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083885 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir" pod "e09ce00d-5b36-4c93-9414-dc6723afd008" (UID: "e09ce00d-5b36-4c93-9414-dc6723afd008"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:18:46.083981 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.083928 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home" pod "e09ce00d-5b36-4c93-9414-dc6723afd008" (UID: "e09ce00d-5b36-4c93-9414-dc6723afd008"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:18:46.084041 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.084007 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache" pod "e09ce00d-5b36-4c93-9414-dc6723afd008" (UID: "e09ce00d-5b36-4c93-9414-dc6723afd008"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:18:46.084184 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.084163 6394 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-tmp-dir\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:46.084184 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.084181 6394 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-home\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:46.084314 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.084190 6394 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-model-cache\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:46.085823 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.085799 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs" pod "e09ce00d-5b36-4c93-9414-dc6723afd008" (UID: "e09ce00d-5b36-4c93-9414-dc6723afd008"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 23:18:46.085903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.085804 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk" pod "e09ce00d-5b36-4c93-9414-dc6723afd008" (UID: "e09ce00d-5b36-4c93-9414-dc6723afd008"). InnerVolumeSpecName "kube-api-access-m9bnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:18:46.085981 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.085966 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm" pod "e09ce00d-5b36-4c93-9414-dc6723afd008" (UID: "e09ce00d-5b36-4c93-9414-dc6723afd008"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 23:18:46.185404 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.185322 6394 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e09ce00d-5b36-4c93-9414-dc6723afd008-dshm\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:46.185404 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.185352 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9bnk\" (UniqueName: \"kubernetes.io/projected/e09ce00d-5b36-4c93-9414-dc6723afd008-kube-api-access-m9bnk\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:46.185404 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.185362 6394 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e09ce00d-5b36-4c93-9414-dc6723afd008-tls-certs\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:18:46.460059 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.459974 6394 generic.go:356] "Generic (PLEG): container finished" podID="e09ce00d-5b36-4c93-9414-dc6723afd008" containerID="fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f" exitCode=0 Nov 03 23:18:46.460059 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.460021 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" Nov 03 23:18:46.460059 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.460030 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" event={"ID":"e09ce00d-5b36-4c93-9414-dc6723afd008","Type":"ContainerDied","Data":"fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f"} Nov 03 23:18:46.460282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.460065 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q" event={"ID":"e09ce00d-5b36-4c93-9414-dc6723afd008","Type":"ContainerDied","Data":"5c47405d79bb60ed86516ebea32d9466d242ca4a73513cd277d11e23218a25aa"} Nov 03 23:18:46.460282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.460085 6394 scope.go:122] "RemoveContainer" containerID="fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f" Nov 03 23:18:46.472467 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.472434 6394 scope.go:122] "RemoveContainer" containerID="fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f" Nov 03 23:18:46.472975 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:18:46.472950 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f\": container with ID starting with fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f not found: ID does not exist" containerID="fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f" Nov 03 23:18:46.473113 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.472983 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f"} err="failed to get container status \"fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f\": rpc error: code = NotFound desc = could not find container \"fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f\": container with ID starting with fc2e9e04bf610da1df9694e13474105ed447c51b807f3ec0cf20d4960e478b9f not found: ID does not exist" Nov 03 23:18:46.477429 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.477402 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q"] Nov 03 23:18:46.480373 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:46.480350 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-395bb97b-unmatched-kserve-7b88dd49ff-zhp7q"] Nov 03 23:18:48.343442 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:18:48.343364 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e09ce00d-5b36-4c93-9414-dc6723afd008" path="/var/lib/kubelet/pods/e09ce00d-5b36-4c93-9414-dc6723afd008/volumes" Nov 03 23:18:48.888220 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:18:48.888184 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:19:10.228301 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:10.228266 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:19:18.887848 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:19:18.887809 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:19:19.222125 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:19.222039 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b"] Nov 03 23:19:19.237445 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:19.237415 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2"] Nov 03 23:19:21.844868 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:21.844837 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-vf2qv"] Nov 03 23:19:24.222771 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.222700 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" podUID="9480ff7b-5073-47df-9228-a3524e0d3bdf" containerName="payload-processing" containerID="cri-o://77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c" gracePeriod=25 Nov 03 23:19:24.238273 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.238239 6394 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" podUID="25990174-a394-488f-b1bd-51dd9f9c735f" containerName="payload-pre-processing" containerID="cri-o://eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524" gracePeriod=25 Nov 03 23:19:24.488525 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.488466 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:19:24.516418 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.516389 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:19:24.560128 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.560096 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume\") pod \"9480ff7b-5073-47df-9228-a3524e0d3bdf\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " Nov 03 23:19:24.560307 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.560261 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n\") pod \"9480ff7b-5073-47df-9228-a3524e0d3bdf\" (UID: \"9480ff7b-5073-47df-9228-a3524e0d3bdf\") " Nov 03 23:19:24.560541 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.560518 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume" pod "9480ff7b-5073-47df-9228-a3524e0d3bdf" (UID: "9480ff7b-5073-47df-9228-a3524e0d3bdf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:24.560620 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.560597 6394 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9480ff7b-5073-47df-9228-a3524e0d3bdf-plugins-config-volume\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:24.562418 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.562395 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n" pod "9480ff7b-5073-47df-9228-a3524e0d3bdf" (UID: "9480ff7b-5073-47df-9228-a3524e0d3bdf"). InnerVolumeSpecName "kube-api-access-l7c6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:24.661854 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.661814 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn\" (UniqueName: \"kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn\") pod \"25990174-a394-488f-b1bd-51dd9f9c735f\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " Nov 03 23:19:24.662054 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.661864 6394 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume\") pod \"25990174-a394-488f-b1bd-51dd9f9c735f\" (UID: \"25990174-a394-488f-b1bd-51dd9f9c735f\") " Nov 03 23:19:24.662262 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.662243 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7c6n\" (UniqueName: \"kubernetes.io/projected/9480ff7b-5073-47df-9228-a3524e0d3bdf-kube-api-access-l7c6n\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:24.662322 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.662279 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume" pod "25990174-a394-488f-b1bd-51dd9f9c735f" (UID: "25990174-a394-488f-b1bd-51dd9f9c735f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 23:19:24.664163 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.664135 6394 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn" pod "25990174-a394-488f-b1bd-51dd9f9c735f" (UID: "25990174-a394-488f-b1bd-51dd9f9c735f"). InnerVolumeSpecName "kube-api-access-bhgkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 23:19:24.670059 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.670031 6394 generic.go:356] "Generic (PLEG): container finished" podID="25990174-a394-488f-b1bd-51dd9f9c735f" containerID="eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524" exitCode=0 Nov 03 23:19:24.670180 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.670077 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" Nov 03 23:19:24.670180 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.670111 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" event={"ID":"25990174-a394-488f-b1bd-51dd9f9c735f","Type":"ContainerDied","Data":"eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524"} Nov 03 23:19:24.670289 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.670180 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2" event={"ID":"25990174-a394-488f-b1bd-51dd9f9c735f","Type":"ContainerDied","Data":"f41cbeee66b600dc57b304360108f5619600bd8f5982ae19645e1c2617c2f344"} Nov 03 23:19:24.670289 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.670207 6394 scope.go:122] "RemoveContainer" containerID="eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524" Nov 03 23:19:24.671435 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.671417 6394 generic.go:356] "Generic (PLEG): container finished" podID="9480ff7b-5073-47df-9228-a3524e0d3bdf" containerID="77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c" exitCode=0 Nov 03 23:19:24.671500 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.671477 6394 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" Nov 03 23:19:24.671556 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.671500 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" event={"ID":"9480ff7b-5073-47df-9228-a3524e0d3bdf","Type":"ContainerDied","Data":"77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c"} Nov 03 23:19:24.671602 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.671553 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b" event={"ID":"9480ff7b-5073-47df-9228-a3524e0d3bdf","Type":"ContainerDied","Data":"21edad3f0aa78ff50edd41b5661a10043190f11f6eb9eb0b98dc699feb9cb455"} Nov 03 23:19:24.681766 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.681737 6394 scope.go:122] "RemoveContainer" containerID="eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524" Nov 03 23:19:24.682559 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:19:24.682529 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524\": container with ID starting with eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524 not found: ID does not exist" containerID="eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524" Nov 03 23:19:24.683295 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.682569 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524"} err="failed to get container status \"eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524\": rpc error: code = NotFound desc = could not find container \"eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524\": container with ID starting with eb8f4719bff3238b88e7459099bccb015ee0369cb57aa754b7767d9c6cb2e524 not found: ID does not exist" Nov 03 23:19:24.683295 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.682591 6394 scope.go:122] "RemoveContainer" containerID="77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c" Nov 03 23:19:24.696158 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.696126 6394 scope.go:122] "RemoveContainer" containerID="77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c" Nov 03 23:19:24.696598 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:19:24.696575 6394 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c\": container with ID starting with 77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c not found: ID does not exist" containerID="77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c" Nov 03 23:19:24.696684 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.696610 6394 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c"} err="failed to get container status \"77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c\": rpc error: code = NotFound desc = could not find container \"77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c\": container with ID starting with 77bb86dd478aa4071a59797d7f398f6d0cc592ffb1875796e57cbfb180c4685c not found: ID does not exist" Nov 03 23:19:24.697532 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.697513 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2"] Nov 03 23:19:24.700936 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.700914 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-8235df-6854bffd47bmbx2"] Nov 03 23:19:24.711268 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.711239 6394 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b"] Nov 03 23:19:24.714964 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.714942 6394 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-main-8235df-565c44d86-hsh9b"] Nov 03 23:19:24.763628 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.763550 6394 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhgkn\" (UniqueName: \"kubernetes.io/projected/25990174-a394-488f-b1bd-51dd9f9c735f-kube-api-access-bhgkn\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:24.763628 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:24.763582 6394 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25990174-a394-488f-b1bd-51dd9f9c735f-plugins-config-volume\") on node \"ip-10-0-128-124.us-east-2.compute.internal\" DevicePath \"\"" Nov 03 23:19:26.344270 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:26.344238 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25990174-a394-488f-b1bd-51dd9f9c735f" path="/var/lib/kubelet/pods/25990174-a394-488f-b1bd-51dd9f9c735f/volumes" Nov 03 23:19:26.344698 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:26.344683 6394 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9480ff7b-5073-47df-9228-a3524e0d3bdf" path="/var/lib/kubelet/pods/9480ff7b-5073-47df-9228-a3524e0d3bdf/volumes" Nov 03 23:19:27.453579 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:27.453543 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6469b954d7-sd82d_e8763ba9-780a-4051-9595-5b957caa0ea0/authorino/0.log" Nov 03 23:19:41.041364 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:41.041327 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-07e9e6f1-qlsls_dba66f12-febd-488b-b21b-c60642c42abd/revoke-keys/0.log" Nov 03 23:19:41.207389 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:41.207360 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-10c34597-bmhm2_eb3fabb5-42d4-433d-97b6-3609f3abc9b0/revoke-keys/0.log" Nov 03 23:19:41.376367 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:41.376317 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-154859f2-9hwrh_400703c1-494b-4753-94fa-ee0762fd4ca4/revoke-keys/0.log" Nov 03 23:19:41.549526 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:41.549493 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-15ac438b-qltpq_72a0872e-0c78-4372-96dd-2b026fdfde6b/revoke-keys/0.log" Nov 03 23:19:41.706811 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:41.706728 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-2b791430-htvn6_d4d2f022-5b09-41b8-8b2e-c92a0807791e/revoke-keys/0.log" Nov 03 23:19:41.875264 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:41.875239 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-53b8b738-7xwj4_d4488a9d-13e4-4320-aa60-200be2f5bb9f/revoke-keys/0.log" Nov 03 23:19:42.041984 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:42.041891 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-53c20305-m5rhj_8f13c389-662c-48f1-837c-7a59240a99e0/revoke-keys/0.log" Nov 03 23:19:42.206987 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:42.206954 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-88c33545-6574w_3392ca03-1402-409d-93b2-2824f072c735/revoke-keys/0.log" Nov 03 23:19:42.370343 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:42.370310 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ca78f09b-p2w49_9ffe9c4a-b1a3-4c07-b755-29ae3f2030c9/revoke-keys/0.log" Nov 03 23:19:42.537457 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:42.537428 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ce2956b7-h9rzt_9712202f-2705-4db9-93da-ec5824f99697/revoke-keys/0.log" Nov 03 23:19:42.717255 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:42.717178 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d5160392-4xgnz_bdf22e18-965a-46a1-a3f4-4074419a54ac/revoke-keys/0.log" Nov 03 23:19:42.874516 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:42.874485 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-qkckr_8deafbb8-884d-432d-94df-6a4be72d6492/postgres/0.log" Nov 03 23:19:44.643599 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:44.643569 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6469b954d7-sd82d_e8763ba9-780a-4051-9595-5b957caa0ea0/authorino/0.log" Nov 03 23:19:44.859501 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:44.859475 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbm7v_2afd1042-9056-4440-92f1-d00ce5ec38ae/manager/0.log" Nov 03 23:19:45.666641 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:45.666612 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vf2qv_b70baa2b-2aa3-4860-9ca7-a174a932839f/limitador/0.log" Nov 03 23:19:45.858570 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:45.858535 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-xgxbq_2a92bfd0-105a-4b00-a171-bf0fadd6b412/manager/0.log" Nov 03 23:19:47.457819 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:47.457780 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-4wxx9_0925a8a5-1874-43a7-826b-3ddc041e5f88/istio-proxy/0.log" Nov 03 23:19:47.641983 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:47.641950 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-55s9l_64dd7ad4-183a-4f9b-8a77-d14636cffc3b/istio-proxy/0.log" Nov 03 23:19:48.162608 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:48.162578 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-g9ntf_dfbbce52-065b-4a15-9b5e-9cc5542b8101/istio-proxy/0.log" Nov 03 23:19:48.887365 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:19:48.887329 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:19:49.564193 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:49.564155 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-59ml8_5ba53a6a-4b41-4970-9f27-244c7cef856d/payload-processing/0.log" Nov 03 23:19:50.834585 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:50.834549 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-cd4dt_9c350b17-8658-47f0-a1f4-d83f0f1c9740/main/0.log" Nov 03 23:19:51.396559 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:51.396530 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-bcnjr_a2ca3f5e-fc96-4457-8bda-a5a2b8fc0463/main/0.log" Nov 03 23:19:51.779282 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:51.779200 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-6q4sf_0ee13325-c9e5-4304-b9f3-dc6f5987103e/main/0.log" Nov 03 23:19:51.955696 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:51.955670 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-9d645_3be911c1-1b8f-445e-981f-9a4da893d65d/main/0.log" Nov 03 23:19:52.140319 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:19:52.140280 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-w8fvn_ff9f5b44-2ce4-4dc5-9fac-1331a4e75862/main/0.log" Nov 03 23:20:02.424231 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424189 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-97w7c/must-gather-w96lk"] Nov 03 23:20:02.424627 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424615 6394 cpu_manager.go:414] "containerMap: removing container" podUID="72a0872e-0c78-4372-96dd-2b026fdfde6b" containerName="revoke-keys" Nov 03 23:20:02.424698 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424630 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72a0872e-0c78-4372-96dd-2b026fdfde6b" containerName="revoke-keys" Nov 03 23:20:02.424698 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424640 6394 cpu_manager.go:414] "containerMap: removing container" podUID="9480ff7b-5073-47df-9228-a3524e0d3bdf" containerName="payload-processing" Nov 03 23:20:02.424698 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424646 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9480ff7b-5073-47df-9228-a3524e0d3bdf" containerName="payload-processing" Nov 03 23:20:02.424698 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424681 6394 cpu_manager.go:414] "containerMap: removing container" podUID="e09ce00d-5b36-4c93-9414-dc6723afd008" containerName="main" Nov 03 23:20:02.424698 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424689 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e09ce00d-5b36-4c93-9414-dc6723afd008" containerName="main" Nov 03 23:20:02.424903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424718 6394 cpu_manager.go:414] "containerMap: removing container" podUID="25990174-a394-488f-b1bd-51dd9f9c735f" containerName="payload-pre-processing" Nov 03 23:20:02.424903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424726 6394 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25990174-a394-488f-b1bd-51dd9f9c735f" containerName="payload-pre-processing" Nov 03 23:20:02.424903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424815 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="9480ff7b-5073-47df-9228-a3524e0d3bdf" containerName="payload-processing" Nov 03 23:20:02.424903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424826 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="e09ce00d-5b36-4c93-9414-dc6723afd008" containerName="main" Nov 03 23:20:02.424903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424834 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="25990174-a394-488f-b1bd-51dd9f9c735f" containerName="payload-pre-processing" Nov 03 23:20:02.424903 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.424843 6394 memory_manager.go:365] "RemoveStaleState removing state" podUID="72a0872e-0c78-4372-96dd-2b026fdfde6b" containerName="revoke-keys" Nov 03 23:20:02.428172 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.428154 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.433184 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.433159 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-97w7c\"/\"kube-root-ca.crt\"" Nov 03 23:20:02.433184 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.433182 6394 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-97w7c\"/\"openshift-service-ca.crt\"" Nov 03 23:20:02.434755 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.434731 6394 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-97w7c\"/\"default-dockercfg-hphws\"" Nov 03 23:20:02.436279 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.436255 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-97w7c/must-gather-w96lk"] Nov 03 23:20:02.487180 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.487142 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqp6\" (UniqueName: \"kubernetes.io/projected/d2558494-9d5b-432b-8f62-1e6268650f08-kube-api-access-bvqp6\") pod \"must-gather-w96lk\" (UID: \"d2558494-9d5b-432b-8f62-1e6268650f08\") " pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.487363 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.487198 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2558494-9d5b-432b-8f62-1e6268650f08-must-gather-output\") pod \"must-gather-w96lk\" (UID: \"d2558494-9d5b-432b-8f62-1e6268650f08\") " pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.588708 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.588670 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqp6\" (UniqueName: \"kubernetes.io/projected/d2558494-9d5b-432b-8f62-1e6268650f08-kube-api-access-bvqp6\") pod \"must-gather-w96lk\" (UID: \"d2558494-9d5b-432b-8f62-1e6268650f08\") " pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.588874 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.588723 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2558494-9d5b-432b-8f62-1e6268650f08-must-gather-output\") pod \"must-gather-w96lk\" (UID: \"d2558494-9d5b-432b-8f62-1e6268650f08\") " pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.589079 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.589059 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d2558494-9d5b-432b-8f62-1e6268650f08-must-gather-output\") pod \"must-gather-w96lk\" (UID: \"d2558494-9d5b-432b-8f62-1e6268650f08\") " pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.598711 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.598668 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqp6\" (UniqueName: \"kubernetes.io/projected/d2558494-9d5b-432b-8f62-1e6268650f08-kube-api-access-bvqp6\") pod \"must-gather-w96lk\" (UID: \"d2558494-9d5b-432b-8f62-1e6268650f08\") " pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:02.743075 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:02.742990 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-97w7c/must-gather-w96lk" Nov 03 23:20:03.016877 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:03.016851 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-97w7c/must-gather-w96lk"] Nov 03 23:20:03.018924 ip-10-0-128-124 kubenswrapper[6394]: W1103 23:20:03.018896 6394 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2558494_9d5b_432b_8f62_1e6268650f08.slice/crio-9e9a94c249cae91c940cc61d4c96e565aa881e13b0ab285c40bee8de8918521b WatchSource:0}: Error finding container 9e9a94c249cae91c940cc61d4c96e565aa881e13b0ab285c40bee8de8918521b: Status 404 returned error can't find the container with id 9e9a94c249cae91c940cc61d4c96e565aa881e13b0ab285c40bee8de8918521b Nov 03 23:20:03.020733 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:03.020717 6394 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 23:20:03.887861 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:03.887834 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/must-gather-w96lk" event={"ID":"d2558494-9d5b-432b-8f62-1e6268650f08","Type":"ContainerStarted","Data":"d4206d444aab1eb8ea08836b43604f56fdbabae5e3f38b19420920adfeda09f4"} Nov 03 23:20:03.888201 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:03.887880 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/must-gather-w96lk" event={"ID":"d2558494-9d5b-432b-8f62-1e6268650f08","Type":"ContainerStarted","Data":"9e9a94c249cae91c940cc61d4c96e565aa881e13b0ab285c40bee8de8918521b"} Nov 03 23:20:04.902245 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:04.902037 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/must-gather-w96lk" event={"ID":"d2558494-9d5b-432b-8f62-1e6268650f08","Type":"ContainerStarted","Data":"841a00f36b251c4b2dff99c731e7e3be9dfe79b97eaa0d90779ed811b7b39a6f"} Nov 03 23:20:04.922209 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:04.922161 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-97w7c/must-gather-w96lk" podStartSLOduration=2.1668278499999998 podStartE2EDuration="2.922147671s" totalImagesPullingTime="755.319821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 23:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:20:04.920514334 +0000 UTC m=+1706.697483524" watchObservedRunningTime="2026-11-03 23:20:04.922147671 +0000 UTC m=+1706.699116859" Nov 03 23:20:05.422675 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:05.422626 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8bw5x_e57657f7-583c-49a4-8b97-c8e7980a95ae/global-pull-secret-syncer/0.log" Nov 03 23:20:05.691754 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:05.691685 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tkqg4_67cf6892-73a4-43fb-9126-b8226bb5406d/konnectivity-agent/0.log" Nov 03 23:20:05.717032 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:05.717005 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-124.us-east-2.compute.internal_933c853ec2aff1af9a557fa27b9770d1/haproxy/0.log" Nov 03 23:20:12.257840 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:12.257803 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6469b954d7-sd82d_e8763ba9-780a-4051-9595-5b957caa0ea0/authorino/0.log" Nov 03 23:20:12.304435 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:12.304399 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbm7v_2afd1042-9056-4440-92f1-d00ce5ec38ae/manager/0.log" Nov 03 23:20:12.473552 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:12.473520 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vf2qv_b70baa2b-2aa3-4860-9ca7-a174a932839f/limitador/0.log" Nov 03 23:20:12.536512 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:12.536433 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-xgxbq_2a92bfd0-105a-4b00-a171-bf0fadd6b412/manager/0.log" Nov 03 23:20:13.978759 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:13.978729 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/alertmanager/0.log" Nov 03 23:20:13.982735 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:13.982704 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-4wxx9_0925a8a5-1874-43a7-826b-3ddc041e5f88/istio-proxy/0.log" Nov 03 23:20:14.004270 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.004058 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-55s9l_64dd7ad4-183a-4f9b-8a77-d14636cffc3b/istio-proxy/0.log" Nov 03 23:20:14.010744 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.009958 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/config-reloader/0.log" Nov 03 23:20:14.043323 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.043299 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/kube-rbac-proxy-web/0.log" Nov 03 23:20:14.065170 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.065134 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-g9ntf_dfbbce52-065b-4a15-9b5e-9cc5542b8101/istio-proxy/0.log" Nov 03 23:20:14.068238 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.068140 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/kube-rbac-proxy/0.log" Nov 03 23:20:14.106370 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.106345 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/kube-rbac-proxy-metric/0.log" Nov 03 23:20:14.126046 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.126013 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/prom-label-proxy/0.log" Nov 03 23:20:14.153148 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.153114 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_65e0beed-cf3c-4cbd-ae79-34dacd82f0c2/init-config-reloader/0.log" Nov 03 23:20:14.217063 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.217033 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-59ml8_5ba53a6a-4b41-4970-9f27-244c7cef856d/payload-processing/0.log" Nov 03 23:20:14.307072 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.306733 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-676d8c84bc-qzgxz_59f436cf-187c-4753-b7b7-54da03201b6f/metrics-server/0.log" Nov 03 23:20:14.389382 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.389357 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6stm_b158d189-1bc5-4434-a09d-960b03d52bde/node-exporter/0.log" Nov 03 23:20:14.414259 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.414218 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6stm_b158d189-1bc5-4434-a09d-960b03d52bde/kube-rbac-proxy/0.log" Nov 03 23:20:14.437398 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.437366 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6stm_b158d189-1bc5-4434-a09d-960b03d52bde/init-textfile/0.log" Nov 03 23:20:14.643874 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.643845 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-5nbpb_911290aa-0ddf-43ed-a72b-c5a96b98217b/kube-rbac-proxy-main/0.log" Nov 03 23:20:14.680052 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.680025 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-5nbpb_911290aa-0ddf-43ed-a72b-c5a96b98217b/kube-rbac-proxy-self/0.log" Nov 03 23:20:14.704629 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:14.704573 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-5nbpb_911290aa-0ddf-43ed-a72b-c5a96b98217b/openshift-state-metrics/0.log" Nov 03 23:20:15.045697 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.045542 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b88c98b8d-8q86r_22cc7343-fce6-4f53-a3a7-096f9cdadb14/telemeter-client/0.log" Nov 03 23:20:15.071075 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.071048 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b88c98b8d-8q86r_22cc7343-fce6-4f53-a3a7-096f9cdadb14/reload/0.log" Nov 03 23:20:15.098359 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.098330 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b88c98b8d-8q86r_22cc7343-fce6-4f53-a3a7-096f9cdadb14/kube-rbac-proxy/0.log" Nov 03 23:20:15.134924 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.134891 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56d7b45d9c-69m9m_c3676875-09f3-484d-8300-3a3c6e9da22b/thanos-query/0.log" Nov 03 23:20:15.157826 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.157695 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56d7b45d9c-69m9m_c3676875-09f3-484d-8300-3a3c6e9da22b/kube-rbac-proxy-web/0.log" Nov 03 23:20:15.183304 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.183275 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56d7b45d9c-69m9m_c3676875-09f3-484d-8300-3a3c6e9da22b/kube-rbac-proxy/0.log" Nov 03 23:20:15.242246 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.242204 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56d7b45d9c-69m9m_c3676875-09f3-484d-8300-3a3c6e9da22b/prom-label-proxy/0.log" Nov 03 23:20:15.279587 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.275472 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56d7b45d9c-69m9m_c3676875-09f3-484d-8300-3a3c6e9da22b/kube-rbac-proxy-rules/0.log" Nov 03 23:20:15.305627 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.305555 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56d7b45d9c-69m9m_c3676875-09f3-484d-8300-3a3c6e9da22b/kube-rbac-proxy-metrics/0.log" Nov 03 23:20:15.375117 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.375086 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6469b954d7-sd82d_e8763ba9-780a-4051-9595-5b957caa0ea0/authorino/0.log" Nov 03 23:20:15.393702 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.393673 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbm7v_2afd1042-9056-4440-92f1-d00ce5ec38ae/manager/0.log" Nov 03 23:20:15.509365 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.509336 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vf2qv_b70baa2b-2aa3-4860-9ca7-a174a932839f/limitador/0.log" Nov 03 23:20:15.547986 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.547957 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-xgxbq_2a92bfd0-105a-4b00-a171-bf0fadd6b412/manager/0.log" Nov 03 23:20:15.863245 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.863206 6394 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh"] Nov 03 23:20:15.869393 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.869366 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:15.875508 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.875469 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh"] Nov 03 23:20:15.987685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.979122 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-sys\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:15.987685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.979199 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrk9\" (UniqueName: \"kubernetes.io/projected/212988b3-301b-421b-bbbf-3b77a6d40084-kube-api-access-hvrk9\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:15.987685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.979286 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-podres\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:15.987685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.979338 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-lib-modules\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:15.987685 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:15.979360 6394 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-proc\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.080091 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.080055 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-lib-modules\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.080794 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.080772 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-proc\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081123 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.081104 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-sys\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081244 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.081230 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrk9\" (UniqueName: \"kubernetes.io/projected/212988b3-301b-421b-bbbf-3b77a6d40084-kube-api-access-hvrk9\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081357 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.081345 6394 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-podres\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081596 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.081578 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-podres\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081720 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.080720 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-lib-modules\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081856 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.081841 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-proc\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.081979 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.081967 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/212988b3-301b-421b-bbbf-3b77a6d40084-sys\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.091617 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.091587 6394 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrk9\" (UniqueName: \"kubernetes.io/projected/212988b3-301b-421b-bbbf-3b77a6d40084-kube-api-access-hvrk9\") pod \"perf-node-gather-daemonset-5sfwh\" (UID: \"212988b3-301b-421b-bbbf-3b77a6d40084\") " pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.193222 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.193126 6394 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:16.508700 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:16.508363 6394 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh"] Nov 03 23:20:17.064703 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:17.064055 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" event={"ID":"212988b3-301b-421b-bbbf-3b77a6d40084","Type":"ContainerStarted","Data":"36bef135d2ad2a8242dcce94c5751d80e80cf638fd1ea8bd5eb721bc740dcd16"} Nov 03 23:20:17.064703 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:17.064108 6394 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" event={"ID":"212988b3-301b-421b-bbbf-3b77a6d40084","Type":"ContainerStarted","Data":"fc8fdf2d9b0af8b94f6c13af6783874c4de03031f77a9789284c61e48d3b18dc"} Nov 03 23:20:17.064703 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:17.064458 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:17.725939 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:17.725841 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69945fc674-7bbft_5ec5f7a9-534d-44dd-a489-2a7627fe74d9/console/0.log" Nov 03 23:20:18.901635 ip-10-0-128-124 kubenswrapper[6394]: E1103 23:20:18.901590 6394 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-x7d6c" containerName="extractor" Nov 03 23:20:19.511555 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:19.511528 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqd56_8b9ab7e1-0444-433c-bf66-e5d004aa40c7/dns/0.log" Nov 03 23:20:19.535973 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:19.535941 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqd56_8b9ab7e1-0444-433c-bf66-e5d004aa40c7/kube-rbac-proxy/0.log" Nov 03 23:20:19.587714 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:19.587686 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c4mbq_22f978bf-c043-4c0c-b895-b3ad7011c9b5/dns-node-resolver/0.log" Nov 03 23:20:20.217791 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:20.217762 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6wjjx_4a61a276-7283-4fac-8fe0-5ad917832ed7/node-ca/0.log" Nov 03 23:20:20.577010 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:20.576978 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-z95sw_2380ed68-2192-4dfc-8940-a0871bd539d6/manager/0.log" Nov 03 23:20:20.589975 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:20.589944 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-z95sw_2380ed68-2192-4dfc-8940-a0871bd539d6/copy-manifests/0.log" Nov 03 23:20:22.175171 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:22.175131 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-4wxx9_0925a8a5-1874-43a7-826b-3ddc041e5f88/istio-proxy/0.log" Nov 03 23:20:22.207551 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:22.207519 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-55s9l_64dd7ad4-183a-4f9b-8a77-d14636cffc3b/istio-proxy/0.log" Nov 03 23:20:22.292777 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:22.292735 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-g9ntf_dfbbce52-065b-4a15-9b5e-9cc5542b8101/istio-proxy/0.log" Nov 03 23:20:22.530371 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:22.530293 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-59ml8_5ba53a6a-4b41-4970-9f27-244c7cef856d/payload-processing/0.log" Nov 03 23:20:23.082836 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.082807 6394 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" Nov 03 23:20:23.102329 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.102271 6394 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-97w7c/perf-node-gather-daemonset-5sfwh" podStartSLOduration=8.102257541 podStartE2EDuration="8.102257541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 23:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 23:20:17.085764248 +0000 UTC m=+1718.862733439" watchObservedRunningTime="2026-11-03 23:20:23.102257541 +0000 UTC m=+1724.879226729" Nov 03 23:20:23.154186 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.154134 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-4wxx9_0925a8a5-1874-43a7-826b-3ddc041e5f88/istio-proxy/0.log" Nov 03 23:20:23.174560 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.174531 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-55s9l_64dd7ad4-183a-4f9b-8a77-d14636cffc3b/istio-proxy/0.log" Nov 03 23:20:23.235389 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.235355 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-g9ntf_dfbbce52-065b-4a15-9b5e-9cc5542b8101/istio-proxy/0.log" Nov 03 23:20:23.380089 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.379992 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-59ml8_5ba53a6a-4b41-4970-9f27-244c7cef856d/payload-processing/0.log" Nov 03 23:20:23.380872 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:23.380852 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d72xp_1693791d-6029-4385-a82b-20e084c7626c/serve-healthcheck-canary/0.log" Nov 03 23:20:24.073424 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:24.073392 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7c646f4476-xp7tk_28167517-0c84-4cec-ab5a-604765b61b91/manager/1.log" Nov 03 23:20:24.073639 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:24.073567 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7c646f4476-xp7tk_28167517-0c84-4cec-ab5a-604765b61b91/manager/0.log" Nov 03 23:20:24.154179 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:24.154147 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x7d6c_34d29ed8-adf3-4a5c-802c-a503b37eca31/kube-rbac-proxy/0.log" Nov 03 23:20:24.176199 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:24.176163 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x7d6c_34d29ed8-adf3-4a5c-802c-a503b37eca31/exporter/0.log" Nov 03 23:20:24.202725 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:24.202691 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x7d6c_34d29ed8-adf3-4a5c-802c-a503b37eca31/extractor/0.log" Nov 03 23:20:27.151237 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:27.151191 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-z95sw_2380ed68-2192-4dfc-8940-a0871bd539d6/manager/0.log" Nov 03 23:20:27.176008 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:27.175982 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-8b65dd898-z95sw_2380ed68-2192-4dfc-8940-a0871bd539d6/copy-manifests/0.log" Nov 03 23:20:27.769681 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:27.768894 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-4wxx9_0925a8a5-1874-43a7-826b-3ddc041e5f88/istio-proxy/0.log" Nov 03 23:20:27.786356 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:27.786322 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-55s9l_64dd7ad4-183a-4f9b-8a77-d14636cffc3b/istio-proxy/0.log" Nov 03 23:20:27.854099 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:27.854052 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-g9ntf_dfbbce52-065b-4a15-9b5e-9cc5542b8101/istio-proxy/0.log" Nov 03 23:20:28.019569 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:28.019532 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-59ml8_5ba53a6a-4b41-4970-9f27-244c7cef856d/payload-processing/0.log" Nov 03 23:20:28.325092 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:28.325062 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7c646f4476-xp7tk_28167517-0c84-4cec-ab5a-604765b61b91/manager/1.log" Nov 03 23:20:28.325607 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:28.325302 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-7c646f4476-xp7tk_28167517-0c84-4cec-ab5a-604765b61b91/manager/0.log" Nov 03 23:20:30.508202 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:30.508166 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-4wxx9_0925a8a5-1874-43a7-826b-3ddc041e5f88/istio-proxy/0.log" Nov 03 23:20:30.526058 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:30.526034 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-55s9l_64dd7ad4-183a-4f9b-8a77-d14636cffc3b/istio-proxy/0.log" Nov 03 23:20:30.580001 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:30.579953 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-68cb9b4b95-g9ntf_dfbbce52-065b-4a15-9b5e-9cc5542b8101/istio-proxy/0.log" Nov 03 23:20:30.741853 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:30.741818 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bb9489676-59ml8_5ba53a6a-4b41-4970-9f27-244c7cef856d/payload-processing/0.log" Nov 03 23:20:32.768518 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:32.768487 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6469b954d7-sd82d_e8763ba9-780a-4051-9595-5b957caa0ea0/authorino/0.log" Nov 03 23:20:32.800280 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:32.800234 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fbm7v_2afd1042-9056-4440-92f1-d00ce5ec38ae/manager/0.log" Nov 03 23:20:32.930254 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:32.930221 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-vf2qv_b70baa2b-2aa3-4860-9ca7-a174a932839f/limitador/0.log" Nov 03 23:20:33.004402 ip-10-0-128-124 kubenswrapper[6394]: I1103 23:20:33.003744 6394 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-xgxbq_2a92bfd0-105a-4b00-a171-bf0fadd6b412/manager/0.log"