Nov 04 04:46:24.059595 ip-10-0-135-45 systemd[1]: Starting Kubernetes Kubelet... Nov 04 04:46:24.479951 ip-10-0-135-45 kubenswrapper[2536]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:46:24.479951 ip-10-0-135-45 kubenswrapper[2536]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 04:46:24.479951 ip-10-0-135-45 kubenswrapper[2536]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:46:24.479951 ip-10-0-135-45 kubenswrapper[2536]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:46:24.484281 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484179 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.484281 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484280 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.484281 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484284 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484288 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484291 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484294 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484297 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484299 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484302 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484306 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484308 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484311 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484314 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484316 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484319 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484321 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484324 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484326 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484329 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484331 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484334 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484337 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.484374 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484340 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484342 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484345 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484349 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484351 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484354 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484356 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484359 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484361 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484364 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484366 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484369 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484372 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484374 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484378 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484382 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484387 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484389 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484392 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.484848 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484395 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484398 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484401 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484403 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484408 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484411 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484414 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484417 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484420 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484422 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484425 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484429 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484431 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484434 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484437 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484439 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484442 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484444 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484447 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.485319 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484449 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484452 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484455 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484457 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484459 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484462 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484464 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484467 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484469 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484473 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484476 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484478 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484481 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484483 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484486 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484488 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484494 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484497 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484499 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484502 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.485757 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484504 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484507 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484509 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484512 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484515 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484517 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484520 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484522 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484525 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484527 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484530 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484532 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484535 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484537 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484540 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484543 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484545 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484548 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484550 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484553 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.486202 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484556 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484558 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484561 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484563 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484566 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.484570 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485399 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485406 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485409 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485412 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485416 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485419 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485421 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485424 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485427 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485430 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485433 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485436 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485439 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485442 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.486664 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485445 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485447 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485450 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485452 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485455 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485458 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485460 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485463 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485465 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485468 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485470 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485473 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485476 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485478 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485481 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485483 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485486 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485489 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485491 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485494 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.487134 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485497 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485499 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485502 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485505 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485508 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485510 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485513 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485515 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485518 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485521 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485523 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485526 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485528 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485531 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485533 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485536 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485538 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485541 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485544 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485547 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.487604 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485551 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485554 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485557 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485560 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485564 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485566 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485569 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485571 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485574 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485577 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485580 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485582 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485585 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485588 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485591 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485594 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485596 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485599 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485601 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.488064 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485604 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485606 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485609 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485611 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485613 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485616 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485618 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485621 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485624 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485626 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485629 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485631 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485633 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485636 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485638 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485641 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485645 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485647 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485650 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485653 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.488527 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485655 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485658 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485660 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485663 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485665 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485668 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485671 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485674 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485678 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485684 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485687 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485690 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.485692 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486181 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486186 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486189 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486192 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486194 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.489016 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486197 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486199 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486202 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486205 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486207 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486210 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486213 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486216 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486218 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486221 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486224 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486228 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486231 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486234 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486237 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486239 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486257 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486260 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486263 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.489460 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486266 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486269 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486271 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486274 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486277 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486280 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486283 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486286 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486289 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486292 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486294 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486297 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486299 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486302 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486304 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486307 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486309 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486312 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486314 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486317 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.490005 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486319 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486322 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486324 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486328 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486330 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486332 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486335 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486337 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486340 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486342 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486345 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486348 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486351 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486354 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486356 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486359 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486362 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486365 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486367 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.490485 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486370 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486374 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486377 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486380 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486382 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486385 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486387 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486390 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486392 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486395 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486397 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486399 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486402 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486404 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486407 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486409 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486412 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486415 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486417 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.490924 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486420 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486422 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486424 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486427 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486429 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486432 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486437 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486440 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486442 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486445 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486448 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486450 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486453 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486456 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486458 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486461 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486463 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486466 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486468 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.491370 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486471 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486473 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486475 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486478 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.486480 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487415 2536 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487425 2536 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487431 2536 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487436 2536 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487440 2536 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487443 2536 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487447 2536 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487451 2536 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487455 2536 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487458 2536 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487461 2536 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487464 2536 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487467 2536 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487471 2536 flags.go:64] FLAG: --cgroup-root="" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487477 2536 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487480 2536 flags.go:64] FLAG: --client-ca-file="" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487483 2536 flags.go:64] FLAG: --cloud-provider="external" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487486 2536 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487492 2536 flags.go:64] FLAG: --cluster-domain="" Nov 04 04:46:24.491891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487494 2536 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487497 2536 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487501 2536 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487505 2536 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487509 2536 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487512 2536 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487515 2536 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487518 2536 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487521 2536 flags.go:64] FLAG: --contention-profiling="false" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487525 2536 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487527 2536 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487530 2536 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487533 2536 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487537 2536 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487540 2536 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487543 2536 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487546 2536 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487549 2536 flags.go:64] FLAG: --enable-server="true" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487551 2536 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487556 2536 flags.go:64] FLAG: --event-burst="100" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487559 2536 flags.go:64] FLAG: --event-qps="50" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487562 2536 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487565 2536 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487568 2536 flags.go:64] FLAG: --eviction-hard="" Nov 04 04:46:24.492522 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487572 2536 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487575 2536 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487578 2536 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487582 2536 flags.go:64] FLAG: --eviction-soft="" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487585 2536 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487588 2536 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487591 2536 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487594 2536 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487597 2536 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487600 2536 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487603 2536 flags.go:64] FLAG: --feature-gates="" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487607 2536 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487611 2536 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487614 2536 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487617 2536 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487620 2536 flags.go:64] FLAG: --healthz-port="10248" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487623 2536 flags.go:64] FLAG: --help="false" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487626 2536 flags.go:64] FLAG: --hostname-override="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487629 2536 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487632 2536 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487635 2536 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487638 2536 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487641 2536 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 04:46:24.493169 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487644 2536 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487647 2536 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487649 2536 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487652 2536 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487655 2536 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487658 2536 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487661 2536 flags.go:64] FLAG: --kube-reserved="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487664 2536 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487666 2536 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487670 2536 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487672 2536 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487676 2536 flags.go:64] FLAG: --lock-file="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487680 2536 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487683 2536 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487686 2536 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487691 2536 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487694 2536 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487697 2536 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487700 2536 flags.go:64] FLAG: --logging-format="text" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487703 2536 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487706 2536 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487711 2536 flags.go:64] FLAG: --manifest-url="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487714 2536 flags.go:64] FLAG: --manifest-url-header="" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487718 2536 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487722 2536 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 04:46:24.493716 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487725 2536 flags.go:64] FLAG: --max-pods="110" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487729 2536 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487732 2536 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487734 2536 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487737 2536 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487740 2536 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487743 2536 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487746 2536 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487753 2536 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487756 2536 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487759 2536 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487762 2536 flags.go:64] FLAG: --pod-cidr="" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487765 2536 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487767 2536 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487770 2536 flags.go:64] FLAG: --pods-per-core="0" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487773 2536 flags.go:64] FLAG: --port="10250" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487776 2536 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487779 2536 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0784556eec8bddf43" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487783 2536 flags.go:64] FLAG: --qos-reserved="" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487786 2536 flags.go:64] FLAG: --read-only-port="10255" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487789 2536 flags.go:64] FLAG: --register-node="true" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487792 2536 flags.go:64] FLAG: --register-with-taints="" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487796 2536 flags.go:64] FLAG: --registry-burst="10" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487799 2536 flags.go:64] FLAG: --registry-qps="5" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487801 2536 flags.go:64] FLAG: --reserved-cpus="" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487804 2536 flags.go:64] FLAG: --reserved-memory="" Nov 04 04:46:24.494332 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487808 2536 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487811 2536 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487814 2536 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487817 2536 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487820 2536 flags.go:64] FLAG: --runonce="false" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487823 2536 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487826 2536 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487829 2536 flags.go:64] FLAG: --seccomp-default="false" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487831 2536 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487834 2536 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487838 2536 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487841 2536 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487844 2536 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487847 2536 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487849 2536 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487852 2536 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487855 2536 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487858 2536 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487861 2536 flags.go:64] FLAG: --system-cgroups="" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487864 2536 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487869 2536 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487872 2536 flags.go:64] FLAG: --tls-cert-file="" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487875 2536 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487879 2536 flags.go:64] FLAG: --tls-min-version="" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487883 2536 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 04:46:24.494992 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487886 2536 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487889 2536 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487891 2536 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487894 2536 flags.go:64] FLAG: --v="2" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487898 2536 flags.go:64] FLAG: --version="false" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487902 2536 flags.go:64] FLAG: --vmodule="" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487906 2536 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.487909 2536 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488071 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488075 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488079 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488082 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488085 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488087 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488090 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488092 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488095 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488098 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488100 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488102 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488105 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488107 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.495576 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488110 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488112 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488115 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488118 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488120 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488123 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488125 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488128 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488130 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488134 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488137 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488139 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488141 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488144 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488146 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488149 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488151 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488154 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488156 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.496075 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488159 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488161 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488163 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488167 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488170 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488172 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488176 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488180 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488184 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488187 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488189 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488192 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488194 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488197 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488199 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488202 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488205 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488207 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488210 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.496593 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488212 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488215 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488217 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488221 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488224 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488226 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488229 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488231 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488234 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488236 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488239 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488256 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488259 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488262 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488264 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488267 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488269 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488272 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488274 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.497106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488277 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488280 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488284 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488286 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488289 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488291 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488294 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488297 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488299 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488302 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488304 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488307 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488309 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488312 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488314 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488317 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488321 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488323 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488326 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488328 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.497677 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488331 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488333 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488336 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488338 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488340 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488343 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488346 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488348 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488351 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488353 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488356 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488359 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488363 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488366 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488370 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.488398 2536 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:46:24.498194 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488437 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488441 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488444 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488447 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488450 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488453 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488455 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488458 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488461 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488463 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488466 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488468 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488472 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488475 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488477 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488480 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488482 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488485 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488487 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.498595 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488489 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488492 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488495 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488497 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488499 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488502 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488505 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488507 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488510 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488512 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488515 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488517 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488521 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488524 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488526 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488529 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488532 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488535 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488538 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488541 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.499033 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488543 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488546 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488548 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488551 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488553 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488557 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488561 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488563 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488565 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488568 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488570 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488573 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488577 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488581 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488584 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488587 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488589 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488592 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488594 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.499500 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488597 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488599 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488602 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488605 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488607 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488611 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488614 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488616 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488618 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488621 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488623 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488635 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488637 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488640 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488643 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488645 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488648 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488651 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488653 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488656 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.499923 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488659 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488661 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488683 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488685 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488688 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488690 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488693 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488696 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488698 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488701 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488703 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488706 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488708 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488711 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488714 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488719 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488723 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488727 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488730 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.500395 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488733 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488735 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488738 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488740 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488743 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488746 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488748 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488751 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.488753 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.496158 2536 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.496174 2536 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.496831 2536 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.496848 2536 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496925 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496932 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496938 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496942 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496946 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496950 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.501489 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496953 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496955 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496958 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496961 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496963 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496966 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496969 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496974 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496978 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496982 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496986 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496990 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.496995 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497001 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497007 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497011 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497015 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497019 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497023 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.501947 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497030 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497034 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497037 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497040 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497045 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497048 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497051 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497054 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497057 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497059 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497062 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497064 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497067 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497070 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497073 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497076 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497079 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497081 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497084 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497086 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.502405 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497089 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497091 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497094 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497097 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497099 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497103 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497108 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497112 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497116 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497120 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497124 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497129 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497134 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497139 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497143 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497145 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497148 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497152 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497156 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497159 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.502881 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497161 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497164 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497166 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497169 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497171 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497174 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497177 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497179 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497182 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497185 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497188 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497190 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497192 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497195 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497198 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497200 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497204 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497206 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497208 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497211 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.503330 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497213 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497216 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497219 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497222 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497225 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497227 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497230 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497233 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497236 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497238 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497242 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497258 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497261 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497264 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497267 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497269 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497272 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497275 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497277 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497280 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.503818 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497283 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.497314 2536 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497463 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497468 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497471 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497473 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497476 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497479 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497482 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497484 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497487 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497489 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497492 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497494 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497497 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497500 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497502 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.504285 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497505 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497508 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497510 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497513 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497516 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497518 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497521 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497524 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497526 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497529 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497532 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497534 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497537 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497539 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497542 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497544 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497547 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497549 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497552 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.504697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497554 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497558 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497563 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497566 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497570 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497573 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497575 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497578 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497580 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497583 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497585 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497588 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497591 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497593 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497596 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497598 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497601 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497603 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497605 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.505141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497608 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497611 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497613 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497616 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497618 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497621 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497623 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497626 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497628 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497631 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497633 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497636 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497638 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497641 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497643 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497646 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497648 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497651 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497654 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497657 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.505679 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497659 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497661 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497664 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497666 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497669 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497672 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497675 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497677 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497680 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497682 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497686 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497690 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497693 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497696 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497699 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497702 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497705 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497707 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497710 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.506164 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497713 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497715 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497720 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497723 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497726 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497728 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497731 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497734 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497736 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497739 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497742 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497744 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497747 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497750 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.497784 2536 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497816 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:46:24.506601 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497820 2536 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497823 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497826 2536 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497828 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497831 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497834 2536 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497836 2536 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497838 2536 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497841 2536 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497845 2536 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497849 2536 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497852 2536 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497856 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497858 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497861 2536 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497864 2536 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497866 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497869 2536 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497871 2536 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:46:24.506966 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497875 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497878 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497880 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497883 2536 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497886 2536 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497888 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497891 2536 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497893 2536 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497896 2536 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497899 2536 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497901 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497904 2536 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497906 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497909 2536 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497911 2536 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497914 2536 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497916 2536 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497919 2536 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497921 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497924 2536 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:46:24.507398 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497926 2536 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497929 2536 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497931 2536 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497934 2536 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497936 2536 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497939 2536 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497942 2536 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497944 2536 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497947 2536 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497951 2536 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497953 2536 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497956 2536 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497960 2536 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497963 2536 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497965 2536 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497968 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497970 2536 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497973 2536 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497975 2536 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:46:24.507918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497978 2536 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497980 2536 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497983 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497985 2536 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497988 2536 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497990 2536 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497993 2536 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497995 2536 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.497998 2536 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498001 2536 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498005 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498008 2536 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498010 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498013 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498015 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498018 2536 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498021 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498023 2536 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498025 2536 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:46:24.508364 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498028 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498031 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498033 2536 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498036 2536 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498038 2536 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498041 2536 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498044 2536 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498047 2536 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498049 2536 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498052 2536 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498054 2536 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498057 2536 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498059 2536 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498062 2536 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498064 2536 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498067 2536 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498069 2536 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498072 2536 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498074 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:46:24.508991 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498077 2536 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498079 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498081 2536 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498084 2536 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498086 2536 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498089 2536 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498091 2536 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498094 2536 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:24.498097 2536 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.498150 2536 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.500517 2536 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.501537 2536 server.go:1014] "Starting client certificate rotation" Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.502029 2536 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.502865 2536 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 04:46:24.509780 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.504261 2536 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:46:24.510176 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.509951 2536 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:46:24.524777 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.524750 2536 log.go:25] "Validated CRI v1 runtime API" Nov 04 04:46:24.529574 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.529558 2536 log.go:25] "Validated CRI v1 image API" Nov 04 04:46:24.530466 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.530442 2536 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 04:46:24.534094 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.534070 2536 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c923cc8f-23e2-4d47-b5b3-21e541021c2d:/dev/nvme0n1p4 db2a0eba-dc3f-47c3-bbec-a5ef83f4c18a:/dev/nvme0n1p3] Nov 04 04:46:24.534166 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.534095 2536 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 04 04:46:24.539052 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.538938 2536 manager.go:217] Machine: {Timestamp:2026-11-04 04:46:24.538462763 +0000 UTC m=+0.355680271 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3139870 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba4cc8462c15962796ec4195b968c SystemUUID:ec2ba4cc-8462-c159-6279-6ec4195b968c BootID:8b6aafef-c292-44ca-b2b8-910d171e9ffa Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:5e:83:47:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:5e:83:47:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:2a:96:5c:c8:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 04:46:24.539052 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.539047 2536 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 04:46:24.539156 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.539134 2536 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 04:46:24.542632 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.542602 2536 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 04:46:24.542773 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.542635 2536 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-45.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 04:46:24.542813 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.542775 2536 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 04:46:24.542813 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.542783 2536 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 04:46:24.542813 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.542799 2536 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:46:24.543784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.543773 2536 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:46:24.545058 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.545045 2536 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 04:46:24.549550 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.549535 2536 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 04:46:24.549678 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.549668 2536 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 04:46:24.550548 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.550538 2536 kubelet.go:493] "Attempting to sync node with API server" Nov 04 04:46:24.550592 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.550562 2536 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 04:46:24.550592 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.550576 2536 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 04:46:24.550592 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.550586 2536 kubelet.go:405] "Adding apiserver pod source" Nov 04 04:46:24.550710 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.550594 2536 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 04:46:24.550949 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.550933 2536 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:46:24.553379 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.553359 2536 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 04:46:24.560943 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.560925 2536 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:46:24.561858 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.561845 2536 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 04:46:24.561902 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.561875 2536 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 04:46:24.562062 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562051 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 04:46:24.562093 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562071 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 04:46:24.562093 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562080 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 04:46:24.562093 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562088 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 04:46:24.562167 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562095 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 04:46:24.562167 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562103 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 04:46:24.562751 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562741 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 04:46:24.562782 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562775 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 04:46:24.562807 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562783 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 04:46:24.562807 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562789 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 04:46:24.562807 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562802 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 04:46:24.562901 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.562811 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 04:46:24.563833 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.563822 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 04:46:24.563833 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.563833 2536 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 04:46:24.569981 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.569963 2536 server.go:1263] "Started kubelet" Nov 04 04:46:24.570145 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.570068 2536 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 04:46:24.570434 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.570413 2536 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 04:46:24.570646 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.570190 2536 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 04:46:24.570759 ip-10-0-135-45 systemd[1]: Started Kubernetes Kubelet. Nov 04 04:46:24.572892 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.572874 2536 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 04:46:24.573038 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.573023 2536 server.go:317] "Adding debug handlers to kubelet server" Nov 04 04:46:24.577212 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.577180 2536 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 04 04:46:24.579977 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.579957 2536 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 04:46:24.579977 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.579970 2536 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 04:46:24.580110 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.580031 2536 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" Nov 04 04:46:24.580738 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580696 2536 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 04:46:24.580818 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580754 2536 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 04:46:24.580818 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580765 2536 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 04:46:24.580918 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580840 2536 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 04:46:24.580918 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580850 2536 factory.go:55] Registering systemd factory Nov 04 04:46:24.580918 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580857 2536 factory.go:223] Registration of the systemd container factory successfully Nov 04 04:46:24.580918 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580877 2536 reconstruct.go:97] "Volume reconstruction finished" Nov 04 04:46:24.580918 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.580884 2536 reconciler.go:29] "Reconciler: start to sync state" Nov 04 04:46:24.581210 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.581191 2536 factory.go:153] Registering CRI-O factory Nov 04 04:46:24.581210 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.581212 2536 factory.go:223] Registration of the crio container factory successfully Nov 04 04:46:24.581337 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.581227 2536 factory.go:103] Registering Raw factory Nov 04 04:46:24.581337 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.581240 2536 manager.go:1199] Started watching for new ooms in manager Nov 04 04:46:24.582367 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.582353 2536 manager.go:319] Starting recovery of all containers Nov 04 04:46:24.593116 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.593094 2536 manager.go:324] Recovery completed Nov 04 04:46:24.598624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.598609 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.600475 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.600430 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.600534 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.600476 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.600534 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.600490 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.601075 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601060 2536 cpu_manager.go:226] "Starting" policy="none" Nov 04 04:46:24.601075 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601072 2536 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 04:46:24.601176 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601092 2536 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 04:46:24.601176 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601112 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.601861 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601845 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.601910 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601877 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.601910 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.601886 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.603272 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.603238 2536 policy_none.go:50] "Start" Nov 04 04:46:24.603327 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.603278 2536 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 04:46:24.603327 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.603294 2536 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 04:46:24.605325 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.605313 2536 policy_none.go:44] "Start" Nov 04 04:46:24.639762 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.639563 2536 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.653592 2536 manager.go:341] "Starting Device Plugin manager" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.653619 2536 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.653627 2536 server.go:87] "Starting device plugin registration server" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.653846 2536 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.653855 2536 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.653970 2536 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.654065 2536 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.654075 2536 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.654582 2536 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.654631 2536 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.659976 2536 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.661181 2536 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.661201 2536 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.661218 2536 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 04:46:24.665431 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.661265 2536 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 04 04:46:24.707441 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.707407 2536 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-45.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 04 04:46:24.707441 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.707412 2536 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-45.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 04 04:46:24.708537 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.707406 2536 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-45.us-west-1.compute.internal.18e4be1d47e6b468 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-45.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-45.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 04:46:24.569930856 +0000 UTC m=+0.387148360,LastTimestamp:2026-11-04 04:46:24.569930856 +0000 UTC m=+0.387148360,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-45.us-west-1.compute.internal,}" Nov 04 04:46:24.754241 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.754117 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.755130 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.755113 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.755184 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.755145 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.755184 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.755156 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.755184 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.755179 2536 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.761118 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.761095 2536 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 04 04:46:24.761238 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.761076 2536 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-45.us-west-1.compute.internal.18e4be1d49b87e0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-45.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-45.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-45.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 04:46:24.600456716 +0000 UTC m=+0.417674225,LastTimestamp:2026-11-04 04:46:24.600456716 +0000 UTC m=+0.417674225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-45.us-west-1.compute.internal,}" Nov 04 04:46:24.761352 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.761315 2536 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal"] Nov 04 04:46:24.761408 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.761381 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.762158 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.762142 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.762235 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.762173 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.762235 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.762185 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.764305 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.764294 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.764451 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.764437 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.764495 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.764466 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.765062 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.765046 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.765062 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.765059 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.765158 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.765074 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.765158 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.765084 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.765158 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.765082 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.765256 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.765161 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.767336 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.767322 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.767403 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.767350 2536 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:46:24.768107 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.768091 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:46:24.768163 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.768123 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:46:24.768163 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.768136 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:46:24.787197 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.787169 2536 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 04:46:24.787330 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.787287 2536 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kjnbm" Nov 04 04:46:24.797129 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.797109 2536 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.799572 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.799556 2536 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.862426 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.862393 2536 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:46:24.862426 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.862420 2536 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:46:24.863945 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.863929 2536 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:46:24.877160 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.877131 2536 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.877160 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:24.877159 2536 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-45.us-west-1.compute.internal\": node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" Nov 04 04:46:24.882180 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.882162 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.882237 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.882190 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.882237 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.882208 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247d5fdffbb0596570a9bedc92fe6730-config\") pod \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"247d5fdffbb0596570a9bedc92fe6730\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.981043 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.981009 2536 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.982827 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.982797 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.982938 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.982837 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.982938 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.982860 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247d5fdffbb0596570a9bedc92fe6730-config\") pod \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"247d5fdffbb0596570a9bedc92fe6730\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.982938 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.982911 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.982938 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.982915 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247d5fdffbb0596570a9bedc92fe6730-config\") pod \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"247d5fdffbb0596570a9bedc92fe6730\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:24.983061 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:24.982911 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:25.081902 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.081838 2536 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:46:25.083620 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.083605 2536 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:25.102036 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.102013 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:25.105186 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.105165 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:46:25.141136 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.141108 2536 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:46:25.501620 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.501542 2536 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 04 04:46:25.502083 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.501665 2536 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 04:46:25.502083 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.501716 2536 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 04 04:46:25.502083 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.501743 2536 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ad7f0a69d1aeb4fbea22a6fe43d5cdd1-3a8265abc582d153.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-135-45.us-west-1.compute.internal.18e4be1d49b87e0c\": read tcp 10.0.135.45:51364->3.132.101.194:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-135-45.us-west-1.compute.internal.18e4be1d49b87e0c default 4881 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-45.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-45.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-45.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 04:46:24 +0000 UTC,LastTimestamp:2026-11-04 04:46:24.762158507 +0000 UTC m=+0.579376013,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-45.us-west-1.compute.internal,}" Nov 04 04:46:25.551711 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.551676 2536 apiserver.go:52] "Watching apiserver" Nov 04 04:46:25.580748 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.580721 2536 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 04 04:46:25.793392 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.793302 2536 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 04:41:26 +0000 UTC" deadline="2028-04-03 04:09:36.949027349 +0000 UTC" Nov 04 04:46:25.793392 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.793340 2536 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12383h23m11.155690452s" Nov 04 04:46:25.809803 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.809776 2536 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 04:46:25.810113 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.810093 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ltftm","openshift-multus/multus-additional-cni-plugins-4l4df","openshift-network-operator/iptables-alerter-c8qfx","openshift-ovn-kubernetes/ovnkube-node-xtqv6","kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal","openshift-cluster-node-tuning-operator/tuned-nnsqw","openshift-multus/network-metrics-daemon-5wzcr","kube-system/konnectivity-agent-ksbdr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal","openshift-image-registry/node-ca-5gfpr","openshift-multus/multus-gzztp","openshift-network-diagnostics/network-check-target-nrkxh","kube-system/global-pull-secret-syncer-sf9x7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2"] Nov 04 04:46:25.811656 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.811640 2536 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:46:25.812502 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.812487 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.814656 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.814634 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.816721 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.816704 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.818897 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.818878 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.821045 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.821028 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.823198 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.823181 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:25.823312 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.823256 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:25.825429 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.825412 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.827707 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.827601 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.829834 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.829818 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.832532 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.832516 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:25.832618 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.832564 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:25.835228 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.835211 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.835333 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.835277 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:25.837401 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.837384 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.866932 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.866913 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.867372 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.867109 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.867612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.867577 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.867612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.867586 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 04:46:25.867726 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.867636 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.867726 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.867692 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tqbjc\"" Nov 04 04:46:25.867884 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.867869 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 04:46:25.882389 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.882374 2536 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 04:46:25.887942 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.887924 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-sys-fs\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.887990 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.887951 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvl9\" (UniqueName: \"kubernetes.io/projected/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kube-api-access-2nvl9\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.887990 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.887967 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-ovn\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.887990 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.887981 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-lib-modules\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.887995 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnfw9\" (UniqueName: \"kubernetes.io/projected/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-kube-api-access-rnfw9\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888048 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.888131 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888090 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f45l\" (UniqueName: \"kubernetes.io/projected/32dcc5b0-c4fd-485d-bda3-604e8965dcff-kube-api-access-7f45l\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.888131 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888108 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-systemd-units\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888183 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888137 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-etc-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888183 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888162 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-kubelet-config\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.888240 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888209 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-bin\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888290 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888239 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-modprobe-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888290 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888283 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-registration-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.888349 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888306 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-device-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.888349 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888320 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dcc5b0-c4fd-485d-bda3-604e8965dcff-host-slash\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.888439 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888364 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-netd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888439 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888384 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-run\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888439 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888407 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-node-log\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888439 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888423 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzqs7\" (UniqueName: \"kubernetes.io/projected/7472ef71-a7e6-495f-8212-189582db5c77-kube-api-access-jzqs7\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888542 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888460 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-var-lib-kubelet\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888542 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888480 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dcc5b0-c4fd-485d-bda3-604e8965dcff-iptables-alerter-script\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.888542 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888494 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7472ef71-a7e6-495f-8212-189582db5c77-ovn-node-metrics-cert\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888542 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888531 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysconfig\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888657 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888551 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-host\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888657 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888570 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-system-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.888657 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888612 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-cnibin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.888657 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888635 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-kubelet\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888657 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888649 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-var-lib-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.888789 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888693 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dd7863e-8391-4629-9a8d-38324d296e87-agent-certs\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.888789 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888711 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888789 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888725 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-sys\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888789 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888757 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-tuned\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.888789 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888784 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-host\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888806 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7863e-8391-4629-9a8d-38324d296e87-konnectivity-ca\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888821 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc13008-7b5b-4964-baf6-3320a2e3078e-hosts-file\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888841 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-serviceca\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888860 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-cni-binary-copy\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888874 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-socket-dir-parent\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888896 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-bin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.888917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888913 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc13008-7b5b-4964-baf6-3320a2e3078e-tmp-dir\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888927 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh6lx\" (UniqueName: \"kubernetes.io/projected/8fc13008-7b5b-4964-baf6-3320a2e3078e-kube-api-access-dh6lx\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888954 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-system-cni-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888969 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.888990 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-script-lib\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889009 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-env-overrides\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889022 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-multus-certs\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889042 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-etc-kubernetes\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889065 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-socket-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.889095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889089 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889106 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cnibin\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889121 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-systemd\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889136 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-multus\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889155 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889175 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889195 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-netns\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889214 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-config\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889238 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-kubernetes\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889287 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889315 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbz86\" (UniqueName: \"kubernetes.io/projected/f8638b06-49e9-43bb-bc66-ea3fd87fd136-kube-api-access-tbz86\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889340 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889362 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwc8\" (UniqueName: \"kubernetes.io/projected/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-kube-api-access-hxwc8\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889390 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-netns\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889406 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-kubelet\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889431 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889471 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-systemd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889504 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889532 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-tmp\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889565 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-k8s-cni-cncf-io\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889606 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-conf-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889637 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7txj\" (UniqueName: \"kubernetes.io/projected/7676efb4-629c-40eb-bada-087789bc737f-kube-api-access-n7txj\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889663 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-slash\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889691 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889714 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889735 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-dbus\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889750 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-log-socket\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.889784 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889788 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-conf\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.890233 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889819 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-hostroot\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.890233 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889847 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkqls\" (UniqueName: \"kubernetes.io/projected/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-kube-api-access-hkqls\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:25.890233 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889872 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.890233 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889894 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-multus-daemon-config\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.890233 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.889933 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.922810 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.922794 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ssxrh\"" Nov 04 04:46:25.922952 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.922938 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 04:46:25.934337 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.934320 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.934704 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.934687 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.935740 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.935715 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 04:46:25.935837 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.935751 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 04:46:25.935837 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.935752 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mkkxt\"" Nov 04 04:46:25.935837 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.935821 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.935964 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.935943 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-jqdfn\"" Nov 04 04:46:25.936164 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936151 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.936212 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936195 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 04:46:25.936263 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936212 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zsr9v\"" Nov 04 04:46:25.936263 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936213 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.936263 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936231 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g79lj\"" Nov 04 04:46:25.936560 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936547 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.936642 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936597 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 04:46:25.936642 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936610 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936643 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936644 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936659 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936685 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936693 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936696 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 04:46:25.936739 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936719 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.936971 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936772 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-shz8v\"" Nov 04 04:46:25.936971 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936833 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:25.936971 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.936939 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kgq44\"" Nov 04 04:46:25.937081 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.937064 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 04:46:25.937369 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.937355 2536 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 04 04:46:25.937418 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.937406 2536 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqr9r" Nov 04 04:46:25.938908 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.938897 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vmp7s\"" Nov 04 04:46:25.990129 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990110 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-etc-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990135 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-kubelet-config\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.990222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990149 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-bin\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990164 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-modprobe-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990178 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-registration-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.990222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990192 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-device-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.990222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990213 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dcc5b0-c4fd-485d-bda3-604e8965dcff-host-slash\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990227 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-kubelet-config\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990233 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-netd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990278 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-etc-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990289 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dcc5b0-c4fd-485d-bda3-604e8965dcff-host-slash\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990236 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-bin\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990286 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-run\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990304 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-device-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990298 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-registration-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990333 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-node-log\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990337 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-netd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990332 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-modprobe-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990368 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzqs7\" (UniqueName: \"kubernetes.io/projected/7472ef71-a7e6-495f-8212-189582db5c77-kube-api-access-jzqs7\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990389 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-node-log\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990396 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-run\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990503 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990418 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-var-lib-kubelet\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990521 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dcc5b0-c4fd-485d-bda3-604e8965dcff-iptables-alerter-script\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990543 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7472ef71-a7e6-495f-8212-189582db5c77-ovn-node-metrics-cert\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990560 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-var-lib-kubelet\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990570 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysconfig\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990597 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-host\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990602 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysconfig\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990619 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-system-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990640 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-cnibin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990642 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-host\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990655 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-kubelet\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990671 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-var-lib-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990691 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-cnibin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990679 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-system-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990710 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dd7863e-8391-4629-9a8d-38324d296e87-agent-certs\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990730 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-kubelet\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990735 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-var-lib-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990735 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.990937 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990770 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-sys\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990793 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-tuned\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990812 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-host\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990827 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-sys\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990831 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990812 2536 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990875 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-host\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990837 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7863e-8391-4629-9a8d-38324d296e87-konnectivity-ca\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990912 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc13008-7b5b-4964-baf6-3320a2e3078e-hosts-file\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990932 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-serviceca\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990951 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-cni-binary-copy\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990972 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-socket-dir-parent\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.990993 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-bin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991018 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc13008-7b5b-4964-baf6-3320a2e3078e-tmp-dir\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991044 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh6lx\" (UniqueName: \"kubernetes.io/projected/8fc13008-7b5b-4964-baf6-3320a2e3078e-kube-api-access-dh6lx\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991067 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-system-cni-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991122 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dcc5b0-c4fd-485d-bda3-604e8965dcff-iptables-alerter-script\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991169 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.991668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991092 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991240 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-script-lib\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991290 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-env-overrides\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991318 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-multus-certs\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991369 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-etc-kubernetes\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991372 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7863e-8391-4629-9a8d-38324d296e87-konnectivity-ca\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991395 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-socket-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991426 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc13008-7b5b-4964-baf6-3320a2e3078e-tmp-dir\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991434 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc13008-7b5b-4964-baf6-3320a2e3078e-hosts-file\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991423 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-system-cni-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991454 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991479 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-multus-certs\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991485 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cnibin\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991638 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-cni-binary-copy\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991669 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-bin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991719 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-etc-kubernetes\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991807 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-socket-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991843 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-serviceca\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.992531 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991868 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-env-overrides\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991886 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cnibin\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.991485 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-socket-dir-parent\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992040 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-systemd\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992066 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-multus\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992089 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992180 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992280 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992294 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992305 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-netns\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992283 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-multus\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992455 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-netns\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992505 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-script-lib\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992522 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-systemd\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992564 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-config\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992611 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-kubernetes\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992644 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.993359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992691 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbz86\" (UniqueName: \"kubernetes.io/projected/f8638b06-49e9-43bb-bc66-ea3fd87fd136-kube-api-access-tbz86\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992720 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992728 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-kubernetes\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992760 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992770 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwc8\" (UniqueName: \"kubernetes.io/projected/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-kube-api-access-hxwc8\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992795 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-netns\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.992863 2536 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992904 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-kubelet\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.992934 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret podName:5e2ff9d2-73c3-4635-a07a-ca5579d71d65 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:26.492913045 +0000 UTC m=+2.310130555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret") pod "global-pull-secret-syncer-sf9x7" (UID: "5e2ff9d2-73c3-4635-a07a-ca5579d71d65") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992953 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-kubelet\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.992999 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993002 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993027 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-systemd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993069 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-config\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993075 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993085 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-netns\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993113 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-tmp\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.994112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993138 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-k8s-cni-cncf-io\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993146 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-systemd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993144 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993165 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-conf-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993187 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7txj\" (UniqueName: \"kubernetes.io/projected/7676efb4-629c-40eb-bada-087789bc737f-kube-api-access-n7txj\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993219 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-slash\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993262 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993285 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993300 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993327 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-dbus\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993366 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-log-socket\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993391 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-conf-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993412 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-conf\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993424 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-dbus\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993441 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-hostroot\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993466 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqls\" (UniqueName: \"kubernetes.io/projected/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-kube-api-access-hkqls\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993491 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.994891 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993516 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-multus-daemon-config\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993539 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993562 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-sys-fs\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993595 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvl9\" (UniqueName: \"kubernetes.io/projected/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kube-api-access-2nvl9\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993620 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-k8s-cni-cncf-io\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993670 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-log-socket\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993618 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-ovn\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.993695 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993712 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-lib-modules\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993730 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-conf\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993739 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfw9\" (UniqueName: \"kubernetes.io/projected/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-kube-api-access-rnfw9\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:25.993749 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:26.493732597 +0000 UTC m=+2.310950109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993772 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-hostroot\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993793 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-slash\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993836 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-ovn\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993843 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-lib-modules\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993907 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.995383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993947 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f45l\" (UniqueName: \"kubernetes.io/projected/32dcc5b0-c4fd-485d-bda3-604e8965dcff-kube-api-access-7f45l\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.993972 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-systemd-units\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.994079 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-systemd-units\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.994137 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.994372 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-sys-fs\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.994585 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.994850 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-tuned\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.994939 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7472ef71-a7e6-495f-8212-189582db5c77-ovn-node-metrics-cert\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.995006 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-multus-daemon-config\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.995044 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dd7863e-8391-4629-9a8d-38324d296e87-agent-certs\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.995052 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:25.995887 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:25.995725 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-tmp\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:26.048148 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.048091 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzqs7\" (UniqueName: \"kubernetes.io/projected/7472ef71-a7e6-495f-8212-189582db5c77-kube-api-access-jzqs7\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:26.048546 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.048521 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh6lx\" (UniqueName: \"kubernetes.io/projected/8fc13008-7b5b-4964-baf6-3320a2e3078e-kube-api-access-dh6lx\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:26.049293 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:26.049273 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:46:26.049293 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:26.049295 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:46:26.049456 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:26.049307 2536 projected.go:196] Error preparing data for projected volume kube-api-access-psdrz for pod openshift-network-diagnostics/network-check-target-nrkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:26.049456 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:26.049384 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz podName:ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b nodeName:}" failed. No retries permitted until 2026-11-04 04:46:26.549371877 +0000 UTC m=+2.366589380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-psdrz" (UniqueName: "kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz") pod "network-check-target-nrkxh" (UID: "ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:26.050096 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.050047 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbz86\" (UniqueName: \"kubernetes.io/projected/f8638b06-49e9-43bb-bc66-ea3fd87fd136-kube-api-access-tbz86\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:26.050490 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.050421 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwc8\" (UniqueName: \"kubernetes.io/projected/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-kube-api-access-hxwc8\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:26.051320 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.051145 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7txj\" (UniqueName: \"kubernetes.io/projected/7676efb4-629c-40eb-bada-087789bc737f-kube-api-access-n7txj\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:46:26.052014 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.051994 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvl9\" (UniqueName: \"kubernetes.io/projected/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kube-api-access-2nvl9\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:26.052222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.052203 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f45l\" (UniqueName: \"kubernetes.io/projected/32dcc5b0-c4fd-485d-bda3-604e8965dcff-kube-api-access-7f45l\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:26.053180 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.053163 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqls\" (UniqueName: \"kubernetes.io/projected/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-kube-api-access-hkqls\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:26.053269 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.053230 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfw9\" (UniqueName: \"kubernetes.io/projected/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-kube-api-access-rnfw9\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:26.134756 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.134704 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ltftm" Nov 04 04:46:26.177359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.177326 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:46:26.184335 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.184312 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:46:26.212318 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.212294 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:46:26.213340 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.213326 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:26.226106 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.226086 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:26.246206 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.246187 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:46:26.247455 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.247423 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ee30152979b4b078f521656a245bb9.slice/crio-0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65 WatchSource:0}: Error finding container 0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65: Status 404 returned error can't find the container with id 0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65 Nov 04 04:46:26.248141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.248127 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8a274b_5fa3_4d9c_96a5_44633e6b1cfa.slice/crio-46f32df98e5e6241b32b9558f5dc1fb81f6823b70576a5136aba52e33805f898 WatchSource:0}: Error finding container 46f32df98e5e6241b32b9558f5dc1fb81f6823b70576a5136aba52e33805f898: Status 404 returned error can't find the container with id 46f32df98e5e6241b32b9558f5dc1fb81f6823b70576a5136aba52e33805f898 Nov 04 04:46:26.249307 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.249284 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7472ef71_a7e6_495f_8212_189582db5c77.slice/crio-1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593 WatchSource:0}: Error finding container 1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593: Status 404 returned error can't find the container with id 1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593 Nov 04 04:46:26.249918 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.249887 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247d5fdffbb0596570a9bedc92fe6730.slice/crio-1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7 WatchSource:0}: Error finding container 1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7: Status 404 returned error can't find the container with id 1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7 Nov 04 04:46:26.251566 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.251542 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd7863e_8391_4629_9a8d_38324d296e87.slice/crio-9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904 WatchSource:0}: Error finding container 9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904: Status 404 returned error can't find the container with id 9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904 Nov 04 04:46:26.253141 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.252991 2536 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:46:26.257217 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.256846 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15c33eb_ef11_4c4f_8ee0_c67a30150de3.slice/crio-3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1 WatchSource:0}: Error finding container 3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1: Status 404 returned error can't find the container with id 3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1 Nov 04 04:46:26.264064 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.264045 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gzztp" Nov 04 04:46:26.272055 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:26.272039 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:46:26.272957 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.272939 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7676efb4_629c_40eb_bada_087789bc737f.slice/crio-d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4 WatchSource:0}: Error finding container d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4: Status 404 returned error can't find the container with id d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4 Nov 04 04:46:26.280323 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:26.280302 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1443a9c8_ac47_4262_a21f_88ce5140b3f9.slice/crio-05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d WatchSource:0}: Error finding container 05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d: Status 404 returned error can't find the container with id 05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d Nov 04 04:46:28.015653 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.015622 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:28.015785 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.015691 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:28.015785 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.015778 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:28.015920 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.015810 2536 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:28.015920 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.015854 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:29.015839485 +0000 UTC m=+3.315508517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:28.015920 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.015867 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret podName:5e2ff9d2-73c3-4635-a07a-ca5579d71d65 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:29.015861439 +0000 UTC m=+3.315530472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret") pod "global-pull-secret-syncer-sf9x7" (UID: "5e2ff9d2-73c3-4635-a07a-ca5579d71d65") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:28.116638 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.116604 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:28.117310 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.116724 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:46:28.117310 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.116739 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:46:28.117310 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.116749 2536 projected.go:196] Error preparing data for projected volume kube-api-access-psdrz for pod openshift-network-diagnostics/network-check-target-nrkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:28.117310 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:28.116806 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz podName:ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b nodeName:}" failed. No retries permitted until 2026-11-04 04:46:29.116780304 +0000 UTC m=+3.416449336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-psdrz" (UniqueName: "kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz") pod "network-check-target-nrkxh" (UID: "ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:28.182985 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.182932 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"247d5fdffbb0596570a9bedc92fe6730","Type":"ContainerStarted","Data":"1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7"} Nov 04 04:46:28.183924 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.183902 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"06ee30152979b4b078f521656a245bb9","Type":"ContainerStarted","Data":"0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65"} Nov 04 04:46:28.186846 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.186823 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" event={"ID":"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa","Type":"ContainerStarted","Data":"46f32df98e5e6241b32b9558f5dc1fb81f6823b70576a5136aba52e33805f898"} Nov 04 04:46:28.187873 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.187856 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" event={"ID":"1443a9c8-ac47-4262-a21f-88ce5140b3f9","Type":"ContainerStarted","Data":"05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d"} Nov 04 04:46:28.188811 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.188781 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gzztp" event={"ID":"7676efb4-629c-40eb-bada-087789bc737f","Type":"ContainerStarted","Data":"d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4"} Nov 04 04:46:28.189694 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.189673 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gfpr" event={"ID":"b15c33eb-ef11-4c4f-8ee0-c67a30150de3","Type":"ContainerStarted","Data":"3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1"} Nov 04 04:46:28.190709 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.190692 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ksbdr" event={"ID":"1dd7863e-8391-4629-9a8d-38324d296e87","Type":"ContainerStarted","Data":"9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904"} Nov 04 04:46:28.191677 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.191661 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593"} Nov 04 04:46:28.374133 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.374059 2536 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:46:28.417398 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.417363 2536 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:46:28.439141 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:28.439114 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc13008_7b5b_4964_baf6_3320a2e3078e.slice/crio-405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea WatchSource:0}: Error finding container 405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea: Status 404 returned error can't find the container with id 405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea Nov 04 04:46:28.457464 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.457423 2536 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 04:41:27 +0000 UTC" deadline="2028-08-17 13:39:31.023168266 +0000 UTC" Nov 04 04:46:28.457464 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:28.457458 2536 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15656h53m2.565712283s" Nov 04 04:46:28.586510 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:28.586480 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32dcc5b0_c4fd_485d_bda3_604e8965dcff.slice/crio-fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8 WatchSource:0}: Error finding container fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8: Status 404 returned error can't find the container with id fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8 Nov 04 04:46:29.023343 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.023308 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:29.023517 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.023359 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:29.023517 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.023490 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:29.023631 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.023573 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:31.023553417 +0000 UTC m=+5.323222463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:29.023695 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.023637 2536 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:29.023695 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.023671 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret podName:5e2ff9d2-73c3-4635-a07a-ca5579d71d65 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:31.023660295 +0000 UTC m=+5.323329334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret") pod "global-pull-secret-syncer-sf9x7" (UID: "5e2ff9d2-73c3-4635-a07a-ca5579d71d65") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:29.124273 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.124239 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:29.124768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.124432 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:46:29.124768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.124455 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:46:29.124768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.124468 2536 projected.go:196] Error preparing data for projected volume kube-api-access-psdrz for pod openshift-network-diagnostics/network-check-target-nrkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:29.124768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.124527 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz podName:ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b nodeName:}" failed. No retries permitted until 2026-11-04 04:46:31.124509411 +0000 UTC m=+5.424178462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-psdrz" (UniqueName: "kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz") pod "network-check-target-nrkxh" (UID: "ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:29.179454 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.179393 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:29.179603 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.179542 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:29.179674 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.179629 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:29.179816 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.179769 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:29.179910 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.179868 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:29.179966 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:29.179941 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:29.200115 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.200039 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8qfx" event={"ID":"32dcc5b0-c4fd-485d-bda3-604e8965dcff","Type":"ContainerStarted","Data":"fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8"} Nov 04 04:46:29.209393 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.209363 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerStarted","Data":"76b3c024a3d41c687e5c0e451b95fed56d096c75c46cc3686ad9c62a0d418efd"} Nov 04 04:46:29.211214 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.211189 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ltftm" event={"ID":"8fc13008-7b5b-4964-baf6-3320a2e3078e","Type":"ContainerStarted","Data":"405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea"} Nov 04 04:46:29.458370 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.458262 2536 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 04:41:27 +0000 UTC" deadline="2028-05-31 09:43:47.499808473 +0000 UTC" Nov 04 04:46:29.458370 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:29.458298 2536 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13780h57m18.041514545s" Nov 04 04:46:31.041546 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:31.041503 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:31.042014 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:31.041557 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:31.042014 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.041704 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:31.042014 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.041766 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:35.041746928 +0000 UTC m=+9.341415961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:31.042198 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.042188 2536 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:31.042254 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.042240 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret podName:5e2ff9d2-73c3-4635-a07a-ca5579d71d65 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:35.042225203 +0000 UTC m=+9.341894257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret") pod "global-pull-secret-syncer-sf9x7" (UID: "5e2ff9d2-73c3-4635-a07a-ca5579d71d65") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:31.142942 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:31.142832 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:31.143119 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.143031 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:46:31.143119 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.143055 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:46:31.143119 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.143068 2536 projected.go:196] Error preparing data for projected volume kube-api-access-psdrz for pod openshift-network-diagnostics/network-check-target-nrkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:31.143336 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.143133 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz podName:ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b nodeName:}" failed. No retries permitted until 2026-11-04 04:46:35.143114833 +0000 UTC m=+9.442783880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-psdrz" (UniqueName: "kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz") pod "network-check-target-nrkxh" (UID: "ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:31.179186 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:31.179156 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:31.179361 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.179277 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:31.179361 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:31.179343 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:31.179483 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.179421 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:31.179483 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:31.179463 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:31.179580 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:31.179525 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:33.180129 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.179760 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:33.180590 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:33.180265 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:33.180744 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.180725 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:33.180867 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:33.180846 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:33.180942 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.180890 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:33.180997 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:33.180967 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:33.235619 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.235574 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ksbdr" event={"ID":"1dd7863e-8391-4629-9a8d-38324d296e87","Type":"ContainerStarted","Data":"6aaf698d08b91a5a4754bda761469033576b5b1e1a2c88b700691c5336942b16"} Nov 04 04:46:33.241987 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.241953 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"247d5fdffbb0596570a9bedc92fe6730","Type":"ContainerStarted","Data":"a178037cbde026ee0541618c5bcc3b39f6069693b5d3861b7871eb19eccca183"} Nov 04 04:46:33.247643 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.247615 2536 generic.go:356] "Generic (PLEG): container finished" podID="06ee30152979b4b078f521656a245bb9" containerID="63582b26733f27b07385b1c06b8596c6ebe4e2422ddf563f744c973a1c011b8c" exitCode=0 Nov 04 04:46:33.247858 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.247835 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"06ee30152979b4b078f521656a245bb9","Type":"ContainerDied","Data":"63582b26733f27b07385b1c06b8596c6ebe4e2422ddf563f744c973a1c011b8c"} Nov 04 04:46:33.258932 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.258368 2536 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="41535a95ad89e3a80cb0c46869343cd00cee354908f66be3641764fb24a2a20e" exitCode=0 Nov 04 04:46:33.258932 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.258402 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerDied","Data":"41535a95ad89e3a80cb0c46869343cd00cee354908f66be3641764fb24a2a20e"} Nov 04 04:46:33.468540 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:33.468493 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ksbdr" podStartSLOduration=2.631634109 podStartE2EDuration="7.468478574s" totalImagesPullingTime="4.836844465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:33.351468107 +0000 UTC m=+7.651137164" watchObservedRunningTime="2026-11-04 04:46:33.468478574 +0000 UTC m=+7.768147627" Nov 04 04:46:34.262846 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:34.262739 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5gfpr" event={"ID":"b15c33eb-ef11-4c4f-8ee0-c67a30150de3","Type":"ContainerStarted","Data":"39ed1c91514c07aa096706a7ba17d27ef901902891b67dc85b665e4ae1daf434"} Nov 04 04:46:34.265861 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:34.265828 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" event={"ID":"1443a9c8-ac47-4262-a21f-88ce5140b3f9","Type":"ContainerStarted","Data":"9ff0b534a4125f11443b781e3c5a6b2e94fcbab740812d2d5baf1ad09d78af86"} Nov 04 04:46:34.272396 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:34.271251 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"06ee30152979b4b078f521656a245bb9","Type":"ContainerStarted","Data":"74d6b04d4fcc06929b58382e79888b1007362f3f7bd94552cc15c77b21a70da7"} Nov 04 04:46:34.376554 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:34.375928 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" podStartSLOduration=8.375909663 podStartE2EDuration="8.375909663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:33.697446117 +0000 UTC m=+7.997115175" watchObservedRunningTime="2026-11-04 04:46:34.375909663 +0000 UTC m=+8.675578718" Nov 04 04:46:34.491142 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:34.490125 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5gfpr" podStartSLOduration=2.8211644 podStartE2EDuration="8.490106967s" totalImagesPullingTime="5.668942567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:34.3767331 +0000 UTC m=+8.676402156" watchObservedRunningTime="2026-11-04 04:46:34.490106967 +0000 UTC m=+8.789776024" Nov 04 04:46:34.491142 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:34.490999 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" podStartSLOduration=8.490986338999999 podStartE2EDuration="8.490986339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:34.490199405 +0000 UTC m=+8.789868463" watchObservedRunningTime="2026-11-04 04:46:34.490986339 +0000 UTC m=+8.790655394" Nov 04 04:46:35.075073 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.074985 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:35.075236 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.075079 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:35.075236 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.075204 2536 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:35.075337 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.075267 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret podName:5e2ff9d2-73c3-4635-a07a-ca5579d71d65 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:43.075248323 +0000 UTC m=+17.374917363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret") pod "global-pull-secret-syncer-sf9x7" (UID: "5e2ff9d2-73c3-4635-a07a-ca5579d71d65") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:35.075591 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.075576 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:35.075669 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.075619 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:43.07560662 +0000 UTC m=+17.375275653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:35.176054 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.176018 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:35.176229 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.176176 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:46:35.176229 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.176192 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:46:35.176229 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.176204 2536 projected.go:196] Error preparing data for projected volume kube-api-access-psdrz for pod openshift-network-diagnostics/network-check-target-nrkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:35.176374 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.176261 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz podName:ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b nodeName:}" failed. No retries permitted until 2026-11-04 04:46:43.176245405 +0000 UTC m=+17.475914444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-psdrz" (UniqueName: "kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz") pod "network-check-target-nrkxh" (UID: "ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:35.179595 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.179570 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:35.179723 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.179698 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:35.179821 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.179764 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:35.179883 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.179859 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:35.179935 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.179910 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:35.179985 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:35.179968 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:35.766677 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.766640 2536 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:35.767426 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:35.767407 2536 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:36.194890 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:36.192420 2536 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 04:46:36.280698 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:36.280617 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" event={"ID":"1443a9c8-ac47-4262-a21f-88ce5140b3f9","Type":"ContainerStarted","Data":"b417c3ef383061ee705ecc9d861a14823aff14d8505fcad43ce92f0cc3b8c082"} Nov 04 04:46:36.286328 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:36.286290 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gzztp" event={"ID":"7676efb4-629c-40eb-bada-087789bc737f","Type":"ContainerStarted","Data":"9e810298cdc97b9c007ae4db944aadf652c1f9ee6af7d98d9ee0d0f647e0d34d"} Nov 04 04:46:36.401059 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:36.401001 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-gzztp" podStartSLOduration=2.104037782 podStartE2EDuration="10.400983037s" totalImagesPullingTime="8.296945255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:36.400215139 +0000 UTC m=+10.699884194" watchObservedRunningTime="2026-11-04 04:46:36.400983037 +0000 UTC m=+10.700652091" Nov 04 04:46:37.179856 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.179765 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:37.180281 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:37.179899 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:37.180281 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.180191 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:37.180281 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:37.180278 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:37.180441 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.180313 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:37.180441 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:37.180354 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:37.190900 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.190773 2536 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T04:46:36.19244216Z","UUID":"3fae6b92-8740-4f28-adf5-4e8fe02fd2f2","Handler":null,"Name":"","Endpoint":""} Nov 04 04:46:37.192505 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.192484 2536 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 04:46:37.192618 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.192512 2536 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 04:46:37.291269 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.290683 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ltftm" event={"ID":"8fc13008-7b5b-4964-baf6-3320a2e3078e","Type":"ContainerStarted","Data":"2aaf23371f411bbd70aa6f3138e176a19521fb4f20d0da7fdbe85bfd6420aba0"} Nov 04 04:46:37.407085 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:37.406678 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-ltftm" podStartSLOduration=3.067951194 podStartE2EDuration="11.406663901s" totalImagesPullingTime="8.338712707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:37.406656103 +0000 UTC m=+11.706325157" watchObservedRunningTime="2026-11-04 04:46:37.406663901 +0000 UTC m=+11.706332954" Nov 04 04:46:38.295040 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:38.294992 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" event={"ID":"1443a9c8-ac47-4262-a21f-88ce5140b3f9","Type":"ContainerStarted","Data":"d97b6904f9210dea6c6c89cd7d223d8849ecd0312434a490ab4f016869b28fb3"} Nov 04 04:46:38.296673 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:38.296647 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8qfx" event={"ID":"32dcc5b0-c4fd-485d-bda3-604e8965dcff","Type":"ContainerStarted","Data":"c92999f48365c344eca164aa112550bdf633e13d234f4298de3164dd0280c6ea"} Nov 04 04:46:38.298419 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:38.298397 2536 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="5dda0c68857efecb3ca36493bee0c8224a75b47375a8ba462b6dbc495f019c87" exitCode=0 Nov 04 04:46:38.298535 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:38.298517 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerDied","Data":"5dda0c68857efecb3ca36493bee0c8224a75b47375a8ba462b6dbc495f019c87"} Nov 04 04:46:38.413077 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:38.413020 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" podStartSLOduration=2.730376486 podStartE2EDuration="12.412999712s" totalImagesPullingTime="9.682623226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:38.412846008 +0000 UTC m=+12.712515064" watchObservedRunningTime="2026-11-04 04:46:38.412999712 +0000 UTC m=+12.712668767" Nov 04 04:46:39.180087 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:39.180049 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:39.180087 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:39.180086 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:39.180329 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:39.180106 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:39.180329 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:39.180230 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:39.180329 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:39.180307 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:39.180432 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:39.180390 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:39.302665 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:39.302627 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" event={"ID":"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa","Type":"ContainerStarted","Data":"e5bd8d3af385c862dd3c6b726d2053d91f4028cdc7d0a2b663a930005e3c95df"} Nov 04 04:46:39.529122 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:39.529074 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c8qfx" podStartSLOduration=5.241369448 podStartE2EDuration="13.529060508s" totalImagesPullingTime="8.28769106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:39.528740563 +0000 UTC m=+13.828409616" watchObservedRunningTime="2026-11-04 04:46:39.529060508 +0000 UTC m=+13.828729562" Nov 04 04:46:39.529293 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:39.529273 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" podStartSLOduration=2.827193041 podStartE2EDuration="13.529269723s" totalImagesPullingTime="10.702076682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:39.415902169 +0000 UTC m=+13.715571225" watchObservedRunningTime="2026-11-04 04:46:39.529269723 +0000 UTC m=+13.828938774" Nov 04 04:46:40.307063 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:40.307021 2536 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="1c6263075e9a31daadff3addc64a659d18005adda43d83a70ac65fe16939a7e8" exitCode=0 Nov 04 04:46:40.307662 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:40.307109 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerDied","Data":"1c6263075e9a31daadff3addc64a659d18005adda43d83a70ac65fe16939a7e8"} Nov 04 04:46:41.179117 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:41.179083 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:41.179311 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:41.179210 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:41.179370 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:41.179303 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:41.179370 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:41.179217 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:41.179370 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:41.179213 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:41.179502 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:41.179394 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:42.316763 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:42.316580 2536 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="6d59dc5d8df6139233a7e07db0ea404b5cb9eb9156189419790902f56417da75" exitCode=0 Nov 04 04:46:42.316763 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:42.316664 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerDied","Data":"6d59dc5d8df6139233a7e07db0ea404b5cb9eb9156189419790902f56417da75"} Nov 04 04:46:43.142633 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.142447 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:43.142847 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.142591 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:43.142847 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.142750 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:59.142735054 +0000 UTC m=+33.442404098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 04 04:46:43.142847 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.142685 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:43.142847 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.142760 2536 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:43.142847 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.142829 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret podName:5e2ff9d2-73c3-4635-a07a-ca5579d71d65 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:59.142820649 +0000 UTC m=+33.442489682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret") pod "global-pull-secret-syncer-sf9x7" (UID: "5e2ff9d2-73c3-4635-a07a-ca5579d71d65") : object "kube-system"/"original-pull-secret" not registered Nov 04 04:46:43.178984 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.178954 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:43.179137 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.179023 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:43.179137 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.179114 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:43.179137 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.179122 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:43.179229 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.179175 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:43.179267 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.179252 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:43.243888 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.243854 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:43.244028 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.243999 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 04 04:46:43.244028 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.244016 2536 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 04 04:46:43.244028 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.244025 2536 projected.go:196] Error preparing data for projected volume kube-api-access-psdrz for pod openshift-network-diagnostics/network-check-target-nrkxh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:43.244135 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:43.244071 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz podName:ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b nodeName:}" failed. No retries permitted until 2026-11-04 04:46:59.244058802 +0000 UTC m=+33.543727835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-psdrz" (UniqueName: "kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz") pod "network-check-target-nrkxh" (UID: "ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 04 04:46:43.321869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.321842 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:46:43.322277 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322149 2536 generic.go:356] "Generic (PLEG): container finished" podID="7472ef71-a7e6-495f-8212-189582db5c77" containerID="852560e022bc5ee345f060f44a5ff6995ef5ac2b56a7c473aa43cd21701ed05d" exitCode=1 Nov 04 04:46:43.322277 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322191 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"f017de5d78596384bba565e255d13e5a78ddc2b647b501b3b503da83d9079dc1"} Nov 04 04:46:43.322277 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322262 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"78d8db32e52833dacf01c6f7fa894ae53be00f3e008d1d368d9204ac5d2ebcff"} Nov 04 04:46:43.322380 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322295 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"cb3a5548aace9d5efb462d3a54add9600a4146e54c4e17eb58018babe3238770"} Nov 04 04:46:43.322380 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322324 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"b6b7a7986eae43f056eb2990f1b30a2151805de67aa8ec4a6007525af860cade"} Nov 04 04:46:43.322380 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322351 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerDied","Data":"852560e022bc5ee345f060f44a5ff6995ef5ac2b56a7c473aa43cd21701ed05d"} Nov 04 04:46:43.322380 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:43.322380 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"6925edeece9bb046acaf6a0642de3adf42dcdcdd957d994e9b3189e8f71f2e1b"} Nov 04 04:46:45.180056 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.179972 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:45.180056 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.179993 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:45.180560 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.180075 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:45.180560 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:45.180077 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:45.180560 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:45.180152 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:45.180560 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:45.180213 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:45.329665 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.329635 2536 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="bbeba408cb6cbb01d753e91af1304ff0d238df9e2b825156de382b7ea5d65a90" exitCode=0 Nov 04 04:46:45.329842 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.329716 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerDied","Data":"bbeba408cb6cbb01d753e91af1304ff0d238df9e2b825156de382b7ea5d65a90"} Nov 04 04:46:45.332783 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.332767 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:46:45.333191 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:45.333168 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"07bc9410a018eab32033c806e510e2837e80b969a4bf15c4e8f185a63a3e1bf5"} Nov 04 04:46:46.337602 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:46.337570 2536 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="4a0c46cbea4ab28a9ff11ad301770fa74a8ebcf04d0f4ae6c5ab4e97eac771cc" exitCode=0 Nov 04 04:46:46.338037 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:46.337616 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerDied","Data":"4a0c46cbea4ab28a9ff11ad301770fa74a8ebcf04d0f4ae6c5ab4e97eac771cc"} Nov 04 04:46:47.179970 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.179669 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:47.179970 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.179685 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:47.180240 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:47.179975 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:47.180240 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.179703 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:47.180240 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:47.180052 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:47.180240 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:47.180117 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:47.342823 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.342773 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4l4df" event={"ID":"f8638b06-49e9-43bb-bc66-ea3fd87fd136","Type":"ContainerStarted","Data":"027fcf61739cb1406ff5884afe783f92ba76ad58410ce6f12a72ef6a557ee3c5"} Nov 04 04:46:47.345971 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.345950 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:46:47.346275 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.346254 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"fd0f6e2d7a776d714e08c41667e2a95ffe35320882ef564556215cbffa769e62"} Nov 04 04:46:47.346480 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.346464 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:47.346550 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.346508 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:47.346651 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.346635 2536 scope.go:122] "RemoveContainer" containerID="852560e022bc5ee345f060f44a5ff6995ef5ac2b56a7c473aa43cd21701ed05d" Nov 04 04:46:47.362841 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.362821 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:47.459498 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:47.459400 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4l4df" podStartSLOduration=9.669359699 podStartE2EDuration="21.459386371s" totalImagesPullingTime="11.790026672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:47.459084336 +0000 UTC m=+21.758753390" watchObservedRunningTime="2026-11-04 04:46:47.459386371 +0000 UTC m=+21.759055421" Nov 04 04:46:48.352223 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:48.352193 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:46:48.352855 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:48.352568 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" event={"ID":"7472ef71-a7e6-495f-8212-189582db5c77","Type":"ContainerStarted","Data":"d79cf13191ccf02ad3c3b6275879cf39299f5ba420b2ad408fff9b8171232fee"} Nov 04 04:46:48.353116 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:48.353095 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:48.368307 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:48.368279 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:46:48.624198 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:48.623008 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" podStartSLOduration=8.032014407 podStartE2EDuration="22.622988587s" totalImagesPullingTime="14.59097418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:48.612274515 +0000 UTC m=+22.911943570" watchObservedRunningTime="2026-11-04 04:46:48.622988587 +0000 UTC m=+22.922657641" Nov 04 04:46:49.179557 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.179526 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:49.179557 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.179540 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:49.179903 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.179617 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:49.179903 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:49.179628 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:49.179903 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:49.179712 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:49.179903 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:49.179825 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:49.715463 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.715424 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5wzcr"] Nov 04 04:46:49.715991 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.715565 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:49.715991 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:49.715717 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:49.716189 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.716171 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrkxh"] Nov 04 04:46:49.716344 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.716255 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:49.716402 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:49.716348 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:49.718229 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.718208 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sf9x7"] Nov 04 04:46:49.718324 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:49.718273 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:49.718381 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:49.718335 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:51.179839 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:51.179788 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:51.180271 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:51.179872 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:51.180271 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:51.179980 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:51.180271 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:51.180002 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:51.180271 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:51.180068 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:51.180271 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:51.180094 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:53.179299 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:53.179212 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:53.179677 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:53.179323 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:53.179677 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:53.179348 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf9x7" podUID="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" Nov 04 04:46:53.179677 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:53.179363 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:53.179677 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:53.179423 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nrkxh" podUID="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" Nov 04 04:46:53.179677 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:53.179488 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5wzcr" podUID="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" Nov 04 04:46:53.923830 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:53.923779 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:53.924015 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:53.923918 2536 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:46:53.924415 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:53.924393 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:46:54.954939 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:54.954690 2536 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeReady" Nov 04 04:46:54.955431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:54.954999 2536 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 04 04:46:55.068201 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.068163 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6jczj"] Nov 04 04:46:55.071444 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.071398 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-97npv"] Nov 04 04:46:55.073007 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.072985 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:46:55.075279 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.075261 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pnlsz"] Nov 04 04:46:55.075408 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.075391 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:46:55.078115 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.078100 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.109694 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.109659 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-5t5wk"] Nov 04 04:46:55.112653 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.112637 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m"] Nov 04 04:46:55.112781 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.112764 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:46:55.115411 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.115393 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.118106 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.118077 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-25b7z"] Nov 04 04:46:55.121944 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.121923 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2c596"] Nov 04 04:46:55.122060 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.122042 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.124960 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.124939 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb"] Nov 04 04:46:55.125054 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.125040 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.125264 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.125223 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jh7\" (UniqueName: \"kubernetes.io/projected/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b-kube-api-access-g7jh7\") pod \"kas-connection-checker-685895c7c9-6jczj\" (UID: \"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b\") " pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:46:55.127611 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.127594 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx"] Nov 04 04:46:55.127731 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.127716 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.130967 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.130950 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p"] Nov 04 04:46:55.131079 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.131063 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.133626 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.133608 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74447c8475-62kjf"] Nov 04 04:46:55.133743 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.133728 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:46:55.136198 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.136181 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-mqqtb"] Nov 04 04:46:55.136373 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.136320 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.138947 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.138927 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2"] Nov 04 04:46:55.139035 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.139027 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.141600 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.141586 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gpnl8"] Nov 04 04:46:55.141714 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.141700 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.144317 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.144290 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.160597 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.160572 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74898b77c8-h48lw"] Nov 04 04:46:55.163885 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.163868 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cbb59b655-6pcvb"] Nov 04 04:46:55.164022 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.164008 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.167588 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.167564 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 04:46:55.168278 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.168258 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 04:46:55.168428 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.168402 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-psc56\"" Nov 04 04:46:55.168553 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.168536 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.168643 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.168624 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.169069 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.169046 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.170381 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.170356 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-dl259"] Nov 04 04:46:55.173976 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.173955 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6jczj"] Nov 04 04:46:55.174101 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.173985 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-97npv"] Nov 04 04:46:55.174101 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.173999 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pnlsz"] Nov 04 04:46:55.174101 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.174096 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:46:55.179104 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.179081 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-5t5wk"] Nov 04 04:46:55.179259 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.179245 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:55.179362 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.179331 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:55.179409 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.179360 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:55.184318 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.184294 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-25b7z"] Nov 04 04:46:55.185208 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.185187 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m"] Nov 04 04:46:55.186199 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.186172 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx"] Nov 04 04:46:55.186900 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.186880 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p"] Nov 04 04:46:55.188910 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.188896 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2c596"] Nov 04 04:46:55.189589 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.189568 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb"] Nov 04 04:46:55.225774 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225744 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.225926 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225782 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-default-certificate\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.225926 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225863 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hndv8\" (UniqueName: \"kubernetes.io/projected/142a2dc1-069f-4121-a94b-c8a11c7d5570-kube-api-access-hndv8\") pod \"volume-data-source-validator-58c9f5f46d-bpm6p\" (UID: \"142a2dc1-069f-4121-a94b-c8a11c7d5570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:46:55.225926 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225888 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh7\" (UniqueName: \"kubernetes.io/projected/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b-kube-api-access-g7jh7\") pod \"kas-connection-checker-685895c7c9-6jczj\" (UID: \"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b\") " pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:46:55.225926 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225913 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9abd182-e801-44f6-a8ba-b9087aa0dca6-cert\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225929 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-service-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225945 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cd79d78-ad19-47ae-942a-360a52bf522f-config-volume\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.225981 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-stats-auth\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226006 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226052 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdndc\" (UniqueName: \"kubernetes.io/projected/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-kube-api-access-tdndc\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226078 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226100 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbhxl\" (UniqueName: \"kubernetes.io/projected/0d2b9220-c17e-4f7a-8263-a00a86a03c81-kube-api-access-bbhxl\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226117 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226133 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.226147 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226147 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226163 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpggk\" (UniqueName: \"kubernetes.io/projected/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf-kube-api-access-tpggk\") pod \"kas-connection-checker-685895c7c9-5t5wk\" (UID: \"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf\") " pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226178 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226201 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226221 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226257 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5p59\" (UniqueName: \"kubernetes.io/projected/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-kube-api-access-g5p59\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226273 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd79d78-ad19-47ae-942a-360a52bf522f-tmp-dir\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226438 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226467 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-snapshots\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226498 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c148a52-c563-4f42-9d49-0606acf343e6-serving-cert\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226541 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslwv\" (UniqueName: \"kubernetes.io/projected/6bd96fe8-a858-4742-8b93-75b58c9e48a8-kube-api-access-bslwv\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226569 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7nnj\" (UniqueName: \"kubernetes.io/projected/e9abd182-e801-44f6-a8ba-b9087aa0dca6-kube-api-access-r7nnj\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226602 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226627 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-config\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.226693 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226673 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd96fe8-a858-4742-8b93-75b58c9e48a8-serving-cert\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226743 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226777 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226909 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.226972 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m28pd\" (UniqueName: \"kubernetes.io/projected/1c148a52-c563-4f42-9d49-0606acf343e6-kube-api-access-m28pd\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227011 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-serving-cert\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227036 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227104 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227242 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227284 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lq9l\" (UniqueName: \"kubernetes.io/projected/3cd79d78-ad19-47ae-942a-360a52bf522f-kube-api-access-5lq9l\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227316 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-config\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227391 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x992\" (UniqueName: \"kubernetes.io/projected/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-kube-api-access-7x992\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227433 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7hw\" (UniqueName: \"kubernetes.io/projected/3d019953-b35c-4683-bba1-7fa5f86ed823-kube-api-access-mg7hw\") pod \"kas-connection-checker-685895c7c9-97npv\" (UID: \"3d019953-b35c-4683-bba1-7fa5f86ed823\") " pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227474 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-tmp\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227495 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.227624 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227526 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12dada1b-2c87-4515-ab1f-2022d70d5c1a-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227560 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv6vh\" (UniqueName: \"kubernetes.io/projected/1944e222-fe66-4a8b-a407-184928fdc15a-kube-api-access-tv6vh\") pod \"network-check-source-6f78d59f99-dl259\" (UID: \"1944e222-fe66-4a8b-a407-184928fdc15a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227583 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-trusted-ca\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227630 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227662 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227685 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227746 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227780 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227830 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz2ws\" (UniqueName: \"kubernetes.io/projected/4867d39c-aede-492d-bdd5-51b57b9baed4-kube-api-access-lz2ws\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227864 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227886 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227902 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.228914 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.227917 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230766 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230885 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230888 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230928 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230939 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230976 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.230947 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231027 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231037 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231046 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231050 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231063 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 04:46:55.231099 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231079 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 04:46:55.231725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231195 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 04:46:55.231725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231196 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.231725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231257 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.231725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231265 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 04:46:55.231725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231436 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.231725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231559 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.232008 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.231734 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.232008 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232000 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 04:46:55.232098 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232027 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 04:46:55.232098 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232072 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 04:46:55.232190 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232115 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.232243 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232195 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 04:46:55.232307 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232283 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvvjk\"" Nov 04 04:46:55.232358 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232298 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 04:46:55.232358 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232314 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.232358 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.232343 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.234280 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.234258 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hn6dc\"" Nov 04 04:46:55.234480 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.234331 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 04:46:55.234546 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.234531 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.237883 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.237845 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.237996 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.237881 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.237996 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.237909 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.277387 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.277354 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 04:46:55.277387 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.277354 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rccwk\"" Nov 04 04:46:55.277590 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.277405 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 04:46:55.277590 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.277413 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 04:46:55.277590 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.277429 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9cn8l\"" Nov 04 04:46:55.281196 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.281173 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hrfp5\"" Nov 04 04:46:55.281359 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.281201 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 04:46:55.281519 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.281496 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9n58l\"" Nov 04 04:46:55.281611 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.281547 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6sxpx\"" Nov 04 04:46:55.281611 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.281585 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vmx8x\"" Nov 04 04:46:55.281850 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.281812 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 04:46:55.282433 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.282386 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 04:46:55.282570 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.282474 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 04:46:55.282570 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.282541 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 04:46:55.282703 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.282630 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-q5r74\"" Nov 04 04:46:55.282854 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.282819 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 04:46:55.327350 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.327311 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f6mcg\"" Nov 04 04:46:55.327781 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.327765 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 04:46:55.329595 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329323 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.329595 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329327 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2"] Nov 04 04:46:55.329595 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329530 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lq9l\" (UniqueName: \"kubernetes.io/projected/3cd79d78-ad19-47ae-942a-360a52bf522f-kube-api-access-5lq9l\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.329595 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329581 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-config\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.329869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329636 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x992\" (UniqueName: \"kubernetes.io/projected/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-kube-api-access-7x992\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.329869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329705 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7hw\" (UniqueName: \"kubernetes.io/projected/3d019953-b35c-4683-bba1-7fa5f86ed823-kube-api-access-mg7hw\") pod \"kas-connection-checker-685895c7c9-97npv\" (UID: \"3d019953-b35c-4683-bba1-7fa5f86ed823\") " pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:46:55.329869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329737 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-tmp\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.329869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329780 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.329869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329829 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12dada1b-2c87-4515-ab1f-2022d70d5c1a-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.329869 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329861 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv6vh\" (UniqueName: \"kubernetes.io/projected/1944e222-fe66-4a8b-a407-184928fdc15a-kube-api-access-tv6vh\") pod \"network-check-source-6f78d59f99-dl259\" (UID: \"1944e222-fe66-4a8b-a407-184928fdc15a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:46:55.330112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329904 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-trusted-ca\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.330112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329940 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.330112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.329985 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.330112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330009 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.330112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330054 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.330112 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330085 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.330376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330130 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2ws\" (UniqueName: \"kubernetes.io/projected/4867d39c-aede-492d-bdd5-51b57b9baed4-kube-api-access-lz2ws\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.330376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330168 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.330376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330212 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.330376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330276 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.330376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330307 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.330376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330353 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.330612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330380 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-default-certificate\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.330612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330410 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hndv8\" (UniqueName: \"kubernetes.io/projected/142a2dc1-069f-4121-a94b-c8a11c7d5570-kube-api-access-hndv8\") pod \"volume-data-source-validator-58c9f5f46d-bpm6p\" (UID: \"142a2dc1-069f-4121-a94b-c8a11c7d5570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:46:55.330612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330455 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9abd182-e801-44f6-a8ba-b9087aa0dca6-cert\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.330612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330501 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-service-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.330612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330531 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cd79d78-ad19-47ae-942a-360a52bf522f-config-volume\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.330612 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330590 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-stats-auth\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.330880 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330629 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.330880 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330709 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdndc\" (UniqueName: \"kubernetes.io/projected/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-kube-api-access-tdndc\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.330880 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330755 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.330880 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330787 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbhxl\" (UniqueName: \"kubernetes.io/projected/0d2b9220-c17e-4f7a-8263-a00a86a03c81-kube-api-access-bbhxl\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.330880 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330840 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.331082 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330873 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.331082 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330919 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.331082 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.330951 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpggk\" (UniqueName: \"kubernetes.io/projected/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf-kube-api-access-tpggk\") pod \"kas-connection-checker-685895c7c9-5t5wk\" (UID: \"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf\") " pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:46:55.331215 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331117 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.331215 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331147 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.331215 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331199 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.331346 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331246 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5p59\" (UniqueName: \"kubernetes.io/projected/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-kube-api-access-g5p59\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.331346 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331278 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd79d78-ad19-47ae-942a-360a52bf522f-tmp-dir\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.331441 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331309 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331473 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-snapshots\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331597 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c148a52-c563-4f42-9d49-0606acf343e6-serving-cert\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331752 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslwv\" (UniqueName: \"kubernetes.io/projected/6bd96fe8-a858-4742-8b93-75b58c9e48a8-kube-api-access-bslwv\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331811 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7nnj\" (UniqueName: \"kubernetes.io/projected/e9abd182-e801-44f6-a8ba-b9087aa0dca6-kube-api-access-r7nnj\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.331851 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332191 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332253 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332514 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-service-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332568 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-config\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332610 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd96fe8-a858-4742-8b93-75b58c9e48a8-serving-cert\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332627 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cd79d78-ad19-47ae-942a-360a52bf522f-config-volume\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332650 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332851 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.332867 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-tmp\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.332928 2536 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.333037 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.833015848 +0000 UTC m=+30.132684900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : secret "router-metrics-certs-default" not found Nov 04 04:46:55.333283 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.333200 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 04:46:55.334294 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.333764 2536 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:46:55.334294 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.333878 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.833848101 +0000 UTC m=+30.133517134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:46:55.334294 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.333983 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.334564 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.334540 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.334619 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.334607 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.334668 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.334655 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28pd\" (UniqueName: \"kubernetes.io/projected/1c148a52-c563-4f42-9d49-0606acf343e6-kube-api-access-m28pd\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.334714 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.334691 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-serving-cert\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.334761 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.334725 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.334827 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.334758 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.335126 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.335098 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-config\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.335246 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.335152 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.335410 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.335391 2536 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:55.335410 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.335401 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-w4xfx\"" Nov 04 04:46:55.335537 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.335460 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mrmbg\"" Nov 04 04:46:55.335584 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.335550 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:55.335584 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.335564 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:46:55.336293 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.336090 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.336293 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.335672 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12dada1b-2c87-4515-ab1f-2022d70d5c1a-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.336293 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.336122 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-config\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.336293 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.336201 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.336293 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.336281 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-n7w7t\"" Nov 04 04:46:55.336570 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.335808 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 04:46:55.337402 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.337378 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:55.337521 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.337508 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:46:55.337597 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.337516 2536 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:46:55.338136 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.337718 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.338136 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.337965 2536 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:46:55.338136 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.338022 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.837999222 +0000 UTC m=+30.137668271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:46:55.338136 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.337579 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd79d78-ad19-47ae-942a-360a52bf522f-tmp-dir\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.338136 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.338088 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.838077043 +0000 UTC m=+30.137746089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:55.339310 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.339264 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.838249851 +0000 UTC m=+30.137918898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:46:55.339428 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.339389 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-snapshots\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.340481 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.340454 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.340623 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.340597 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.340885 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.340855 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.340885 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.340879 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.840852216 +0000 UTC m=+30.140521265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:46:55.341018 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.340974 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.341068 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341045 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.341290 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341268 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-default-certificate\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.341469 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341293 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-stats-auth\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.341527 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341313 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.341527 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341473 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jh7\" (UniqueName: \"kubernetes.io/projected/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b-kube-api-access-g7jh7\") pod \"kas-connection-checker-685895c7c9-6jczj\" (UID: \"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b\") " pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:46:55.341620 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341567 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.341670 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.341626 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.841612421 +0000 UTC m=+30.141281454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:46:55.341728 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.341659 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls podName:3cd79d78-ad19-47ae-942a-360a52bf522f nodeName:}" failed. No retries permitted until 2026-11-04 04:46:55.841650204 +0000 UTC m=+30.141319237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls") pod "dns-default-2c596" (UID: "3cd79d78-ad19-47ae-942a-360a52bf522f") : secret "dns-default-metrics-tls" not found Nov 04 04:46:55.341933 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341829 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.341933 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.341875 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cbb59b655-6pcvb"] Nov 04 04:46:55.342184 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.342130 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.342184 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.342144 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-trusted-ca\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.342569 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.342549 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd96fe8-a858-4742-8b93-75b58c9e48a8-serving-cert\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.343090 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.343073 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-mqqtb"] Nov 04 04:46:55.344113 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.344086 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c148a52-c563-4f42-9d49-0606acf343e6-serving-cert\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.344252 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.344132 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74447c8475-62kjf"] Nov 04 04:46:55.344252 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.344213 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9abd182-e801-44f6-a8ba-b9087aa0dca6-cert\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.344252 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.344247 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-serving-cert\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.344911 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.344894 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74898b77c8-h48lw"] Nov 04 04:46:55.345453 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.345440 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpnl8"] Nov 04 04:46:55.346050 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.346035 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-dl259"] Nov 04 04:46:55.384954 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.384925 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:46:55.388199 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.388165 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lq9l\" (UniqueName: \"kubernetes.io/projected/3cd79d78-ad19-47ae-942a-360a52bf522f-kube-api-access-5lq9l\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.388632 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.388616 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbhxl\" (UniqueName: \"kubernetes.io/projected/0d2b9220-c17e-4f7a-8263-a00a86a03c81-kube-api-access-bbhxl\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.389449 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.389426 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x992\" (UniqueName: \"kubernetes.io/projected/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-kube-api-access-7x992\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.389603 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.389581 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7hw\" (UniqueName: \"kubernetes.io/projected/3d019953-b35c-4683-bba1-7fa5f86ed823-kube-api-access-mg7hw\") pod \"kas-connection-checker-685895c7c9-97npv\" (UID: \"3d019953-b35c-4683-bba1-7fa5f86ed823\") " pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:46:55.391829 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.391787 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:46:55.391940 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.391906 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.392053 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.392031 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.392421 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.392401 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.392880 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.392861 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv6vh\" (UniqueName: \"kubernetes.io/projected/1944e222-fe66-4a8b-a407-184928fdc15a-kube-api-access-tv6vh\") pod \"network-check-source-6f78d59f99-dl259\" (UID: \"1944e222-fe66-4a8b-a407-184928fdc15a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:46:55.397510 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.397430 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hndv8\" (UniqueName: \"kubernetes.io/projected/142a2dc1-069f-4121-a94b-c8a11c7d5570-kube-api-access-hndv8\") pod \"volume-data-source-validator-58c9f5f46d-bpm6p\" (UID: \"142a2dc1-069f-4121-a94b-c8a11c7d5570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.400145 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpggk\" (UniqueName: \"kubernetes.io/projected/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf-kube-api-access-tpggk\") pod \"kas-connection-checker-685895c7c9-5t5wk\" (UID: \"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf\") " pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.401593 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5p59\" (UniqueName: \"kubernetes.io/projected/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-kube-api-access-g5p59\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.401617 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2ws\" (UniqueName: \"kubernetes.io/projected/4867d39c-aede-492d-bdd5-51b57b9baed4-kube-api-access-lz2ws\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.401781 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28pd\" (UniqueName: \"kubernetes.io/projected/1c148a52-c563-4f42-9d49-0606acf343e6-kube-api-access-m28pd\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.402125 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7nnj\" (UniqueName: \"kubernetes.io/projected/e9abd182-e801-44f6-a8ba-b9087aa0dca6-kube-api-access-r7nnj\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.403047 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdndc\" (UniqueName: \"kubernetes.io/projected/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-kube-api-access-tdndc\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.403145 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslwv\" (UniqueName: \"kubernetes.io/projected/6bd96fe8-a858-4742-8b93-75b58c9e48a8-kube-api-access-bslwv\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.404076 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.403299 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.425479 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.425444 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:46:55.430326 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.430286 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:46:55.437663 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.437479 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:46:55.455162 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.454963 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:46:55.463925 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.460876 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:46:55.484394 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.484032 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:46:55.513986 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.509963 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:46:55.519917 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.519884 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:46:55.784655 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.784431 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-97npv"] Nov 04 04:46:55.786982 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.786957 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d019953_b35c_4683_bba1_7fa5f86ed823.slice/crio-ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345 WatchSource:0}: Error finding container ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345: Status 404 returned error can't find the container with id ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345 Nov 04 04:46:55.790264 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.790225 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-6jczj"] Nov 04 04:46:55.792670 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.792650 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06238b1_20bb_4835_bdac_4fdd5fa9ce2b.slice/crio-0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288 WatchSource:0}: Error finding container 0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288: Status 404 returned error can't find the container with id 0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288 Nov 04 04:46:55.840908 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.840872 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:55.841030 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.840926 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.841030 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.840999 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:55.841136 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.841058 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:55.841136 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.841085 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:55.841243 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.841226 2536 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:46:55.841303 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.841292 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.841274473 +0000 UTC m=+31.140943524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:46:55.841427 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.841413 2536 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:46:55.841479 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.841455 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.841444107 +0000 UTC m=+31.141113153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:46:55.841588 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.841574 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:55.841635 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.841592 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:46:55.846911 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.846419 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.841681936 +0000 UTC m=+31.141350985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:46:55.846911 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.846764 2536 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:46:55.846911 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.846838 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.846822721 +0000 UTC m=+31.146491774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : secret "router-metrics-certs-default" not found Nov 04 04:46:55.847144 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.847130 2536 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:55.847200 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.847171 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.847158705 +0000 UTC m=+31.146827754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:55.847979 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.847958 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-25b7z"] Nov 04 04:46:55.848270 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.848235 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c148a52_c563_4f42_9d49_0606acf343e6.slice/crio-3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089 WatchSource:0}: Error finding container 3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089: Status 404 returned error can't find the container with id 3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089 Nov 04 04:46:55.849741 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.849720 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m"] Nov 04 04:46:55.852976 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.852955 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff5a0f6_ec54_42d0_ba0e_397ab74c2c80.slice/crio-bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36 WatchSource:0}: Error finding container bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36: Status 404 returned error can't find the container with id bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36 Nov 04 04:46:55.865297 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.865241 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-5t5wk"] Nov 04 04:46:55.867655 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.867599 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p"] Nov 04 04:46:55.875717 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.875697 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4f5a06_6cb8_4f9f_922b_d8060cbfffdf.slice/crio-1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006 WatchSource:0}: Error finding container 1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006: Status 404 returned error can't find the container with id 1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006 Nov 04 04:46:55.876106 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.876081 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142a2dc1_069f_4121_a94b_c8a11c7d5570.slice/crio-3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b WatchSource:0}: Error finding container 3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b: Status 404 returned error can't find the container with id 3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b Nov 04 04:46:55.878885 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.878469 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx"] Nov 04 04:46:55.882101 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.882078 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ef7ea9_2699_46f3_8448_53a7b72b2e0b.slice/crio-ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7 WatchSource:0}: Error finding container ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7: Status 404 returned error can't find the container with id ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7 Nov 04 04:46:55.932092 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.932066 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-mqqtb"] Nov 04 04:46:55.935984 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.935957 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd96fe8_a858_4742_8b93_75b58c9e48a8.slice/crio-cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48 WatchSource:0}: Error finding container cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48: Status 404 returned error can't find the container with id cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48 Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.941828 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.941871 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.941975 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.941994 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.942031 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.942056 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.942036198 +0000 UTC m=+31.241705248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.942104 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.94208658 +0000 UTC m=+31.241755646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.942111 2536 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:46:55.942182 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:55.942162 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls podName:3cd79d78-ad19-47ae-942a-360a52bf522f nodeName:}" failed. No retries permitted until 2026-11-04 04:46:56.942148831 +0000 UTC m=+31.241817887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls") pod "dns-default-2c596" (UID: "3cd79d78-ad19-47ae-942a-360a52bf522f") : secret "dns-default-metrics-tls" not found Nov 04 04:46:55.952516 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.952495 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpnl8"] Nov 04 04:46:55.962436 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:55.962420 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-dl259"] Nov 04 04:46:55.963826 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.963783 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9abd182_e801_44f6_a8ba_b9087aa0dca6.slice/crio-84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e WatchSource:0}: Error finding container 84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e: Status 404 returned error can't find the container with id 84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e Nov 04 04:46:55.964646 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:55.964625 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1944e222_fe66_4a8b_a407_184928fdc15a.slice/crio-ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85 WatchSource:0}: Error finding container ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85: Status 404 returned error can't find the container with id ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85 Nov 04 04:46:56.370610 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.370577 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-25b7z" event={"ID":"1c148a52-c563-4f42-9d49-0606acf343e6","Type":"ContainerStarted","Data":"3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089"} Nov 04 04:46:56.371769 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.371743 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" event={"ID":"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80","Type":"ContainerStarted","Data":"bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36"} Nov 04 04:46:56.373212 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.373188 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" event={"ID":"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf","Type":"ContainerStarted","Data":"636cdc85bc6397a75891a5667dc549edc37d0834e1aacb2fa739c39ee2989f59"} Nov 04 04:46:56.373291 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.373227 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" event={"ID":"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf","Type":"ContainerStarted","Data":"1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006"} Nov 04 04:46:56.374822 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.374775 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-97npv" event={"ID":"3d019953-b35c-4683-bba1-7fa5f86ed823","Type":"ContainerStarted","Data":"3677ba8057c00ae81c51ee8b5dc22184ce4268cd9d57065f1377129df349ab82"} Nov 04 04:46:56.374915 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.374838 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-97npv" event={"ID":"3d019953-b35c-4683-bba1-7fa5f86ed823","Type":"ContainerStarted","Data":"ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345"} Nov 04 04:46:56.376308 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.376279 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-6jczj" event={"ID":"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b","Type":"ContainerStarted","Data":"922b763193809d5f0846db170327a0a4701273f3b083aa0ed64b36d010403f7f"} Nov 04 04:46:56.376398 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.376324 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-6jczj" event={"ID":"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b","Type":"ContainerStarted","Data":"0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288"} Nov 04 04:46:56.377424 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.377403 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" event={"ID":"1944e222-fe66-4a8b-a407-184928fdc15a","Type":"ContainerStarted","Data":"ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85"} Nov 04 04:46:56.378586 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.378567 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" event={"ID":"6bd96fe8-a858-4742-8b93-75b58c9e48a8","Type":"ContainerStarted","Data":"cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48"} Nov 04 04:46:56.379766 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.379738 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpnl8" event={"ID":"e9abd182-e801-44f6-a8ba-b9087aa0dca6","Type":"ContainerStarted","Data":"84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e"} Nov 04 04:46:56.380873 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.380848 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" event={"ID":"142a2dc1-069f-4121-a94b-c8a11c7d5570","Type":"ContainerStarted","Data":"3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b"} Nov 04 04:46:56.381851 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.381833 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" event={"ID":"07ef7ea9-2699-46f3-8448-53a7b72b2e0b","Type":"ContainerStarted","Data":"ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7"} Nov 04 04:46:56.848960 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.848885 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:56.849110 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849019 2536 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:56.849110 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849088 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.849070238 +0000 UTC m=+33.148739289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:56.849267 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.849131 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:56.849267 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.849212 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:56.849267 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.849240 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:56.849403 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.849268 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:56.849450 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849435 2536 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:46:56.849499 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849484 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.849471236 +0000 UTC m=+33.149140282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:46:56.849553 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849537 2536 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:46:56.849597 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849568 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.849559062 +0000 UTC m=+33.149228108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : secret "router-metrics-certs-default" not found Nov 04 04:46:56.849648 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849624 2536 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:46:56.849692 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849656 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.849645008 +0000 UTC m=+33.149314057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:46:56.849749 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849711 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:56.849749 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849722 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:46:56.849882 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.849754 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.849742264 +0000 UTC m=+33.149411311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:46:56.950758 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.950729 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:56.950950 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.950777 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:56.950950 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:56.950823 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:56.950950 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.950897 2536 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:46:56.950950 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.950940 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls podName:3cd79d78-ad19-47ae-942a-360a52bf522f nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.950923895 +0000 UTC m=+33.250592943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls") pod "dns-default-2c596" (UID: "3cd79d78-ad19-47ae-942a-360a52bf522f") : secret "dns-default-metrics-tls" not found Nov 04 04:46:56.951118 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.950956 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.950947929 +0000 UTC m=+33.250616976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:46:56.951118 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.950983 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:56.951118 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.950994 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:46:56.951118 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:56.951027 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:46:58.951016017 +0000 UTC m=+33.250685051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:46:57.334542 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:57.334423 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-97npv" podStartSLOduration=417.334385937 podStartE2EDuration="6m57.334385937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:57.333210962 +0000 UTC m=+31.632880016" watchObservedRunningTime="2026-11-04 04:46:57.334385937 +0000 UTC m=+31.634054998" Nov 04 04:46:57.335007 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:57.334728 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-6jczj" podStartSLOduration=417.334714396 podStartE2EDuration="6m57.334714396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:57.221354248 +0000 UTC m=+31.521023304" watchObservedRunningTime="2026-11-04 04:46:57.334714396 +0000 UTC m=+31.634383448" Nov 04 04:46:57.447648 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:57.447578 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" podStartSLOduration=417.447559292 podStartE2EDuration="6m57.447559292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:57.447022533 +0000 UTC m=+31.746691588" watchObservedRunningTime="2026-11-04 04:46:57.447559292 +0000 UTC m=+31.747228347" Nov 04 04:46:58.397459 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.397385 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" event={"ID":"142a2dc1-069f-4121-a94b-c8a11c7d5570","Type":"ContainerStarted","Data":"30fe894c53e4af3d7dd2b5b44636253709278cfcd6949de03c1720699a3b1039"} Nov 04 04:46:58.870904 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.870871 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:46:58.871070 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.870913 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:58.871070 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871019 2536 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:46:58.871070 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871030 2536 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:58.871162 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871075 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.871053343 +0000 UTC m=+37.170722376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : secret "router-metrics-certs-default" not found Nov 04 04:46:58.871162 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871100 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.87108155 +0000 UTC m=+37.170750592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:46:58.871162 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.871151 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:46:58.871253 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.871187 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:46:58.871253 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.871217 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:46:58.871390 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871373 2536 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:46:58.871420 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871394 2536 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:46:58.871420 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871406 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.871397424 +0000 UTC m=+37.171066456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:46:58.871478 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871433 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.871422048 +0000 UTC m=+37.171091113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:46:58.871478 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871464 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:58.871478 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871477 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:46:58.871579 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.871504 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.8714972 +0000 UTC m=+37.171166232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.972102 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.972152 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:58.972335 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.972452 2536 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.972511 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls podName:3cd79d78-ad19-47ae-942a-360a52bf522f nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.972493596 +0000 UTC m=+37.272162640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls") pod "dns-default-2c596" (UID: "3cd79d78-ad19-47ae-942a-360a52bf522f") : secret "dns-default-metrics-tls" not found Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.972579 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.972588 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.972610 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.972603664 +0000 UTC m=+37.272272709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:46:58.972768 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:58.972671 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.972660704 +0000 UTC m=+37.272329752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:46:59.174192 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.173937 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:59.174192 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.173985 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:46:59.174192 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:59.174132 2536 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 04 04:46:59.174532 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:46:59.174200 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs podName:e9f6a25f-ca01-4224-bd59-ff0205c1aa17 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:31.174180228 +0000 UTC m=+65.473849280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs") pod "network-metrics-daemon-5wzcr" (UID: "e9f6a25f-ca01-4224-bd59-ff0205c1aa17") : secret "metrics-daemon-secret" not found Nov 04 04:46:59.180329 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.180303 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:59.276031 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.275459 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:59.279155 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.279127 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:59.426309 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.426036 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:46:59.434279 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.434181 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:46:59.516932 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.516888 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" podStartSLOduration=409.171271317 podStartE2EDuration="6m51.516874856s" totalImagesPullingTime="2.345603539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:46:59.516242788 +0000 UTC m=+33.815911846" watchObservedRunningTime="2026-11-04 04:46:59.516874856 +0000 UTC m=+33.816543901" Nov 04 04:46:59.871102 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.870981 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sf9x7"] Nov 04 04:46:59.930194 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:46:59.930166 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nrkxh"] Nov 04 04:46:59.963715 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:46:59.963680 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4b01da_24ff_42a9_ad6b_e73f8c6b2c7b.slice/crio-5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434 WatchSource:0}: Error finding container 5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434: Status 404 returned error can't find the container with id 5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434 Nov 04 04:47:00.405841 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:00.405785 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrkxh" event={"ID":"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b","Type":"ContainerStarted","Data":"5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434"} Nov 04 04:47:00.407266 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:00.407236 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sf9x7" event={"ID":"5e2ff9d2-73c3-4635-a07a-ca5579d71d65","Type":"ContainerStarted","Data":"53d950702ffd8af02ec59280d123734ab6b6ed2e257b7ba349aae4e968050b11"} Nov 04 04:47:01.415020 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.414988 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/0.log" Nov 04 04:47:01.416386 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.415707 2536 generic.go:356] "Generic (PLEG): container finished" podID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" containerID="1311715d26877d3dc91343f10e0955b674ae9ad4c985d59e3a387a9bf8a38327" exitCode=255 Nov 04 04:47:01.416924 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.416089 2536 scope.go:122] "RemoveContainer" containerID="1311715d26877d3dc91343f10e0955b674ae9ad4c985d59e3a387a9bf8a38327" Nov 04 04:47:01.416924 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.416326 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" event={"ID":"6bd96fe8-a858-4742-8b93-75b58c9e48a8","Type":"ContainerDied","Data":"1311715d26877d3dc91343f10e0955b674ae9ad4c985d59e3a387a9bf8a38327"} Nov 04 04:47:01.421106 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.420571 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpnl8" event={"ID":"e9abd182-e801-44f6-a8ba-b9087aa0dca6","Type":"ContainerStarted","Data":"bda4b55358d3e0e2a17407a57c76e2ddf9a6c72eb65143b52db8dda9bd4b7f2f"} Nov 04 04:47:01.424604 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.424161 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-25b7z" event={"ID":"1c148a52-c563-4f42-9d49-0606acf343e6","Type":"ContainerStarted","Data":"7bf5dd471060b69ec5b10036bc915b17970682cca2a9efa1d8aee1f35a6938c0"} Nov 04 04:47:01.427176 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.427127 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" event={"ID":"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80","Type":"ContainerStarted","Data":"a09eb0405aa5dadac1a5f45042abb5efb96030518bc5fa5c5cc8af9014f672b4"} Nov 04 04:47:01.602463 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.602419 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sqh8z"] Nov 04 04:47:01.632885 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.632862 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.644850 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.644334 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" podStartSLOduration=409.602053912 podStartE2EDuration="6m54.644317924s" totalImagesPullingTime="5.042264012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:01.64202777 +0000 UTC m=+35.941696824" watchObservedRunningTime="2026-11-04 04:47:01.644317924 +0000 UTC m=+35.943986981" Nov 04 04:47:01.663086 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.663011 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sqh8z"] Nov 04 04:47:01.685964 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.685518 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvrn2\"" Nov 04 04:47:01.686871 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.686331 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 04:47:01.686871 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.686376 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 04:47:01.761725 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.761630 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-25b7z" podStartSLOduration=386.229812044 podStartE2EDuration="6m30.761611886s" totalImagesPullingTime="4.531799842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:01.760350051 +0000 UTC m=+36.060019106" watchObservedRunningTime="2026-11-04 04:47:01.761611886 +0000 UTC m=+36.061280941" Nov 04 04:47:01.812087 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.812055 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.812233 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.812136 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.812281 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.812259 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjtk\" (UniqueName: \"kubernetes.io/projected/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-api-access-hwjtk\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.812321 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.812297 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42385bf-b692-423c-95a5-c29d1a3532d7-crio-socket\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.812411 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.812382 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42385bf-b692-423c-95a5-c29d1a3532d7-data-volume\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.855923 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.855890 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-hs56x-94wmn"] Nov 04 04:47:01.873904 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.873652 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gpnl8" podStartSLOduration=1.5853628309999999 podStartE2EDuration="6.873638898s" totalImagesPullingTime="5.288276067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:01.872307099 +0000 UTC m=+36.171976153" watchObservedRunningTime="2026-11-04 04:47:01.873638898 +0000 UTC m=+36.173307951" Nov 04 04:47:01.879387 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.879351 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.913913 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.914004 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:01.914076 2536 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.914096 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjtk\" (UniqueName: \"kubernetes.io/projected/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-api-access-hwjtk\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.914124 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42385bf-b692-423c-95a5-c29d1a3532d7-crio-socket\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.914189 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42385bf-b692-423c-95a5-c29d1a3532d7-data-volume\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.914470 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42385bf-b692-423c-95a5-c29d1a3532d7-crio-socket\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:01.914486 2536 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:01.914522 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.414502476 +0000 UTC m=+36.714171515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:01.914539 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:02.414529605 +0000 UTC m=+36.714198638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : configmap "kube-rbac-proxy" not found Nov 04 04:47:01.914628 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.914581 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42385bf-b692-423c-95a5-c29d1a3532d7-data-volume\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:01.917681 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.917658 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-hs56x-94wmn"] Nov 04 04:47:01.972888 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:01.972861 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjtk\" (UniqueName: \"kubernetes.io/projected/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-api-access-hwjtk\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:02.016020 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.015622 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.016020 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.015669 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.016020 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.015713 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.016020 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.015734 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.116567 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.116529 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.116715 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.116586 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.116715 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.116644 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.116715 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.116672 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.117730 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.117705 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.118020 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.117997 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.118720 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.118679 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.175369 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.175328 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.206021 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.205994 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:02.420129 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.420048 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:02.420482 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.420190 2536 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:47:02.420482 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.420208 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:02.420482 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.420266 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:03.420244666 +0000 UTC m=+37.719913711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : configmap "kube-rbac-proxy" not found Nov 04 04:47:02.420482 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.420320 2536 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:02.420482 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.420366 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:03.420355463 +0000 UTC m=+37.720024511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:02.433764 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.433740 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/1.log" Nov 04 04:47:02.434312 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.434282 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/0.log" Nov 04 04:47:02.434405 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.434323 2536 generic.go:356] "Generic (PLEG): container finished" podID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" exitCode=255 Nov 04 04:47:02.434896 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.434869 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" event={"ID":"6bd96fe8-a858-4742-8b93-75b58c9e48a8","Type":"ContainerDied","Data":"7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d"} Nov 04 04:47:02.434985 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.434935 2536 scope.go:122] "RemoveContainer" containerID="1311715d26877d3dc91343f10e0955b674ae9ad4c985d59e3a387a9bf8a38327" Nov 04 04:47:02.435196 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.435176 2536 scope.go:122] "RemoveContainer" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" Nov 04 04:47:02.435446 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.435423 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-mqqtb_openshift-console-operator(6bd96fe8-a858-4742-8b93-75b58c9e48a8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" podUID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" Nov 04 04:47:02.757642 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.756679 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7"] Nov 04 04:47:02.773375 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.773343 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv"] Nov 04 04:47:02.775453 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.774880 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:02.787667 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.787095 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:02.817654 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.817603 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7"] Nov 04 04:47:02.827520 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.826648 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmh4m\" (UniqueName: \"kubernetes.io/projected/9b081972-8fb4-4f6b-a930-5e45e9a933d5-kube-api-access-mmh4m\") pod \"migrator-66df5d496b-lh7qv\" (UID: \"9b081972-8fb4-4f6b-a930-5e45e9a933d5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:02.827520 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.826822 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5s7b\" (UniqueName: \"kubernetes.io/projected/3c90286e-b41c-4649-8468-b583b6fcbcef-kube-api-access-v5s7b\") pod \"migrator-66df5d496b-x6fc7\" (UID: \"3c90286e-b41c-4649-8468-b583b6fcbcef\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:02.827520 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.827172 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 04:47:02.827520 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.827277 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6x6qg\"" Nov 04 04:47:02.827520 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.827332 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:02.829155 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.829103 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv"] Nov 04 04:47:02.928006 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.927502 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:02.928006 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.927608 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:02.928006 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.927676 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmh4m\" (UniqueName: \"kubernetes.io/projected/9b081972-8fb4-4f6b-a930-5e45e9a933d5-kube-api-access-mmh4m\") pod \"migrator-66df5d496b-lh7qv\" (UID: \"9b081972-8fb4-4f6b-a930-5e45e9a933d5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:02.928006 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.927749 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:02.928006 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.927779 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:02.928006 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.927840 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:02.928766 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.928738 2536 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.928925 2536 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.928993 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:10.928972262 +0000 UTC m=+45.228641296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929068 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929080 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929114 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:47:10.929102627 +0000 UTC m=+45.228771666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929164 2536 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929206 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:10.929183715 +0000 UTC m=+45.228852750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : secret "router-metrics-certs-default" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929242 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:47:10.929234015 +0000 UTC m=+45.228903047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.929266 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5s7b\" (UniqueName: \"kubernetes.io/projected/3c90286e-b41c-4649-8468-b583b6fcbcef-kube-api-access-v5s7b\") pod \"migrator-66df5d496b-x6fc7\" (UID: \"3c90286e-b41c-4649-8468-b583b6fcbcef\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929343 2536 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:47:02.929546 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:02.929380 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:10.929369465 +0000 UTC m=+45.229038510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:47:02.986897 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.986866 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-hs56x-94wmn"] Nov 04 04:47:03.001697 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:47:02.996462 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1fc023b_934d_4884_b04f_78472b636238.slice/crio-f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0 WatchSource:0}: Error finding container f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0: Status 404 returned error can't find the container with id f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0 Nov 04 04:47:03.001697 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:02.998503 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5s7b\" (UniqueName: \"kubernetes.io/projected/3c90286e-b41c-4649-8468-b583b6fcbcef-kube-api-access-v5s7b\") pod \"migrator-66df5d496b-x6fc7\" (UID: \"3c90286e-b41c-4649-8468-b583b6fcbcef\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:03.001697 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.000177 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmh4m\" (UniqueName: \"kubernetes.io/projected/9b081972-8fb4-4f6b-a930-5e45e9a933d5-kube-api-access-mmh4m\") pod \"migrator-66df5d496b-lh7qv\" (UID: \"9b081972-8fb4-4f6b-a930-5e45e9a933d5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:03.030085 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.030064 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:03.030185 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.030131 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:03.030185 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.030164 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:03.030330 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.030198 2536 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:47:03.030330 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.030252 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls podName:3cd79d78-ad19-47ae-942a-360a52bf522f nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.030238946 +0000 UTC m=+45.329908000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls") pod "dns-default-2c596" (UID: "3cd79d78-ad19-47ae-942a-360a52bf522f") : secret "dns-default-metrics-tls" not found Nov 04 04:47:03.030330 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.030323 2536 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:03.030330 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.030331 2536 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:47:03.030530 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.030350 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.030332614 +0000 UTC m=+45.330001666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:47:03.030530 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.030373 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.030362032 +0000 UTC m=+45.330031072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:47:03.100913 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.100725 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:03.118323 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.118233 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:03.435433 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.435334 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:03.435884 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.435432 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:03.435884 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.435490 2536 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:03.435884 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.435556 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:05.435537637 +0000 UTC m=+39.735206688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:03.435884 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.435586 2536 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:47:03.435884 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.435640 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:05.43562738 +0000 UTC m=+39.735296428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : configmap "kube-rbac-proxy" not found Nov 04 04:47:03.439898 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.439863 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-hs56x-94wmn" event={"ID":"b1fc023b-934d-4884-b04f-78472b636238","Type":"ContainerStarted","Data":"eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98"} Nov 04 04:47:03.440907 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.439920 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-hs56x-94wmn" event={"ID":"b1fc023b-934d-4884-b04f-78472b636238","Type":"ContainerStarted","Data":"f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0"} Nov 04 04:47:03.441825 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.441771 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" event={"ID":"1944e222-fe66-4a8b-a407-184928fdc15a","Type":"ContainerStarted","Data":"d23f085cb557acfb4dedc3e1e3f9c65a8f170c02d41d4dab15b7e2147e5c39d1"} Nov 04 04:47:03.444773 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.444757 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/1.log" Nov 04 04:47:03.445095 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.445080 2536 scope.go:122] "RemoveContainer" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" Nov 04 04:47:03.445237 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:03.445218 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-mqqtb_openshift-console-operator(6bd96fe8-a858-4742-8b93-75b58c9e48a8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" podUID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" Nov 04 04:47:03.447449 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.447431 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" event={"ID":"07ef7ea9-2699-46f3-8448-53a7b72b2e0b","Type":"ContainerStarted","Data":"0dfc01708746232b8119c1575895fcb905e7dfa9d3165896dd968eb2f8c34268"} Nov 04 04:47:03.497755 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.497729 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7"] Nov 04 04:47:03.499678 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:47:03.499648 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c90286e_b41c_4649_8468_b583b6fcbcef.slice/crio-4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737 WatchSource:0}: Error finding container 4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737: Status 404 returned error can't find the container with id 4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737 Nov 04 04:47:03.553106 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.553057 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-hs56x-94wmn" podStartSLOduration=2.553044133 podStartE2EDuration="2.553044133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:03.551574674 +0000 UTC m=+37.851243729" watchObservedRunningTime="2026-11-04 04:47:03.553044133 +0000 UTC m=+37.852713186" Nov 04 04:47:03.604658 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.604592 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv"] Nov 04 04:47:03.607208 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:47:03.607181 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b081972_8fb4_4f6b_a930_5e45e9a933d5.slice/crio-c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6 WatchSource:0}: Error finding container c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6: Status 404 returned error can't find the container with id c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6 Nov 04 04:47:03.666450 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:03.666405 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" podStartSLOduration=385.950566566 podStartE2EDuration="6m32.66639118s" totalImagesPullingTime="6.715824614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:03.666034359 +0000 UTC m=+37.965703414" watchObservedRunningTime="2026-11-04 04:47:03.66639118 +0000 UTC m=+37.966060234" Nov 04 04:47:04.453349 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:04.453310 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nrkxh" event={"ID":"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b","Type":"ContainerStarted","Data":"aa0c56e4859b4dac6bd2fb6594905639e5302cac04b365fe80253f3f3c8bb262"} Nov 04 04:47:04.453786 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:04.453420 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:47:04.454679 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:04.454647 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" event={"ID":"9b081972-8fb4-4f6b-a930-5e45e9a933d5","Type":"ContainerStarted","Data":"c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6"} Nov 04 04:47:04.456040 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:04.456000 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" event={"ID":"3c90286e-b41c-4649-8468-b583b6fcbcef","Type":"ContainerStarted","Data":"4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737"} Nov 04 04:47:04.567056 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:04.566995 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" podStartSLOduration=384.93312478 podStartE2EDuration="6m31.566980479s" totalImagesPullingTime="6.633855699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:03.893919212 +0000 UTC m=+38.193588268" watchObservedRunningTime="2026-11-04 04:47:04.566980479 +0000 UTC m=+38.866649535" Nov 04 04:47:04.567239 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:04.567083 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nrkxh" podStartSLOduration=34.810672607 podStartE2EDuration="38.567077993s" totalImagesPullingTime="3.756405386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:04.566435605 +0000 UTC m=+38.866104665" watchObservedRunningTime="2026-11-04 04:47:04.567077993 +0000 UTC m=+38.866747048" Nov 04 04:47:05.138379 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.138341 2536 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-bzzbz"] Nov 04 04:47:05.162383 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.162352 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.201003 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.200972 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-bzzbz"] Nov 04 04:47:05.215613 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.215587 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 04 04:47:05.245167 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.245133 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 04 04:47:05.245167 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.245151 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 04 04:47:05.245167 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.245132 2536 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 04 04:47:05.254771 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.254740 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6773a478-4dfc-4115-a719-93ed66a03fde-signing-cabundle\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.254911 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.254822 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6773a478-4dfc-4115-a719-93ed66a03fde-signing-key\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.255047 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.255023 2536 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5jf\" (UniqueName: \"kubernetes.io/projected/6773a478-4dfc-4115-a719-93ed66a03fde-kube-api-access-8s5jf\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.265511 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.265486 2536 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jwpjv\"" Nov 04 04:47:05.356385 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.356356 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5jf\" (UniqueName: \"kubernetes.io/projected/6773a478-4dfc-4115-a719-93ed66a03fde-kube-api-access-8s5jf\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.356574 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.356423 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6773a478-4dfc-4115-a719-93ed66a03fde-signing-cabundle\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.356574 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.356458 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6773a478-4dfc-4115-a719-93ed66a03fde-signing-key\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.357073 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.357051 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6773a478-4dfc-4115-a719-93ed66a03fde-signing-cabundle\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.359222 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.359196 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6773a478-4dfc-4115-a719-93ed66a03fde-signing-key\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.413664 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.413609 2536 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5jf\" (UniqueName: \"kubernetes.io/projected/6773a478-4dfc-4115-a719-93ed66a03fde-kube-api-access-8s5jf\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:05.457088 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.457052 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:05.457521 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.457131 2536 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:05.457521 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:05.457212 2536 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:05.457521 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:05.457261 2536 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 04 04:47:05.457521 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:05.457279 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.45726307 +0000 UTC m=+43.756932124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:05.457521 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:05.457325 2536 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.457308184 +0000 UTC m=+43.756977238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : configmap "kube-rbac-proxy" not found Nov 04 04:47:05.485243 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.485211 2536 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:05.485376 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.485272 2536 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:05.485629 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.485611 2536 scope.go:122] "RemoveContainer" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" Nov 04 04:47:05.485848 ip-10-0-135-45 kubenswrapper[2536]: E1104 04:47:05.485826 2536 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-mqqtb_openshift-console-operator(6bd96fe8-a858-4742-8b93-75b58c9e48a8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" podUID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" Nov 04 04:47:05.486860 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:05.486660 2536 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:06.139431 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.139410 2536 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-bzzbz"] Nov 04 04:47:06.142122 ip-10-0-135-45 kubenswrapper[2536]: W1104 04:47:06.142092 2536 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6773a478_4dfc_4115_a719_93ed66a03fde.slice/crio-5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2 WatchSource:0}: Error finding container 5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2: Status 404 returned error can't find the container with id 5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2 Nov 04 04:47:06.451350 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.451286 2536 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ltftm_8fc13008-7b5b-4964-baf6-3320a2e3078e/dns-node-resolver/0.log" Nov 04 04:47:06.465323 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.465290 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" event={"ID":"9b081972-8fb4-4f6b-a930-5e45e9a933d5","Type":"ContainerStarted","Data":"645a2953e32305d3e3b1749ba7115a36f76436fb0e27f36354c7ca9492658dea"} Nov 04 04:47:06.466902 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.466877 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" event={"ID":"6773a478-4dfc-4115-a719-93ed66a03fde","Type":"ContainerStarted","Data":"77d2a48c57f7e0e3a2d84c6537ada4ae44dedbb440579b09748bee50dbfb8b2d"} Nov 04 04:47:06.467010 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.466921 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" event={"ID":"6773a478-4dfc-4115-a719-93ed66a03fde","Type":"ContainerStarted","Data":"5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2"} Nov 04 04:47:06.468372 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.468350 2536 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" event={"ID":"3c90286e-b41c-4649-8468-b583b6fcbcef","Type":"ContainerStarted","Data":"b99eee7f0677ac44408e1af745b16f511fbe44ceb42f2539dfa39c53e167a1f8"} Nov 04 04:47:06.579516 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.579471 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" podStartSLOduration=2.465558429 podStartE2EDuration="4.579453764s" totalImagesPullingTime="2.113895335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:06.577581252 +0000 UTC m=+40.877250307" watchObservedRunningTime="2026-11-04 04:47:06.579453764 +0000 UTC m=+40.879122818" Nov 04 04:47:06.692899 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.692854 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" podStartSLOduration=1.692841535 podStartE2EDuration="1.692841535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:06.691559933 +0000 UTC m=+40.991228986" watchObservedRunningTime="2026-11-04 04:47:06.692841535 +0000 UTC m=+40.992510589" Nov 04 04:47:06.807349 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.807292 2536 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" podStartSLOduration=2.545331893 podStartE2EDuration="4.807277471s" totalImagesPullingTime="2.261945578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:06.806665548 +0000 UTC m=+41.106334603" watchObservedRunningTime="2026-11-04 04:47:06.807277471 +0000 UTC m=+41.106946527" Nov 04 04:47:06.877757 ip-10-0-135-45 kubenswrapper[2536]: I1104 04:47:06.877659 2536 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:47:06.877852 ip-10-0-135-45 systemd[1]: Stopping Kubernetes Kubelet... Nov 04 04:47:06.899219 ip-10-0-135-45 systemd[1]: kubelet.service: Deactivated successfully. Nov 04 04:47:06.899397 ip-10-0-135-45 systemd[1]: Stopped Kubernetes Kubelet. Nov 04 04:47:06.899561 ip-10-0-135-45 systemd[1]: kubelet.service: Consumed 3.231s CPU time. Nov 04 04:47:06.914587 ip-10-0-135-45 systemd[1]: Starting Kubernetes Kubelet... Nov 04 04:47:07.015063 ip-10-0-135-45 kubenswrapper[5019]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:47:07.015063 ip-10-0-135-45 kubenswrapper[5019]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 04 04:47:07.015063 ip-10-0-135-45 kubenswrapper[5019]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:47:07.015063 ip-10-0-135-45 kubenswrapper[5019]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 04 04:47:07.017533 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017451 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.017533 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017531 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.017533 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017538 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017543 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017547 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017551 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017557 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017563 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017567 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017571 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017574 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017579 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017582 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017586 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017597 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017602 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017605 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017609 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017613 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017617 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017621 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.017747 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017653 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017661 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017667 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017673 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017677 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017681 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017685 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017690 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017695 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017699 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017704 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017708 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017712 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017716 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017721 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017725 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017729 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017733 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017737 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017741 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.018592 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017745 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017749 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017754 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017758 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017762 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017766 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017777 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017783 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017787 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017808 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017813 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017817 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017821 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017825 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017829 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017833 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017837 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017841 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017845 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.019495 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017849 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017854 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017858 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017863 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017867 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017871 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017875 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017879 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017883 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017887 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017891 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017895 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017899 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017903 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017908 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017912 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017915 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017919 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017923 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017928 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.020324 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017940 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017945 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017949 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017955 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017959 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017963 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017967 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017971 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017976 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017980 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017984 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017988 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017992 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.017996 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018000 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018005 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018009 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018014 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018018 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018022 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.021190 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018026 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018030 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018034 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018039 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018042 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.018047 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019351 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019373 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019378 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019382 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019386 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019390 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019394 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019399 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019403 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019407 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019412 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019416 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019421 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.021999 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019425 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019429 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019433 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019437 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019441 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019445 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019449 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019453 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019458 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019462 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019467 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019471 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019475 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019480 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019483 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019487 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019491 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019495 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019499 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019504 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.022872 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019508 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019512 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019516 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019520 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019524 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019528 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019532 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019538 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019546 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019552 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019559 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019563 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019567 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019572 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019576 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019580 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019584 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019588 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019592 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.023810 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019596 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019600 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019604 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019607 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019612 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019616 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019620 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019624 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019628 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019632 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019637 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019641 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019646 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019651 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019655 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019659 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019666 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019672 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019677 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019682 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.024623 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019686 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019692 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019697 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019700 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019704 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019708 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019713 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019718 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019722 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019726 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019730 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019734 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019738 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019742 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019746 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019749 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019754 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019758 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019763 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.025312 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019767 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019771 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019775 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019779 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019783 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019787 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019809 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019814 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019819 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019825 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019829 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019833 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019837 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019841 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.019847 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020666 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020675 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020680 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020684 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020689 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.025784 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020693 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020697 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020701 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020705 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020709 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020713 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020717 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020722 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020726 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020731 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020735 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020739 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020743 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020747 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020751 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020755 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020759 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020763 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020767 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020771 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.026299 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020775 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020779 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020783 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020787 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020808 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020813 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020819 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020825 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020829 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020833 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020837 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020841 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020845 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020849 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020853 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020857 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020861 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020866 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020870 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.026788 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020876 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020882 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020887 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020891 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020895 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020899 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020903 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020907 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020910 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020914 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020918 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020922 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020926 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020930 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020934 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020938 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020942 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020946 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020950 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.027343 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020957 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020961 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020966 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020970 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020974 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020979 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020983 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020988 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020992 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.020996 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021000 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021004 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021008 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021012 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021018 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021022 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021026 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021030 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021034 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.027954 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021040 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021047 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021052 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.021057 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022206 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022224 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022229 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022233 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022237 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022242 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022246 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022250 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022270 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022275 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022280 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022285 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022291 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022295 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022299 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022304 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.028660 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022308 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022315 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022319 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.022323 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022478 5019 flags.go:64] FLAG: --address="0.0.0.0" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022489 5019 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022499 5019 flags.go:64] FLAG: --anonymous-auth="true" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022508 5019 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022515 5019 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022520 5019 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022527 5019 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022534 5019 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022539 5019 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022544 5019 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022549 5019 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022555 5019 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022559 5019 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022564 5019 flags.go:64] FLAG: --cgroup-root="" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022568 5019 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022573 5019 flags.go:64] FLAG: --client-ca-file="" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022578 5019 flags.go:64] FLAG: --cloud-provider="external" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022583 5019 flags.go:64] FLAG: --cluster-dns="[]" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022590 5019 flags.go:64] FLAG: --cluster-domain="" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022595 5019 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 04 04:47:07.029489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022600 5019 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022605 5019 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022611 5019 flags.go:64] FLAG: --container-log-max-files="5" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022617 5019 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022621 5019 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022627 5019 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022633 5019 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022638 5019 flags.go:64] FLAG: --contention-profiling="false" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022642 5019 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022647 5019 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022652 5019 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022656 5019 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022663 5019 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022667 5019 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022672 5019 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022678 5019 flags.go:64] FLAG: --enable-load-reader="false" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022683 5019 flags.go:64] FLAG: --enable-server="true" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022688 5019 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022694 5019 flags.go:64] FLAG: --event-burst="100" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022699 5019 flags.go:64] FLAG: --event-qps="50" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022703 5019 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022708 5019 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022713 5019 flags.go:64] FLAG: --eviction-hard="" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022719 5019 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 04 04:47:07.030599 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022724 5019 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022729 5019 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022734 5019 flags.go:64] FLAG: --eviction-soft="" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022739 5019 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022743 5019 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022748 5019 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022753 5019 flags.go:64] FLAG: --experimental-mounter-path="" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022757 5019 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022762 5019 flags.go:64] FLAG: --fail-swap-on="true" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022767 5019 flags.go:64] FLAG: --feature-gates="" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022773 5019 flags.go:64] FLAG: --file-check-frequency="20s" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022778 5019 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022782 5019 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022787 5019 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022812 5019 flags.go:64] FLAG: --healthz-port="10248" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022817 5019 flags.go:64] FLAG: --help="false" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022822 5019 flags.go:64] FLAG: --hostname-override="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022827 5019 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022832 5019 flags.go:64] FLAG: --http-check-frequency="20s" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022836 5019 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022841 5019 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022847 5019 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022854 5019 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 04 04:47:07.031758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022860 5019 flags.go:64] FLAG: --image-service-endpoint="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022865 5019 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022869 5019 flags.go:64] FLAG: --kube-api-burst="100" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022874 5019 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022878 5019 flags.go:64] FLAG: --kube-api-qps="50" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022882 5019 flags.go:64] FLAG: --kube-reserved="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022887 5019 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022891 5019 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022896 5019 flags.go:64] FLAG: --kubelet-cgroups="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022900 5019 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022905 5019 flags.go:64] FLAG: --lock-file="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022910 5019 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022914 5019 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022919 5019 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022929 5019 flags.go:64] FLAG: --log-json-split-stream="false" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022933 5019 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022938 5019 flags.go:64] FLAG: --log-text-split-stream="false" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022943 5019 flags.go:64] FLAG: --logging-format="text" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022948 5019 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022953 5019 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022958 5019 flags.go:64] FLAG: --manifest-url="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022962 5019 flags.go:64] FLAG: --manifest-url-header="" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022969 5019 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022986 5019 flags.go:64] FLAG: --max-open-files="1000000" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.022994 5019 flags.go:64] FLAG: --max-pods="110" Nov 04 04:47:07.032762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023000 5019 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023005 5019 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023009 5019 flags.go:64] FLAG: --memory-manager-policy="None" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023014 5019 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023019 5019 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023023 5019 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023030 5019 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023042 5019 flags.go:64] FLAG: --node-status-max-images="50" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023047 5019 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023052 5019 flags.go:64] FLAG: --oom-score-adj="-999" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023056 5019 flags.go:64] FLAG: --pod-cidr="" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023062 5019 flags.go:64] FLAG: --pod-manifest-path="" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023067 5019 flags.go:64] FLAG: --pod-max-pids="-1" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023071 5019 flags.go:64] FLAG: --pods-per-core="0" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023076 5019 flags.go:64] FLAG: --port="10250" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023081 5019 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023086 5019 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0784556eec8bddf43" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023091 5019 flags.go:64] FLAG: --qos-reserved="" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023096 5019 flags.go:64] FLAG: --read-only-port="10255" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023101 5019 flags.go:64] FLAG: --register-node="true" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023106 5019 flags.go:64] FLAG: --register-with-taints="" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023111 5019 flags.go:64] FLAG: --registry-burst="10" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023116 5019 flags.go:64] FLAG: --registry-qps="5" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023120 5019 flags.go:64] FLAG: --reserved-cpus="" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023125 5019 flags.go:64] FLAG: --reserved-memory="" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023131 5019 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 04 04:47:07.033829 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023136 5019 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023141 5019 flags.go:64] FLAG: --rotate-certificates="false" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023146 5019 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023151 5019 flags.go:64] FLAG: --runonce="false" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023156 5019 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023161 5019 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023166 5019 flags.go:64] FLAG: --seccomp-default="false" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023172 5019 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023176 5019 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023181 5019 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023186 5019 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023191 5019 flags.go:64] FLAG: --storage-driver-password="root" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023197 5019 flags.go:64] FLAG: --storage-driver-secure="false" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023202 5019 flags.go:64] FLAG: --storage-driver-table="stats" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023206 5019 flags.go:64] FLAG: --storage-driver-user="root" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023211 5019 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023216 5019 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023221 5019 flags.go:64] FLAG: --system-cgroups="" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023225 5019 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023234 5019 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023239 5019 flags.go:64] FLAG: --tls-cert-file="" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023243 5019 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023251 5019 flags.go:64] FLAG: --tls-min-version="" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023255 5019 flags.go:64] FLAG: --tls-private-key-file="" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023260 5019 flags.go:64] FLAG: --topology-manager-policy="none" Nov 04 04:47:07.035024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023265 5019 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023269 5019 flags.go:64] FLAG: --topology-manager-scope="container" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023274 5019 flags.go:64] FLAG: --v="2" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023281 5019 flags.go:64] FLAG: --version="false" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023287 5019 flags.go:64] FLAG: --vmodule="" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023293 5019 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.023298 5019 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023522 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023530 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023534 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023538 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023542 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023547 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023551 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023556 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023561 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023565 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023570 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023573 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023582 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023588 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.036119 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023593 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023597 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023601 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023605 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023613 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023618 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023623 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023628 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023633 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023637 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023642 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023646 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023650 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023653 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023657 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023661 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023665 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023670 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023674 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023678 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.037082 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023682 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023686 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023690 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023695 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023698 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023702 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023707 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023711 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023716 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023720 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023726 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023730 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023735 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023739 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023743 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023747 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023751 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023755 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023759 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.037919 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023763 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023767 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023771 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023775 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023781 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023785 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023807 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023813 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023816 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023820 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023824 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023828 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023832 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023836 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023840 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023844 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023848 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023852 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023857 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023862 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.038531 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023866 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023871 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023875 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023882 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023886 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023890 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023894 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023898 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023902 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023906 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023911 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023915 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023919 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023923 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023927 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023931 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023937 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023942 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023946 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023950 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.039245 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023954 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023958 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023962 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023966 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023970 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023974 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023978 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023982 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023986 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023990 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023995 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.023999 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024003 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.024047 5019 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024098 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.039837 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024105 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024111 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024116 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024120 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024125 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024129 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024135 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024140 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024144 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024149 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024153 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024157 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024165 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024171 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024176 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024181 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024186 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024190 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024194 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024198 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.040231 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024202 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024206 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024210 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024214 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024218 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024222 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024226 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024231 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024235 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024239 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024243 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024248 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024252 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024257 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024261 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024265 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024269 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024273 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024278 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.040756 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024282 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024287 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024291 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024296 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024300 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024304 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024310 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024314 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024318 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024322 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024326 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024330 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024334 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024338 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024342 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024346 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024350 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024355 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024359 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024363 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.041286 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024367 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024371 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024375 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024379 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024383 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024387 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024393 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024398 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024402 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024407 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024411 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024415 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024419 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024423 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024427 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024430 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024434 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024438 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024445 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024449 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.041864 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024453 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024457 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024461 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024465 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024469 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024473 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024477 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024481 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024485 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024489 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024493 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024497 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024501 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024505 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024509 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024513 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024517 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024521 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024530 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.042493 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024535 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024539 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024543 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024547 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024551 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024555 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.024560 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.031103 5019 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.031121 5019 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.031154 5019 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.031162 5019 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031253 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031261 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031265 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031270 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031274 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031278 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031283 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031287 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031291 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.043402 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031295 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031299 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031304 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031308 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031312 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031316 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031320 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031324 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031329 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031334 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031339 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031343 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031349 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031353 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031369 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031373 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031377 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031381 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031386 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.044224 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031390 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031394 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031398 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031402 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031407 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031411 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031415 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031419 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031423 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031427 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031431 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031435 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031439 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031443 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031447 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031451 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031455 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031461 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031468 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031473 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.044997 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031479 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031485 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031490 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031494 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031499 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031503 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031507 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031511 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031517 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031523 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031528 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031533 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031537 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031541 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031545 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031549 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031553 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031557 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031561 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.045823 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031566 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031570 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031574 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031578 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031582 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031586 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031590 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031594 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031598 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031602 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031607 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031611 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031616 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031620 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031624 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031628 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031632 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031636 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031640 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031645 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.046651 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031649 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031653 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031657 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031661 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031665 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031669 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031673 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031677 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031681 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031685 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031689 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031694 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031698 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031702 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031706 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031710 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031715 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031719 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.047612 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.031723 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.031763 5019 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032007 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032017 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032021 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032026 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032030 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032036 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032041 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032045 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032049 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032053 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032058 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032062 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032066 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032070 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.048383 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032075 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032079 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032083 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032087 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032091 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032096 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032100 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032104 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032108 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032112 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032116 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032120 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032124 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032128 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032132 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032137 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032141 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032145 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032149 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032153 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.049074 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032157 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032161 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032165 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032169 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032174 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032178 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032182 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032186 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032190 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032194 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032198 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032202 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032210 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032214 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032217 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032222 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032226 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032232 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032238 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.049951 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032243 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032247 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032251 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032255 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032259 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032263 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032267 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032272 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032275 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032280 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032284 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032287 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032292 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032296 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032299 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032303 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032307 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032312 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032317 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.050873 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032321 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032325 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032329 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032335 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032341 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032345 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032351 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032355 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032359 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032363 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032368 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032372 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032376 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032380 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032384 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032389 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032393 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032397 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032401 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.051694 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032405 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032409 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032413 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032418 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032421 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032425 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032429 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032434 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032438 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032442 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032446 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032450 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032454 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032459 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032463 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.032498 5019 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 04 04:47:07.052455 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032550 5019 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032557 5019 feature_gate.go:386] unrecognized feature gate: Example Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032565 5019 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032571 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032578 5019 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032583 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032587 5019 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032592 5019 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032595 5019 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032600 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032604 5019 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032608 5019 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032613 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032617 5019 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032621 5019 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032625 5019 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032629 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032633 5019 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032637 5019 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 04 04:47:07.053106 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032641 5019 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032645 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032650 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032654 5019 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032658 5019 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032662 5019 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032666 5019 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032673 5019 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032678 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032682 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032686 5019 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032691 5019 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032695 5019 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032699 5019 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032705 5019 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032709 5019 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032713 5019 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032719 5019 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032723 5019 feature_gate.go:386] unrecognized feature gate: Example2 Nov 04 04:47:07.053867 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032728 5019 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032732 5019 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032736 5019 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032740 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032744 5019 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032748 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032752 5019 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032756 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032760 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032764 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032768 5019 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032771 5019 feature_gate.go:386] unrecognized feature gate: EVPN Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032775 5019 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032779 5019 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032783 5019 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032787 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032809 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032814 5019 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032818 5019 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032822 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 04 04:47:07.054714 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032826 5019 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032830 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032835 5019 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032839 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032843 5019 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032852 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032857 5019 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032863 5019 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032867 5019 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032871 5019 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032877 5019 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032881 5019 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032886 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032890 5019 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032895 5019 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032900 5019 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032904 5019 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032908 5019 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032913 5019 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032917 5019 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 04 04:47:07.055621 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032921 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032925 5019 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032929 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032933 5019 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032937 5019 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032941 5019 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032945 5019 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032949 5019 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032952 5019 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032956 5019 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032960 5019 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032964 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032968 5019 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032972 5019 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032976 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032980 5019 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032983 5019 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032988 5019 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032992 5019 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.032998 5019 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 04 04:47:07.056563 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033002 5019 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033007 5019 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033012 5019 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033016 5019 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033020 5019 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033026 5019 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033030 5019 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:07.033034 5019 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.033112 5019 server.go:957] "Client rotation is on, will bootstrap in background" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.035073 5019 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.035143 5019 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.035418 5019 server.go:1014] "Starting client certificate rotation" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.035533 5019 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.035609 5019 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 04:41:26 +0000 UTC" deadline="2028-08-19 10:53:44.11630151 +0000 UTC" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.035639 5019 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15702h6m37.080663909s" Nov 04 04:47:07.057488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.036198 5019 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:47:07.058123 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.037827 5019 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 04 04:47:07.058123 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.039479 5019 log.go:25] "Validated CRI v1 runtime API" Nov 04 04:47:07.058123 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.041179 5019 log.go:25] "Validated CRI v1 image API" Nov 04 04:47:07.058123 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.042140 5019 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 04 04:47:07.058123 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.045189 5019 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c923cc8f-23e2-4d47-b5b3-21e541021c2d:/dev/nvme0n1p4 db2a0eba-dc3f-47c3-bbec-a5ef83f4c18a:/dev/nvme0n1p3] Nov 04 04:47:07.058418 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.045215 5019 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2/userdata/shm major:0 minor:362 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/53d950702ffd8af02ec59280d123734ab6b6ed2e257b7ba349aae4e968050b11/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/53d950702ffd8af02ec59280d123734ab6b6ed2e257b7ba349aae4e968050b11/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76b3c024a3d41c687e5c0e451b95fed56d096c75c46cc3686ad9c62a0d418efd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76b3c024a3d41c687e5c0e451b95fed56d096c75c46cc3686ad9c62a0d418efd/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e/userdata/shm major:0 minor:245 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0/userdata/shm major:0 minor:322 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07ef7ea9-2699-46f3-8448-53a7b72b2e0b/volumes/kubernetes.io~projected/kube-api-access-g5p59:{mountpoint:/var/lib/kubelet/pods/07ef7ea9-2699-46f3-8448-53a7b72b2e0b/volumes/kubernetes.io~projected/kube-api-access-g5p59 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07ef7ea9-2699-46f3-8448-53a7b72b2e0b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/07ef7ea9-2699-46f3-8448-53a7b72b2e0b/volumes/kubernetes.io~secret/serving-cert major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0d2b9220-c17e-4f7a-8263-a00a86a03c81/volumes/kubernetes.io~projected/kube-api-access-bbhxl:{mountpoint:/var/lib/kubelet/pods/0d2b9220-c17e-4f7a-8263-a00a86a03c81/volumes/kubernetes.io~projected/kube-api-access-bbhxl major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/142a2dc1-069f-4121-a94b-c8a11c7d5570/volumes/kubernetes.io~projected/kube-api-access-hndv8:{mountpoint:/var/lib/kubelet/pods/142a2dc1-069f-4121-a94b-c8a11c7d5570/volumes/kubernetes.io~projected/kube-api-access-hndv8 major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1443a9c8-ac47-4262-a21f-88ce5140b3f9/volumes/kubernetes.io~projected/kube-api-access-2nvl9:{mountpoint:/var/lib/kubelet/pods/1443a9c8-ac47-4262-a21f-88ce5140b3f9/volumes/kubernetes.io~projected/kube-api-access-2nvl9 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1944e222-fe66-4a8b-a407-184928fdc15a/volumes/kubernetes.io~projected/kube-api-access-tv6vh:{mountpoint:/var/lib/kubelet/pods/1944e222-fe66-4a8b-a407-184928fdc15a/volumes/kubernetes.io~projected/kube-api-access-tv6vh major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1c148a52-c563-4f42-9d49-0606acf343e6/volumes/kubernetes.io~projected/kube-api-access-m28pd:{mountpoint:/var/lib/kubelet/pods/1c148a52-c563-4f42-9d49-0606acf343e6/volumes/kubernetes.io~projected/kube-api-access-m28pd major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1c148a52-c563-4f42-9d49-0606acf343e6/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/1c148a52-c563-4f42-9d49-0606acf343e6/volumes/kubernetes.io~secret/serving-cert major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1dd7863e-8391-4629-9a8d-38324d296e87/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/1dd7863e-8391-4629-9a8d-38324d296e87/volumes/kubernetes.io~secret/agent-certs major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/volumes/kubernetes.io~projected/kube-api-access-tdndc:{mountpoint:/var/lib/kubelet/pods/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/volumes/kubernetes.io~projected/kube-api-access-tdndc major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/32dcc5b0-c4fd-485d-bda3-604e8965dcff/volumes/kubernetes.io~projected/kube-api-access-7f45l:{mountpoint:/var/lib/kubelet/pods/32dcc5b0-c4fd-485d-bda3-604e8965dcff/volumes/kubernetes.io~projected/kube-api-access-7f45l major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c90286e-b41c-4649-8468-b583b6fcbcef/volumes/kubernetes.io~projected/kube-api-access-v5s7b:{mountpoint:/var/lib/kubelet/pods/3c90286e-b41c-4649-8468-b583b6fcbcef/volumes/kubernetes.io~projected/kube-api-access-v5s7b major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3cd79d78-ad19-47ae-942a-360a52bf522f/volumes/kubernetes.io~projected/kube-api-access-5lq9l:{mountpoint:/var/lib/kubelet/pods/3cd79d78-ad19-47ae-942a-360a52bf522f/volumes/kubernetes.io~projected/kube-api-access-5lq9l major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3d019953-b35c-4683-bba1-7fa5f86ed823/volumes/kubernetes.io~projected/kube-api-access-mg7hw:{mountpoint:/var/lib/kubelet/pods/3d019953-b35c-4683-bba1-7fa5f86ed823/volumes/kubernetes.io~projected/kube-api-access-mg7hw major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~projected/kube-api-access-lz2ws:{mountpoint:/var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~projected/kube-api-access-lz2ws major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~secret/default-certificate major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~secret/stats-auth major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5e2ff9d2-73c3-4635-a07a-ca5579d71d65/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/5e2ff9d2-73c3-4635-a07a-ca5579d71d65/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6773a478-4dfc-4115-a719-93ed66a03fde/volumes/kubernetes.io~projected/kube-api-access-8s5jf:{mountpoint:/var/lib/kubelet/pods/6773a478-4dfc-4115-a719-93ed66a03fde/volumes/kubernetes.io~projected/kube-api-access-8s5jf major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6773a478-4dfc-4115-a719-93ed66a03fde/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/6773a478-4dfc-4115-a719-93ed66a03fde/volumes/kubernetes.io~secret/signing-key major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bd96fe8-a858-4742-8b93-75b58c9e48a8/volumes/kubernetes.io~projected/kube-api-access-bslwv:{mountpoint:/var/lib/kubelet/pods/6bd96fe8-a858-4742-8b93-75b58c9e48a8/volumes/kubernetes.io~projected/kube-api-access-bslwv major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bd96fe8-a858-4742-8b93-75b58c9e48a8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/6bd96fe8-a858-4742-8b93-75b58c9e48a8/volumes/kubernetes.io~secret/serving-cert major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volumes/kubernetes.io~projected/kube-api-access-jzqs7:{mountpoint:/var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volumes/kubernetes.io~projected/kube-api-access-jzqs7 major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7676efb4-629c-40eb-bada-087789bc737f/volumes/kubernetes.io~projected/kube-api-access-n7txj:{mountpoint:/var/lib/kubelet/pods/7676efb4-629c-40eb-bada-087789bc737f/volumes/kubernetes.io~projected/kube-api-access-n7txj major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf/volumes/kubernetes.io~projected/kube-api-access-tpggk:{mountpoint:/var/lib/kubelet/pods/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf/volumes/kubernetes.io~projected/kube-api-access-tpggk major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8fc13008-7b5b-4964-baf6-3320a2e3078e/volumes/kubernetes.io~projected/kube-api-access-dh6lx:{mountpoint:/var/lib/kubelet/pods/8fc13008-7b5b-4964-baf6-3320a2e3078e/volumes/kubernetes.io~projected/kube-api-access-dh6lx major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b081972-8fb4-4f6b-a930-5e45e9a933d5/volumes/kubernetes.io~projected/kube-api-access-mmh4m:{mountpoint:/var/lib/kubelet/pods/9b081972-8fb4-4f6b-a930-5e45e9a933d5/volumes/kubernetes.io~projected/kube-api-access-mmh4m major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b/volumes/kubernetes.io~projected/kube-api-access-g7jh7:{mountpoint:/var/lib/kubelet/pods/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b/volumes/kubernetes.io~projected/kube-api-access-g7jh7 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~empty-dir/tmp major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~projected/kube-api-access-rnfw9:{mountpoint:/var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~projected/kube-api-access-rnfw9 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b/volumes/kubernetes.io~projected/kube-api-access-psdrz:{mountpoint:/var/lib/kubelet/pods/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b/volumes/kubernetes.io~projected/kube-api-access-psdrz major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b15c33eb-ef11-4c4f-8ee0-c67a30150de3/volumes/kubernetes.io~projected/kube-api-access-hxwc8:{mountpoint:/var/lib/kubelet/pods/b15c33eb-ef11-4c4f-8ee0-c67a30150de3/volumes/kubernetes.io~projected/kube-api-access-hxwc8 major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b1fc023b-934d-4884-b04f-78472b636238/volumes/kubernetes.io~projected/kube-api-access-68pv6:{mountpoint:/var/lib/kubelet/pods/b1fc023b-934d-4884-b04f-78472b636238/volumes/kubernetes.io~projected/kube-api-access-68pv6 major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~projected/kube-api-access-8trp6:{mountpoint:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~projected/kube-api-access-8trp6 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~projected/kube-api-access-skkbl:{mountpoint:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~projected/kube-api-access-skkbl major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e/volumes/kubernetes.io~projected/kube-api-access-7x992:{mountpoint:/var/lib/kubelet/pods/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e/volumes/kubernetes.io~projected/kube-api-access-7x992 major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9abd182-e801-44f6-a8ba-b9087aa0dca6/volumes/kubernetes.io~projected/kube-api-access-r7nnj:{mountpoint:/var/lib/kubelet/pods/e9abd182-e801-44f6-a8ba-b9087aa0dca6/volumes/kubernetes.io~projected/kube-api-access-r7nnj major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9abd182-e801-44f6-a8ba-b9087aa0dca6/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/e9abd182-e801-44f6-a8ba-b9087aa0dca6/volumes/kubernetes.io~secret/cert major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9f6a25f-ca01-4224-bd59-ff0205c1aa17/volumes/kubernetes.io~projected/kube-api-access-hkqls:{mountpoint:/var/lib/kubelet/pods/e9f6a25f-ca01-4224-bd59-ff0205c1aa17/volumes/kubernetes.io~projected/kube-api-access-hkqls major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f42385bf-b692-423c-95a5-c29d1a3532d7/volumes/kubernetes.io~projected/kube-api-access-hwjtk:{mountpoint:/var/lib/kubelet/pods/f42385bf-b692-423c-95a5-c29d1a3532d7/volumes/kubernetes.io~projected/kube-api-access-hwjtk major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f8638b06-49e9-43bb-bc66-ea3fd87fd136/volumes/kubernetes.io~projected/kube-api-access-tbz86:{mountpoint:/var/lib/kubelet/pods/f8638b06-49e9-43bb-bc66-ea3fd87fd136/volumes/kubernetes.io~projected/kube-api-access-tbz86 major:0 minor:53 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/be64546c2366b58289839058a60a3f0ff64332602cdc4d6ddfa3c594ce3d0412/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/55e1b01906764096070b3315db64be2279c3178396b30d504783152e9fe24c76/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/34f030e8204db42dd073dfb2198cc4c138c17fcc8e19989e9d8449d12621f3c7/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/291f446c1936bcd1942ed9455810019740ddff17da63cd10f0bcb23f63a3d8b8/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/77441cbf1d5332f894ab2c287b6c1198b26214b826a2437fe5efe5bb5028b708/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/832e1c74fc12b8ae309613de1ec95bb780eeb667910d53e96569f0ff03e7574a/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/207b753381027cc5e1fd7d589da58c7b52189e41547e9b49785575a2488d7e5e/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/dc66300e1a3a01505976cdd9e559fe73367599a3659322c0a08c5e01f78bb819/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/2cbb3a23e7c6cf76c8a6921eebd1c1a20c213528e0b301cdee566deae6993d91/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/7204915c06a13dda8f5729a28878fee05fb96787f7af24f2c26125394bdcfe68/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/fdafa31c683a06e9817a4bcf588f26d23c4f9f84511793ff05b217f4a3f3743c/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/d6d06920d8df59809844cf902c50f7f4475d9aba64d29023b01a84eea1e2071b/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/003850d1f38ef14fa965c1d609df55299cfc71db881fd825547533d44307ee74/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/453748df58be44e5dec08ef90cde196daf253176716bf5839f707a057f6d6bcf/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/48fe43889c4d34571b93ce923db09e63ae5d79ce26a6ca4c5599c7e1ad8d3c5d/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/563f6ac783e6e70fed163d19e242db40347492e284eb6be21bb862741f2cd953/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/2576dfbcb0a520e839da030e2ca5666bf7ba2a115c0a170d0066f231de42f93e/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/d124d3794b27105f371a604d3266febef06c4dffa8595e3870c357d2d5aa4420/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/db4ed47e72d696bfcbb54155f36cd97fc87f0a112d34ad6e76c2bdd982bcfaf8/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/18cdbc5edd761d776073bbe2bacd18b1e5295fb97b3d3ce3f44caa6b82f6f953/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/0209a05ea87edd9a8545080687249dfc008ec9cbe6cf1298a364ac8018c9fc5c/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/4f0df6e57abf9362a1f025953411925fee81b38f68f7f70c49f0a3afca4634a4/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/61ed9249323d34001cd56a3436e19ca00b7112ebdbb91630d6aaec83e767b933/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/7b5cdfd5b00e12f437723f6c9a8f959f40c08201680e41640d8c0db0781cf4f3/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/2ad074620b3d1d260a5b2b4f9f2dd54bbad3bd1ca0b8b238c7ec70a99645d68f/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/d237d66590311209450f8225405f84aa643ccae23df4280b0bb47f67e3d26daf/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/f451e7d688b384e94ddc99b995de50c0465d5abb134ca1c1a27c5fae81d12d7e/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/f1d4b3ccbe7f345cb6fa8b7f98e1e49caa71bdd0d7a029e5d952bccec99658d9/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/8107c2fd2598a0420d64ba8f267749ba4cf9514cd5477b9c234cc610918bcad8/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/6449938f63467b94ca8de66db116ab11fcca45f21f0b4add2bd54479acd4b6a3/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/5ea212fa9d96f41dd16d5fbc18a9ae5e01f606c72ded999b8c4b634401aadc06/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/be521283e14abd15b7544f00f96120897099819652f9bc4cfdeaf9b7584c2d3f/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/d61cbc0a8eb3034b977eb46535f6e7e5b1c3b3b16dd5187527d45f1779c1acb4/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/6d3d59a011582fe521a06ed0483500236e6196fcc044515ba93b5d05905eca32/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/0f94800a455ffc78789a956dbd6bc9c32b44a4b4dd5d7ea945738954dd2f13ca/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/dd7173e7adc138d1ac7ff9a0bc13fcdc2e8d04bd926956a8f375bc279ee48b23/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/3ab74975a6550807e3b8230b55761923972ceb13acde224ac56614de8733da5c/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/319c1302a670fa9acc2b2ec17e4bb626c548a65470f7437a8bec23cbde0a53fc/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/9d0c8dcef680c5d4ff3bd186c04ed3567ccdf3cb3c855db44b58c61647504352/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/5674d15c44fba868dc37b0ead3f076109ec607b8d90e8f4d32b6681d05ccc734/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/cdff4125e5ab7c632b56d726fc99a73c0e57cc87c53f577635009c2343e6dbe5/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/9a3549cc17b6dd05f0d6dce04aea4c7af863720c73af861e18b75ad80bc9c041/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/d439f49ec30f2bb8b735c93798292048f66212fcc33a5200adc3226132fdd4db/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-340:{mountpoint:/var/lib/containers/storage/overlay/6476950bf6b47f8be274b2520971d7ba139590503a245c9a9e020b4ee67333f1/merged major:0 minor:340 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/e349175071c27b3203ff48ead60d8f120e51a86b22e32ec44f3aa1a3a4191d24/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/0639c9cdcd13069cabfebac0b7677f3f94b07d1007b242a2637664529bb6fdfb/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/84ab65eb864a4a16003878cdc64191e9321ca7e6242b47d2f46b6cdfdadccc0c/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/298856a1fbbee49b99faba18b31a05b61b53826bcae62175b0df601303faf11c/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/fe7b892546ccdf6bb3ca0bbe5ab1e59cdc18121f6ee91247b7b994f1b5531242/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/66b5bd5df1537523d67435bb7b8c9891ed3fc20f14f5c97efab33048901aae04/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/34b5e8295bf0efc8ce22a1afa2570953cb23744ed152edf38f751ac3b03d2811/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/2e5c606d424bf8a5d4f281f9979b0aa5ead03fe0f227c9214d80ba1775cc7f27/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/0a36731ca55a1a2e1c0176a05313db72886baa1191126e0adcda5279469840bc/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/dff2faab4bf0b8beb3953495bed4cf2e040074e67738e3c5ef839f2c580bd721/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/da4378f198280b6e7227db35b41135e8c79a121136558db21289ac6ba3bf38f6/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/62a7b612b2a17a6d474464dd2db486ffea09182b8726cacd33ef84a30976cd88/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/0d5d5c9047cbf720f36d36947c16d5489c1abda35f2a5afd32f32f41e8bd59b3/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/59160d594c3b8b49ef07512fc1fe9cb69de3d973e2c827eeef4dcbf5d1ec4fce/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/3051cecef872867c0002548a36e91e9ec4e94e5865ba86f92d15ffaa327803ed/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/98aa44de5d7363ed1f1d9e8a701e3d5ad463d0e02c902e000a9cef3f337e5105/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/b4677dbfd8c6ceef6a8b9ddd57d93d0049faa42e2a745494b4b8526022c45f9a/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/cd794a88c6b904e0a5ba548a37be3955b0ee7fcb8844b0151bcf6727ae3304e5/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 04 04:47:07.058819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.057829 5019 manager.go:217] Machine: {Timestamp:2026-11-04 04:47:07.057046092 +0000 UTC m=+0.099460712 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3187582 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba4cc8462c15962796ec4195b968c SystemUUID:ec2ba4cc-8462-c159-6279-6ec4195b968c BootID:8b6aafef-c292-44ca-b2b8-910d171e9ffa Filesystems:[{Device:/run/containers/storage/overlay-containers/5e7e1e360e2b90369bc05867fd50a024741b3ec725451d1ad67b647c38027434/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6773a478-4dfc-4115-a719-93ed66a03fde/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:356 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3539508d7768e311626d06a3c49dbaa4d30c7c4d3dbb06c7ff2c51ea38c41089/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9ff4e4c80a91bafe5244b30ca9160c18200fa8925935fa69dfa9f8b646f34904/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbda968e7b8fd052abd151d7ac40ec996c5c64b5a229805f75aa7b1bb51b84c8/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b/volumes/kubernetes.io~projected/kube-api-access-g7jh7 DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1c148a52-c563-4f42-9d49-0606acf343e6/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f8638b06-49e9-43bb-bc66-ea3fd87fd136/volumes/kubernetes.io~projected/kube-api-access-tbz86 DeviceMajor:0 DeviceMinor:53 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba3b4fc4a99df091fd582654bdf6ab76f8b9bb658772cd0a158515a69e680c85/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5e2ff9d2-73c3-4635-a07a-ca5579d71d65/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/07ef7ea9-2699-46f3-8448-53a7b72b2e0b/volumes/kubernetes.io~projected/kube-api-access-g5p59 DeviceMajor:0 DeviceMinor:224 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-340 DeviceMajor:0 DeviceMinor:340 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ee6a146f7bb89d1035c35ee74fdcd777993950bf153f261d6a46ecdc64086345/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a77150bbefc3bf1f6d882e2aeb2f5fb55a85f9b925426965c65d2f1c09e2737/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05983ac98d6af4685c1752a6ddeb3d46ce995a935e4c2d4067126c30cdfcc44d/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6bd96fe8-a858-4742-8b93-75b58c9e48a8/volumes/kubernetes.io~projected/kube-api-access-bslwv DeviceMajor:0 DeviceMinor:227 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:228 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/1dd7863e-8391-4629-9a8d-38324d296e87/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:47 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:49 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1443a9c8-ac47-4262-a21f-88ce5140b3f9/volumes/kubernetes.io~projected/kube-api-access-2nvl9 DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/53d950702ffd8af02ec59280d123734ab6b6ed2e257b7ba349aae4e968050b11/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9bf0f0bc35dcc397c22754c2e730579df0d0e313d7f51864567adb9ed6aefb4/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/405b16eefd7955d083eb0503fd4da4024d15c0de7f05bc6e5951e933f1455bea/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f42385bf-b692-423c-95a5-c29d1a3532d7/volumes/kubernetes.io~projected/kube-api-access-hwjtk DeviceMajor:0 DeviceMinor:312 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~projected/kube-api-access-skkbl DeviceMajor:0 DeviceMinor:215 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/84c0634c7e53e424722e2d244ad354a97a0b5c102347076bb185260c9173959e/userdata/shm DeviceMajor:0 DeviceMinor:245 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b/volumes/kubernetes.io~projected/kube-api-access-psdrz DeviceMajor:0 DeviceMinor:293 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0/userdata/shm DeviceMajor:0 DeviceMinor:322 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~projected/kube-api-access-8trp6 DeviceMajor:0 DeviceMinor:217 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1af2e035d8a47cabe5d4f3813b815b673f84455495aa8c778a11cb32f6e7b006/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bc5b3c63548d51227520cdd56a1f12a612ba3e7e6fc684d450631f394ea8fe36/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volumes/kubernetes.io~projected/kube-api-access-jzqs7 DeviceMajor:0 DeviceMinor:51 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6bd96fe8-a858-4742-8b93-75b58c9e48a8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e/volumes/kubernetes.io~projected/kube-api-access-7x992 DeviceMajor:0 DeviceMinor:214 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/07ef7ea9-2699-46f3-8448-53a7b72b2e0b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:210 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/142a2dc1-069f-4121-a94b-c8a11c7d5570/volumes/kubernetes.io~projected/kube-api-access-hndv8 DeviceMajor:0 DeviceMinor:220 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/volumes/kubernetes.io~projected/kube-api-access-tdndc DeviceMajor:0 DeviceMinor:226 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9b081972-8fb4-4f6b-a930-5e45e9a933d5/volumes/kubernetes.io~projected/kube-api-access-mmh4m DeviceMajor:0 DeviceMinor:339 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/b15c33eb-ef11-4c4f-8ee0-c67a30150de3/volumes/kubernetes.io~projected/kube-api-access-hxwc8 DeviceMajor:0 DeviceMinor:54 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7472ef71-a7e6-495f-8212-189582db5c77/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/e9abd182-e801-44f6-a8ba-b9087aa0dca6/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:209 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3f44c4ca3534faccde60783265287287cefa734c571fdbe41475e2c7b47ff41b/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7676efb4-629c-40eb-bada-087789bc737f/volumes/kubernetes.io~projected/kube-api-access-n7txj DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/32dcc5b0-c4fd-485d-bda3-604e8965dcff/volumes/kubernetes.io~projected/kube-api-access-7f45l DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76b3c024a3d41c687e5c0e451b95fed56d096c75c46cc3686ad9c62a0d418efd/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3cd79d78-ad19-47ae-942a-360a52bf522f/volumes/kubernetes.io~projected/kube-api-access-5lq9l DeviceMajor:0 DeviceMinor:211 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3d019953-b35c-4683-bba1-7fa5f86ed823/volumes/kubernetes.io~projected/kube-api-access-mg7hw DeviceMajor:0 DeviceMinor:213 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:216 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4867d39c-aede-492d-bdd5-51b57b9baed4/volumes/kubernetes.io~projected/kube-api-access-lz2ws DeviceMajor:0 DeviceMinor:222 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ea44a671ba16c4896c9bfcd9fb8126dafd9b65ef35ef4cc2e30b2e533b1e6ce7/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3c90286e-b41c-4649-8468-b583b6fcbcef/volumes/kubernetes.io~projected/kube-api-access-v5s7b DeviceMajor:0 DeviceMinor:338 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8fc13008-7b5b-4964-baf6-3320a2e3078e/volumes/kubernetes.io~projected/kube-api-access-dh6lx DeviceMajor:0 DeviceMinor:52 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c5d0dcc128bf3c08ea276c369e53ed5c6540a3a57b520a618e6ea9e6e831fae6/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf/volumes/kubernetes.io~projected/kube-api-access-tpggk DeviceMajor:0 DeviceMinor:221 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e9abd182-e801-44f6-a8ba-b9087aa0dca6/volumes/kubernetes.io~projected/kube-api-access-r7nnj DeviceMajor:0 DeviceMinor:223 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cc9557432455dba0954ddfdc7831b26753d3b09961369fb19d837be3dbad2c48/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0d2b9220-c17e-4f7a-8263-a00a86a03c81/volumes/kubernetes.io~projected/kube-api-access-bbhxl DeviceMajor:0 DeviceMinor:212 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1944e222-fe66-4a8b-a407-184928fdc15a/volumes/kubernetes.io~projected/kube-api-access-tv6vh DeviceMajor:0 DeviceMinor:218 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3c403a5942c8bc9ad137444370e6b4a8329c0059497be4906ef9b87adcb1baa1/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e9f6a25f-ca01-4224-bd59-ff0205c1aa17/volumes/kubernetes.io~projected/kube-api-access-hkqls DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~projected/kube-api-access-rnfw9 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6773a478-4dfc-4115-a719-93ed66a03fde/volumes/kubernetes.io~projected/kube-api-access-8s5jf DeviceMajor:0 DeviceMinor:361 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5379e4e293323b0497e57f6d6d538431592a25129e174831006db2e0c641eff2/userdata/shm DeviceMajor:0 DeviceMinor:362 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:50 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f1cfffce108a8da2e7478b2ee6f45b774f483a2084d9ffccc08090facc09593/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b1fc023b-934d-4884-b04f-78472b636238/volumes/kubernetes.io~projected/kube-api-access-68pv6 DeviceMajor:0 DeviceMinor:317 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0de9d0d133a67dee716ee080d3687262a7d90d989878527c803951ff1307c288/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1c148a52-c563-4f42-9d49-0606acf343e6/volumes/kubernetes.io~projected/kube-api-access-m28pd DeviceMajor:0 DeviceMinor:225 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0de9d0d133a67de MacAddress:06:95:73:ba:c8:3e Speed:10000 Mtu:8901} {Name:1af2e035d8a47ca MacAddress:c2:a2:55:39:7e:c4 Speed:10000 Mtu:8901} {Name:3539508d7768e31 MacAddress:f6:58:bd:18:76:7e Speed:10000 Mtu:8901} {Name:3f44c4ca3534fac MacAddress:72:36:c8:d8:68:ce Speed:10000 Mtu:8901} {Name:4a77150bbefc3bf MacAddress:f2:50:5d:85:6b:cb Speed:10000 Mtu:8901} {Name:5379e4e293323b0 MacAddress:62:8a:2a:c3:ec:34 Speed:10000 Mtu:8901} {Name:53d950702ffd8af MacAddress:62:78:99:a2:61:60 Speed:10000 Mtu:8901} {Name:5e7e1e360e2b903 MacAddress:8e:c8:78:09:d3:97 Speed:10000 Mtu:8901} {Name:84c0634c7e53e42 MacAddress:a2:de:f9:95:b5:4b Speed:10000 Mtu:8901} {Name:ba3b4fc4a99df09 MacAddress:aa:65:ec:d6:33:06 Speed:10000 Mtu:8901} {Name:bc5b3c63548d512 MacAddress:2a:21:48:a4:c3:bd Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:5a:5e:83:47:0d Speed:0 Mtu:9001} {Name:br-int MacAddress:82:52:ea:ec:7d:3a Speed:0 Mtu:8901} {Name:c5d0dcc128bf3c0 MacAddress:b2:9c:28:87:6d:b5 Speed:10000 Mtu:8901} {Name:cc9557432455dba MacAddress:aa:88:eb:77:09:3e Speed:10000 Mtu:8901} {Name:ea44a671ba16c48 MacAddress:e2:c5:e9:ef:fa:37 Speed:10000 Mtu:8901} {Name:ee6a146f7bb89d1 MacAddress:32:ff:39:a4:94:b9 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:5a:5e:83:47:0d Speed:0 Mtu:9001} {Name:f6341e72ede12ac MacAddress:4a:fa:93:ed:70:19 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:8a:c2:67:3b:e8:f6 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:36:2a:96:5c:c8:4f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 04 04:47:07.058819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.058549 5019 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 04 04:47:07.058819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.058610 5019 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 04 04:47:07.059255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.058964 5019 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 04 04:47:07.059255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.058990 5019 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-45.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 04 04:47:07.059255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059173 5019 topology_manager.go:143] "Creating topology manager with none policy" Nov 04 04:47:07.059255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059186 5019 container_manager_linux.go:311] "Creating device plugin manager" Nov 04 04:47:07.059255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059236 5019 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:47:07.059255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059256 5019 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 04 04:47:07.059541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059342 5019 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 04 04:47:07.059625 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059612 5019 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 04 04:47:07.059754 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059743 5019 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 04 04:47:07.059828 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059805 5019 kubelet.go:493] "Attempting to sync node with API server" Nov 04 04:47:07.059828 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059827 5019 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 04 04:47:07.059914 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059841 5019 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 04 04:47:07.059914 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059856 5019 kubelet.go:405] "Adding apiserver pod source" Nov 04 04:47:07.059914 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.059868 5019 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 04 04:47:07.060765 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.060742 5019 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 04:47:07.060765 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.060758 5019 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:47:07.061313 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.061291 5019 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 04 04:47:07.063853 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.063839 5019 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 04 04:47:07.063853 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.063852 5019 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 04 04:47:07.063951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.063942 5019 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 04 04:47:07.064132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064122 5019 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 04 04:47:07.064161 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064150 5019 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 04 04:47:07.064240 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064231 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 04 04:47:07.064268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064245 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 04 04:47:07.064268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064252 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 04 04:47:07.064268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064257 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 04 04:47:07.064268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064263 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 04 04:47:07.064268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064269 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064275 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064281 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064288 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064294 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064313 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064322 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064352 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 04 04:47:07.064396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.064361 5019 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 04 04:47:07.068084 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.068068 5019 server.go:1263] "Started kubelet" Nov 04 04:47:07.068158 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.068134 5019 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 04 04:47:07.068841 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.068223 5019 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 04 04:47:07.068841 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.068336 5019 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 04 04:47:07.068841 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.068835 5019 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 04 04:47:07.068597 ip-10-0-135-45 systemd[1]: Started Kubernetes Kubelet. Nov 04 04:47:07.069919 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.069519 5019 server.go:317] "Adding debug handlers to kubelet server" Nov 04 04:47:07.074561 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.074395 5019 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 04 04:47:07.074750 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.074727 5019 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 04 04:47:07.074844 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.074780 5019 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 04:41:27 +0000 UTC" deadline="2028-07-03 23:24:09.847220973 +0000 UTC" Nov 04 04:47:07.074844 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.074814 5019 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14586h37m2.772409506s" Nov 04 04:47:07.074961 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.074861 5019 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 04 04:47:07.074961 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.074876 5019 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 04 04:47:07.075065 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.075003 5019 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 04 04:47:07.075065 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.075015 5019 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" Nov 04 04:47:07.076972 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.076672 5019 factory.go:55] Registering systemd factory Nov 04 04:47:07.076972 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.076698 5019 factory.go:223] Registration of the systemd container factory successfully Nov 04 04:47:07.077972 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.077955 5019 factory.go:153] Registering CRI-O factory Nov 04 04:47:07.077972 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.077971 5019 factory.go:223] Registration of the crio container factory successfully Nov 04 04:47:07.078106 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.078017 5019 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 04 04:47:07.078106 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.078032 5019 factory.go:103] Registering Raw factory Nov 04 04:47:07.078106 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.078042 5019 manager.go:1199] Started watching for new ooms in manager Nov 04 04:47:07.078358 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.078347 5019 manager.go:319] Starting recovery of all containers Nov 04 04:47:07.079210 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079172 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c148a52-c563-4f42-9d49-0606acf343e6" volumeName="kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-snapshots" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079212 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1fc023b-934d-4884-b04f-78472b636238" volumeName="kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079226 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079237 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079250 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="142a2dc1-069f-4121-a94b-c8a11c7d5570" volumeName="kubernetes.io/projected/142a2dc1-069f-4121-a94b-c8a11c7d5570-kube-api-access-hndv8" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079262 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c148a52-c563-4f42-9d49-0606acf343e6" volumeName="kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-tmp" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079275 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80" volumeName="kubernetes.io/projected/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-kube-api-access-tdndc" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079287 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4867d39c-aede-492d-bdd5-51b57b9baed4" volumeName="kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-stats-auth" seLinuxMountContext="" Nov 04 04:47:07.079298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079301 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7472ef71-a7e6-495f-8212-189582db5c77" volumeName="kubernetes.io/secret/7472ef71-a7e6-495f-8212-189582db5c77-ovn-node-metrics-cert" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079314 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1fc023b-934d-4884-b04f-78472b636238" volumeName="kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079337 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079375 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c90286e-b41c-4649-8468-b583b6fcbcef" volumeName="kubernetes.io/projected/3c90286e-b41c-4649-8468-b583b6fcbcef-kube-api-access-v5s7b" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079387 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5e2ff9d2-73c3-4635-a07a-ca5579d71d65" volumeName="kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079400 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6773a478-4dfc-4115-a719-93ed66a03fde" volumeName="kubernetes.io/secret/6773a478-4dfc-4115-a719-93ed66a03fde-signing-key" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079416 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c148a52-c563-4f42-9d49-0606acf343e6" volumeName="kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-trusted-ca-bundle" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079429 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32dcc5b0-c4fd-485d-bda3-604e8965dcff" volumeName="kubernetes.io/configmap/32dcc5b0-c4fd-485d-bda3-604e8965dcff-iptables-alerter-script" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079451 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8638b06-49e9-43bb-bc66-ea3fd87fd136" volumeName="kubernetes.io/projected/f8638b06-49e9-43bb-bc66-ea3fd87fd136-kube-api-access-tbz86" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079462 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d2b9220-c17e-4f7a-8263-a00a86a03c81" volumeName="kubernetes.io/configmap/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-config" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079474 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6773a478-4dfc-4115-a719-93ed66a03fde" volumeName="kubernetes.io/projected/6773a478-4dfc-4115-a719-93ed66a03fde-kube-api-access-8s5jf" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079486 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7472ef71-a7e6-495f-8212-189582db5c77" volumeName="kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-script-lib" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079498 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7676efb4-629c-40eb-bada-087789bc737f" volumeName="kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-multus-daemon-config" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079509 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079521 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079532 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1944e222-fe66-4a8b-a407-184928fdc15a" volumeName="kubernetes.io/projected/1944e222-fe66-4a8b-a407-184928fdc15a-kube-api-access-tv6vh" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079544 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c148a52-c563-4f42-9d49-0606acf343e6" volumeName="kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-service-ca-bundle" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079560 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b" volumeName="kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079570 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079582 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079598 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9d32ce2-2b5d-4f8b-904e-486f556d9e8e" volumeName="kubernetes.io/configmap/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-telemetry-config" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079609 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8638b06-49e9-43bb-bc66-ea3fd87fd136" volumeName="kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-binary-copy" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079620 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07ef7ea9-2699-46f3-8448-53a7b72b2e0b" volumeName="kubernetes.io/secret/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-serving-cert" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079631 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cd79d78-ad19-47ae-942a-360a52bf522f" volumeName="kubernetes.io/configmap/3cd79d78-ad19-47ae-942a-360a52bf522f-config-volume" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079642 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7676efb4-629c-40eb-bada-087789bc737f" volumeName="kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-cni-binary-copy" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079654 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf" volumeName="kubernetes.io/projected/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf-kube-api-access-tpggk" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079666 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b15c33eb-ef11-4c4f-8ee0-c67a30150de3" volumeName="kubernetes.io/projected/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-kube-api-access-hxwc8" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079677 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079688 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9abd182-e801-44f6-a8ba-b9087aa0dca6" volumeName="kubernetes.io/projected/e9abd182-e801-44f6-a8ba-b9087aa0dca6-kube-api-access-r7nnj" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079699 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f42385bf-b692-423c-95a5-c29d1a3532d7" volumeName="kubernetes.io/empty-dir/f42385bf-b692-423c-95a5-c29d1a3532d7-data-volume" seLinuxMountContext="" Nov 04 04:47:07.079703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079711 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c148a52-c563-4f42-9d49-0606acf343e6" volumeName="kubernetes.io/secret/1c148a52-c563-4f42-9d49-0606acf343e6-serving-cert" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079724 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1dd7863e-8391-4629-9a8d-38324d296e87" volumeName="kubernetes.io/secret/1dd7863e-8391-4629-9a8d-38324d296e87-agent-certs" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079737 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80" volumeName="kubernetes.io/configmap/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-config" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079748 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd96fe8-a858-4742-8b93-75b58c9e48a8" volumeName="kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-config" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079760 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b081972-8fb4-4f6b-a930-5e45e9a933d5" volumeName="kubernetes.io/projected/9b081972-8fb4-4f6b-a930-5e45e9a933d5-kube-api-access-mmh4m" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079771 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a06238b1-20bb-4835-bdac-4fdd5fa9ce2b" volumeName="kubernetes.io/projected/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b-kube-api-access-g7jh7" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079783 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079812 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079825 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07ef7ea9-2699-46f3-8448-53a7b72b2e0b" volumeName="kubernetes.io/configmap/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-config" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079836 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7472ef71-a7e6-495f-8212-189582db5c77" volumeName="kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-config" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079847 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7676efb4-629c-40eb-bada-087789bc737f" volumeName="kubernetes.io/projected/7676efb4-629c-40eb-bada-087789bc737f-kube-api-access-n7txj" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079858 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8fc13008-7b5b-4964-baf6-3320a2e3078e" volumeName="kubernetes.io/empty-dir/8fc13008-7b5b-4964-baf6-3320a2e3078e-tmp-dir" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079871 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa" volumeName="kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-tmp" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079881 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1fc023b-934d-4884-b04f-78472b636238" volumeName="kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079902 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079913 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d9d32ce2-2b5d-4f8b-904e-486f556d9e8e" volumeName="kubernetes.io/projected/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-kube-api-access-7x992" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079926 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4867d39c-aede-492d-bdd5-51b57b9baed4" volumeName="kubernetes.io/projected/4867d39c-aede-492d-bdd5-51b57b9baed4-kube-api-access-lz2ws" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079936 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4867d39c-aede-492d-bdd5-51b57b9baed4" volumeName="kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-default-certificate" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079956 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6773a478-4dfc-4115-a719-93ed66a03fde" volumeName="kubernetes.io/configmap/6773a478-4dfc-4115-a719-93ed66a03fde-signing-cabundle" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079968 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd96fe8-a858-4742-8b93-75b58c9e48a8" volumeName="kubernetes.io/projected/6bd96fe8-a858-4742-8b93-75b58c9e48a8-kube-api-access-bslwv" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079981 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.079993 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8638b06-49e9-43bb-bc66-ea3fd87fd136" volumeName="kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080005 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0d2b9220-c17e-4f7a-8263-a00a86a03c81" volumeName="kubernetes.io/projected/0d2b9220-c17e-4f7a-8263-a00a86a03c81-kube-api-access-bbhxl" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080015 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c148a52-c563-4f42-9d49-0606acf343e6" volumeName="kubernetes.io/projected/1c148a52-c563-4f42-9d49-0606acf343e6-kube-api-access-m28pd" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080027 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1443a9c8-ac47-4262-a21f-88ce5140b3f9" volumeName="kubernetes.io/projected/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kube-api-access-2nvl9" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080038 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3d019953-b35c-4683-bba1-7fa5f86ed823" volumeName="kubernetes.io/projected/3d019953-b35c-4683-bba1-7fa5f86ed823-kube-api-access-mg7hw" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080051 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7472ef71-a7e6-495f-8212-189582db5c77" volumeName="kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-env-overrides" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080063 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7472ef71-a7e6-495f-8212-189582db5c77" volumeName="kubernetes.io/projected/7472ef71-a7e6-495f-8212-189582db5c77-kube-api-access-jzqs7" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080076 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b1fc023b-934d-4884-b04f-78472b636238" volumeName="kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080127 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cd79d78-ad19-47ae-942a-360a52bf522f" volumeName="kubernetes.io/empty-dir/3cd79d78-ad19-47ae-942a-360a52bf522f-tmp-dir" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080141 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd96fe8-a858-4742-8b93-75b58c9e48a8" volumeName="kubernetes.io/secret/6bd96fe8-a858-4742-8b93-75b58c9e48a8-serving-cert" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080168 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07ef7ea9-2699-46f3-8448-53a7b72b2e0b" volumeName="kubernetes.io/projected/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-kube-api-access-g5p59" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080186 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12dada1b-2c87-4515-ab1f-2022d70d5c1a" volumeName="kubernetes.io/configmap/12dada1b-2c87-4515-ab1f-2022d70d5c1a-nginx-conf" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080200 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80" volumeName="kubernetes.io/secret/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-serving-cert" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080215 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="32dcc5b0-c4fd-485d-bda3-604e8965dcff" volumeName="kubernetes.io/projected/32dcc5b0-c4fd-485d-bda3-604e8965dcff-kube-api-access-7f45l" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080229 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3cd79d78-ad19-47ae-942a-360a52bf522f" volumeName="kubernetes.io/projected/3cd79d78-ad19-47ae-942a-360a52bf522f-kube-api-access-5lq9l" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080242 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8fc13008-7b5b-4964-baf6-3320a2e3078e" volumeName="kubernetes.io/projected/8fc13008-7b5b-4964-baf6-3320a2e3078e-kube-api-access-dh6lx" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080270 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b15c33eb-ef11-4c4f-8ee0-c67a30150de3" volumeName="kubernetes.io/configmap/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-serviceca" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080283 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1e06a2c-e799-452d-9154-1470a26915b8" volumeName="kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080296 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1dd7863e-8391-4629-9a8d-38324d296e87" volumeName="kubernetes.io/configmap/1dd7863e-8391-4629-9a8d-38324d296e87-konnectivity-ca" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080307 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa" volumeName="kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-tuned" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080321 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b8737327-9a63-4ff6-899b-905c18fa2dcd" volumeName="kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080333 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9abd182-e801-44f6-a8ba-b9087aa0dca6" volumeName="kubernetes.io/secret/e9abd182-e801-44f6-a8ba-b9087aa0dca6-cert" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080346 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9f6a25f-ca01-4224-bd59-ff0205c1aa17" volumeName="kubernetes.io/projected/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-kube-api-access-hkqls" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080361 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd96fe8-a858-4742-8b93-75b58c9e48a8" volumeName="kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-trusted-ca" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080384 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa" volumeName="kubernetes.io/projected/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-kube-api-access-rnfw9" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080397 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f42385bf-b692-423c-95a5-c29d1a3532d7" volumeName="kubernetes.io/projected/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-api-access-hwjtk" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080411 5019 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f8638b06-49e9-43bb-bc66-ea3fd87fd136" volumeName="kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-sysctl-allowlist" seLinuxMountContext="" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080424 5019 reconstruct.go:97] "Volume reconstruction finished" Nov 04 04:47:07.081066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.080432 5019 reconciler.go:29] "Reconciler: start to sync state" Nov 04 04:47:07.095092 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.095047 5019 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 04 04:47:07.101231 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.101210 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/1.log" Nov 04 04:47:07.101417 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.101213 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/1.log" Nov 04 04:47:07.115238 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.115209 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:47:07.115856 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.115731 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:47:07.116731 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.116710 5019 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 04 04:47:07.116731 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.116733 5019 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 04 04:47:07.116840 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.116749 5019 kubelet.go:2521] "Starting kubelet main sync loop" Nov 04 04:47:07.116840 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.116783 5019 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 04 04:47:07.129196 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.129177 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/1.log" Nov 04 04:47:07.129301 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.129201 5019 generic.go:356] "Generic (PLEG): container finished" podID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" exitCode=255 Nov 04 04:47:07.138852 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.138823 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="4a0c46cbea4ab28a9ff11ad301770fa74a8ebcf04d0f4ae6c5ab4e97eac771cc" exitCode=0 Nov 04 04:47:07.138852 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.138845 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="bbeba408cb6cbb01d753e91af1304ff0d238df9e2b825156de382b7ea5d65a90" exitCode=0 Nov 04 04:47:07.138852 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.138851 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="6d59dc5d8df6139233a7e07db0ea404b5cb9eb9156189419790902f56417da75" exitCode=0 Nov 04 04:47:07.138852 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.138857 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="1c6263075e9a31daadff3addc64a659d18005adda43d83a70ac65fe16939a7e8" exitCode=0 Nov 04 04:47:07.139134 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.138862 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="5dda0c68857efecb3ca36493bee0c8224a75b47375a8ba462b6dbc495f019c87" exitCode=0 Nov 04 04:47:07.139134 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.138868 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8638b06-49e9-43bb-bc66-ea3fd87fd136" containerID="41535a95ad89e3a80cb0c46869343cd00cee354908f66be3641764fb24a2a20e" exitCode=0 Nov 04 04:47:07.148318 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.148295 5019 generic.go:356] "Generic (PLEG): container finished" podID="06ee30152979b4b078f521656a245bb9" containerID="63582b26733f27b07385b1c06b8596c6ebe4e2422ddf563f744c973a1c011b8c" exitCode=0 Nov 04 04:47:07.176065 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.176037 5019 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" Nov 04 04:47:07.178611 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.178587 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:47:07.178976 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.178942 5019 generic.go:356] "Generic (PLEG): container finished" podID="7472ef71-a7e6-495f-8212-189582db5c77" containerID="852560e022bc5ee345f060f44a5ff6995ef5ac2b56a7c473aa43cd21701ed05d" exitCode=1 Nov 04 04:47:07.181594 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.181578 5019 manager.go:324] Recovery completed Nov 04 04:47:07.199013 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.198986 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.200735 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.200711 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.200860 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.200747 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.200860 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.200761 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.205785 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.205758 5019 cpu_manager.go:226] "Starting" policy="none" Nov 04 04:47:07.205785 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.205782 5019 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 04 04:47:07.205936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.205819 5019 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 04 04:47:07.206044 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206024 5019 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 04 04:47:07.206087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206046 5019 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 04 04:47:07.206087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206070 5019 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 04 04:47:07.206087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206078 5019 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 04 04:47:07.206087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206086 5019 policy_none.go:50] "Start" Nov 04 04:47:07.206310 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206104 5019 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 04 04:47:07.206310 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206118 5019 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 04 04:47:07.206403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206388 5019 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 04 04:47:07.206476 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206407 5019 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 04 04:47:07.206476 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206416 5019 policy_none.go:44] "Start" Nov 04 04:47:07.206614 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.206588 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.208856 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.208053 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.208856 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.208085 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.208856 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.208100 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.211647 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.211621 5019 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 04 04:47:07.215139 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.215124 5019 manager.go:341] "Starting Device Plugin manager" Nov 04 04:47:07.215229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.215150 5019 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 04 04:47:07.215229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.215160 5019 server.go:87] "Starting device plugin registration server" Nov 04 04:47:07.215559 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.215545 5019 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 04 04:47:07.215622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.215561 5019 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 04 04:47:07.215858 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.215842 5019 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 04 04:47:07.215996 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.215950 5019 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 04 04:47:07.216082 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.216062 5019 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 04 04:47:07.216173 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.216136 5019 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 04 04:47:07.216257 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.216196 5019 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T04:47:07.2159777Z","UUID":"83adf6f5-1b19-4978-856c-799c49f87bc8","Handler":null,"Name":"","Endpoint":""} Nov 04 04:47:07.217395 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.216937 5019 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal"] Nov 04 04:47:07.217395 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.217141 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.217944 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.217698 5019 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 04 04:47:07.217944 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.217748 5019 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" Nov 04 04:47:07.217944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.217878 5019 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 04 04:47:07.217944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.217907 5019 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 04 04:47:07.218544 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.218522 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.218631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.218560 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.218631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.218578 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.219088 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.219071 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.219681 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.219651 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.220000 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.219942 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.220080 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220020 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.220080 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220035 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.220528 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220488 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"247d5fdffbb0596570a9bedc92fe6730","Type":"ContainerStarted","Data":"a178037cbde026ee0541618c5bcc3b39f6069693b5d3861b7871eb19eccca183"} Nov 04 04:47:07.220633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220536 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"247d5fdffbb0596570a9bedc92fe6730","Type":"ContainerStarted","Data":"1f183868763ae7d5ec0432ed2e1a3fd4b4d6ab986c98ab42134a4d85417f10a7"} Nov 04 04:47:07.220633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220549 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"06ee30152979b4b078f521656a245bb9","Type":"ContainerStarted","Data":"74d6b04d4fcc06929b58382e79888b1007362f3f7bd94552cc15c77b21a70da7"} Nov 04 04:47:07.220633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220563 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"06ee30152979b4b078f521656a245bb9","Type":"ContainerDied","Data":"63582b26733f27b07385b1c06b8596c6ebe4e2422ddf563f744c973a1c011b8c"} Nov 04 04:47:07.220633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220575 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" event={"ID":"06ee30152979b4b078f521656a245bb9","Type":"ContainerStarted","Data":"0410722c0cf1579f93e2b778b73fd4e27913ab4273e14ce060366d24ebb23a65"} Nov 04 04:47:07.220633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220606 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.221126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220706 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.221126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220723 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.221126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.220734 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.221126 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.220946 5019 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.221378 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.221364 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.221435 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.221390 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.221435 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.221406 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.221562 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.221549 5019 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-45.us-west-1.compute.internal\" not found" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.268485 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.268451 5019 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:47:07.268670 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.268559 5019 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:47:07.268670 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.268602 5019 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 04 04:47:07.268936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.268914 5019 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:47:07.276975 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.276958 5019 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.316211 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.316124 5019 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 04 04:47:07.317281 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.317261 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 04 04:47:07.317412 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.317293 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 04 04:47:07.317412 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.317304 5019 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-45.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 04 04:47:07.317412 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.317355 5019 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.319355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.319336 5019 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 04 04:47:07.335356 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.335335 5019 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:47:07.335465 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.335391 5019 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.335465 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.335403 5019 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.369695 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.369664 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.369867 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.369699 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.369867 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.369719 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247d5fdffbb0596570a9bedc92fe6730-config\") pod \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"247d5fdffbb0596570a9bedc92fe6730\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.426200 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.426163 5019 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.426404 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.426269 5019 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.439264 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.439236 5019 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:47:07.439393 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:07.439279 5019 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.470483 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.470440 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.470636 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.470491 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.470636 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.470563 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.470636 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.470572 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/06ee30152979b4b078f521656a245bb9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"06ee30152979b4b078f521656a245bb9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.470636 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.470611 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247d5fdffbb0596570a9bedc92fe6730-config\") pod \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"247d5fdffbb0596570a9bedc92fe6730\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:07.470951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:07.470656 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/247d5fdffbb0596570a9bedc92fe6730-config\") pod \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" (UID: \"247d5fdffbb0596570a9bedc92fe6730\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:08.060992 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.060959 5019 apiserver.go:52] "Watching apiserver" Nov 04 04:47:08.182000 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.181975 5019 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:08.182169 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.182110 5019 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:08.215193 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.215170 5019 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 04 04:47:08.215885 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.215860 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5gfpr","openshift-insights/insights-runtime-extractor-sqh8z","openshift-service-ca/service-ca-5fffc97bdf-bzzbz","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2","openshift-ingress/router-default-74447c8475-62kjf","openshift-network-console/networking-console-plugin-86c478bb88-pnlsz","openshift-ovn-kubernetes/ovnkube-node-xtqv6","kube-system/kas-connection-checker-685895c7c9-6jczj","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m","openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb","openshift-dns/dns-default-2c596","openshift-dns/node-resolver-ltftm","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p","openshift-image-registry/image-registry-cbb59b655-6pcvb","openshift-ingress-canary/ingress-canary-gpnl8","openshift-insights/periodic-gathering-hs56x-94wmn","openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv","openshift-console-operator/console-operator-7cd56b8dbc-mqqtb","openshift-network-operator/iptables-alerter-c8qfx","openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx","openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7","kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal","openshift-insights/insights-operator-7c4986d449-25b7z","openshift-multus/multus-additional-cni-plugins-4l4df","openshift-image-registry/image-registry-74898b77c8-h48lw","openshift-cluster-node-tuning-operator/tuned-nnsqw","openshift-multus/network-metrics-daemon-5wzcr","openshift-multus/multus-gzztp","kube-system/kas-connection-checker-685895c7c9-97npv","kube-system/global-pull-secret-syncer-sf9x7","kube-system/kas-connection-checker-685895c7c9-5t5wk","openshift-network-diagnostics/network-check-target-nrkxh","kube-system/konnectivity-agent-ksbdr","openshift-network-diagnostics/network-check-source-6f78d59f99-dl259"] Nov 04 04:47:08.217566 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.217544 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.217959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.217943 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.219914 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.219894 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.220404 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.220387 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.221232 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.221211 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:08.229939 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.229919 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.231151 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.231135 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.231678 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.231663 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.233321 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.233308 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.242482 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.242466 5019 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:47:08.242556 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.242515 5019 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:08.242828 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.242811 5019 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 04 04:47:08.242911 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.242853 5019 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-45.us-west-1.compute.internal" Nov 04 04:47:08.272689 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.272662 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.274171 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.274153 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.274335 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.274317 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.274335 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.274311 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.274836 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.274816 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 04 04:47:08.275027 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275010 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 04 04:47:08.275128 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275097 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.275128 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275113 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 04 04:47:08.275233 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275154 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 04 04:47:08.275233 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275180 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 04 04:47:08.275233 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275201 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.275233 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275225 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.275370 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275248 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 04 04:47:08.275436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275422 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hn6dc\"" Nov 04 04:47:08.275481 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275433 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rccwk\"" Nov 04 04:47:08.275481 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275479 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 04 04:47:08.275570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275528 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.275570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275535 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 04 04:47:08.275570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275529 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 04 04:47:08.275570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275552 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vmx8x\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275579 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275584 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275585 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275637 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275637 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275813 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.275859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275857 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 04 04:47:08.276112 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.275918 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.276112 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.276027 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.276219 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.276205 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 04 04:47:08.276303 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.276288 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f6mcg\"" Nov 04 04:47:08.276349 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.276335 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9n58l\"" Nov 04 04:47:08.277462 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.277449 5019 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 04 04:47:08.280631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280611 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslwv\" (UniqueName: \"kubernetes.io/projected/6bd96fe8-a858-4742-8b93-75b58c9e48a8-kube-api-access-bslwv\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.280711 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280645 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-system-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.280711 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280670 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-host\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.280711 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280695 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.280862 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280753 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-kubelet-config\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.280862 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280807 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-config\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:47:08.280862 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280844 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-var-lib-kubelet\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.280968 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280952 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:47:08.281022 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.280974 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-config\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:47:08.281022 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281010 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwc8\" (UniqueName: \"kubernetes.io/projected/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-kube-api-access-hxwc8\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.281126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281097 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-var-lib-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.281168 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281137 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-run\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.281215 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281184 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.281268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281232 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:47:08.281268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281252 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-hostroot\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.281329 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281306 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-stats-auth\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.281329 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281326 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-serving-cert\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:47:08.281385 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281341 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m28pd\" (UniqueName: \"kubernetes.io/projected/1c148a52-c563-4f42-9d49-0606acf343e6-kube-api-access-m28pd\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.281417 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281389 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-k8s-cni-cncf-io\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.281417 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281410 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5s7b\" (UniqueName: \"kubernetes.io/projected/3c90286e-b41c-4649-8468-b583b6fcbcef-kube-api-access-v5s7b\") pod \"migrator-66df5d496b-x6fc7\" (UID: \"3c90286e-b41c-4649-8468-b583b6fcbcef\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:08.281478 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281440 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-cnibin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.281585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281572 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-sys-fs\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.281684 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281602 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-dbus\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.281684 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281646 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5p59\" (UniqueName: \"kubernetes.io/projected/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-kube-api-access-g5p59\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:47:08.281816 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281728 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-etc-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.281816 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281759 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9abd182-e801-44f6-a8ba-b9087aa0dca6-cert\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:47:08.281816 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281790 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-stats-auth\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.281988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281833 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-trusted-ca\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.281988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281864 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.281988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281893 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.281988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281919 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvl9\" (UniqueName: \"kubernetes.io/projected/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kube-api-access-2nvl9\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.281988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281944 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.281988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.281967 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dcc5b0-c4fd-485d-bda3-604e8965dcff-host-slash\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.282141 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282091 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.282141 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282115 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f45l\" (UniqueName: \"kubernetes.io/projected/32dcc5b0-c4fd-485d-bda3-604e8965dcff-kube-api-access-7f45l\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.282192 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282149 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-config\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.282228 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282187 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-multus\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.282297 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282224 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dd7863e-8391-4629-9a8d-38324d296e87-agent-certs\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:47:08.282297 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282242 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-host\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.282297 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282286 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-tuned\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.282415 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282395 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnfw9\" (UniqueName: \"kubernetes.io/projected/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-kube-api-access-rnfw9\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.282454 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282419 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-config\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.282503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282401 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-tuned\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.282503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282444 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6773a478-4dfc-4115-a719-93ed66a03fde-signing-key\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:08.282595 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282516 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-tmp\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.282595 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282562 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.282595 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282587 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd79d78-ad19-47ae-942a-360a52bf522f-tmp-dir\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.282699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282613 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-bin\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.282699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282619 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-tmp\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.282699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282656 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-config\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.282699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282675 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cd79d78-ad19-47ae-942a-360a52bf522f-tmp-dir\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.282854 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282711 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.282854 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282729 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.282854 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282825 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpggk\" (UniqueName: \"kubernetes.io/projected/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf-kube-api-access-tpggk\") pod \"kas-connection-checker-685895c7c9-5t5wk\" (UID: \"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf\") " pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:47:08.282854 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282842 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-registration-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.282986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282855 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-lib-modules\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.282986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282873 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5jf\" (UniqueName: \"kubernetes.io/projected/6773a478-4dfc-4115-a719-93ed66a03fde-kube-api-access-8s5jf\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:08.282986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282886 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd96fe8-a858-4742-8b93-75b58c9e48a8-serving-cert\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.282986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282909 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.282986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.282954 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.283221 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283016 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.283221 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283104 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-script-lib\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.283315 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283296 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42385bf-b692-423c-95a5-c29d1a3532d7-crio-socket\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.283345 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283329 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-conf\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.283433 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283417 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7nnj\" (UniqueName: \"kubernetes.io/projected/e9abd182-e801-44f6-a8ba-b9087aa0dca6-kube-api-access-r7nnj\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:47:08.283468 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283444 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.283468 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283462 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7472ef71-a7e6-495f-8212-189582db5c77-ovn-node-metrics-cert\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.283519 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283482 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc13008-7b5b-4964-baf6-3320a2e3078e-hosts-file\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.283519 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283499 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.283570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283551 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysconfig\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.283622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283605 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-sys\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.283651 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283613 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6bd96fe8-a858-4742-8b93-75b58c9e48a8-serving-cert\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.283684 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283671 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.283716 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283705 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.283767 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283752 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7863e-8391-4629-9a8d-38324d296e87-konnectivity-ca\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:47:08.283830 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283817 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6773a478-4dfc-4115-a719-93ed66a03fde-signing-cabundle\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:08.283872 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283861 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-device-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.283900 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283881 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.283933 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283898 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbhxl\" (UniqueName: \"kubernetes.io/projected/0d2b9220-c17e-4f7a-8263-a00a86a03c81-kube-api-access-bbhxl\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.283933 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283925 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-default-certificate\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.284021 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283943 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh6lx\" (UniqueName: \"kubernetes.io/projected/8fc13008-7b5b-4964-baf6-3320a2e3078e-kube-api-access-dh6lx\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.284021 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283968 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.284021 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.283995 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x992\" (UniqueName: \"kubernetes.io/projected/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-kube-api-access-7x992\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.284109 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284032 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz2ws\" (UniqueName: \"kubernetes.io/projected/4867d39c-aede-492d-bdd5-51b57b9baed4-kube-api-access-lz2ws\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.284109 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284067 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.284109 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284093 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-snapshots\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.284216 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284135 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-kubelet\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.284216 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284152 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-default-certificate\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.284216 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284168 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7hw\" (UniqueName: \"kubernetes.io/projected/3d019953-b35c-4683-bba1-7fa5f86ed823-kube-api-access-mg7hw\") pod \"kas-connection-checker-685895c7c9-97npv\" (UID: \"3d019953-b35c-4683-bba1-7fa5f86ed823\") " pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:47:08.284301 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284229 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-node-log\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.284301 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284256 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.284301 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284280 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1c148a52-c563-4f42-9d49-0606acf343e6-snapshots\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.284301 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284286 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.284404 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284317 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-serviceca\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.284404 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284389 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.284458 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284408 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.284458 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284424 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-multus-certs\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.284511 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284486 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.284511 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284506 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-systemd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.284564 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284521 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.284564 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284548 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c148a52-c563-4f42-9d49-0606acf343e6-serving-cert\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.284614 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284580 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12dada1b-2c87-4515-ab1f-2022d70d5c1a-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:08.284663 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284645 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:08.284717 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284691 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-bin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.284747 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284721 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c148a52-c563-4f42-9d49-0606acf343e6-serving-cert\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.284747 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284726 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-conf-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.284823 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284751 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-system-cni-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.284823 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284770 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.284823 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284785 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-modprobe-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.284907 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284847 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc13008-7b5b-4964-baf6-3320a2e3078e-tmp-dir\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.284907 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284870 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.284959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284912 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.284959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284935 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fc13008-7b5b-4964-baf6-3320a2e3078e-tmp-dir\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.284959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.284950 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lq9l\" (UniqueName: \"kubernetes.io/projected/3cd79d78-ad19-47ae-942a-360a52bf522f-kube-api-access-5lq9l\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.285036 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285002 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.285036 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285020 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-kubernetes\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.285093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285045 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-tmp\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.285093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285076 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.285186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285098 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-multus-daemon-config\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.285186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285121 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-tmp\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.285186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285124 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv6vh\" (UniqueName: \"kubernetes.io/projected/1944e222-fe66-4a8b-a407-184928fdc15a-kube-api-access-tv6vh\") pod \"network-check-source-6f78d59f99-dl259\" (UID: \"1944e222-fe66-4a8b-a407-184928fdc15a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:47:08.285186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285164 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.285315 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285202 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.285315 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285240 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-log-socket\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.285315 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285263 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.285315 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285291 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjtk\" (UniqueName: \"kubernetes.io/projected/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-api-access-hwjtk\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.285436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285309 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-netns\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.285471 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285432 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-etc-kubernetes\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.285471 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285434 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.285537 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285471 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7txj\" (UniqueName: \"kubernetes.io/projected/7676efb4-629c-40eb-bada-087789bc737f-kube-api-access-n7txj\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.285537 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285496 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dcc5b0-c4fd-485d-bda3-604e8965dcff-iptables-alerter-script\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.285605 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285590 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmh4m\" (UniqueName: \"kubernetes.io/projected/9b081972-8fb4-4f6b-a930-5e45e9a933d5-kube-api-access-mmh4m\") pod \"migrator-66df5d496b-lh7qv\" (UID: \"9b081972-8fb4-4f6b-a930-5e45e9a933d5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:08.285639 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285615 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.285639 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285631 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.285706 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285650 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:47:08.285706 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285675 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-netd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.285785 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285769 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-service-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.285849 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285818 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.285880 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285861 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdndc\" (UniqueName: \"kubernetes.io/projected/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-kube-api-access-tdndc\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:47:08.285914 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285889 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.285945 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285912 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.285945 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.285933 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42385bf-b692-423c-95a5-c29d1a3532d7-data-volume\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.286066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286048 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f42385bf-b692-423c-95a5-c29d1a3532d7-data-volume\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.286099 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286058 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-slash\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.286127 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286104 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-netns\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.286162 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286146 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.286197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286176 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-cni-binary-copy\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.286241 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286213 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkqls\" (UniqueName: \"kubernetes.io/projected/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-kube-api-access-hkqls\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.286290 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286277 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-kubelet\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.286332 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286316 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-env-overrides\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.286373 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286346 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzqs7\" (UniqueName: \"kubernetes.io/projected/7472ef71-a7e6-495f-8212-189582db5c77-kube-api-access-jzqs7\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.286373 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286341 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.286472 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286376 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh7\" (UniqueName: \"kubernetes.io/projected/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b-kube-api-access-g7jh7\") pod \"kas-connection-checker-685895c7c9-6jczj\" (UID: \"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b\") " pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:47:08.286472 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286406 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.286472 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286433 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.286472 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286439 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-service-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.286472 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286457 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cnibin\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.286705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286487 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.286705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286515 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.286705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286554 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-socket-dir-parent\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.286705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286599 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.286705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286660 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-socket-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.286971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286717 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:47:08.286971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286749 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cd79d78-ad19-47ae-942a-360a52bf522f-config-volume\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.286971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286777 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-systemd-units\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.286971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286836 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.286971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286955 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:47:08.287202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.286955 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.287202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.287004 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbz86\" (UniqueName: \"kubernetes.io/projected/f8638b06-49e9-43bb-bc66-ea3fd87fd136-kube-api-access-tbz86\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.287202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.287036 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hndv8\" (UniqueName: \"kubernetes.io/projected/142a2dc1-069f-4121-a94b-c8a11c7d5570-kube-api-access-hndv8\") pod \"volume-data-source-validator-58c9f5f46d-bpm6p\" (UID: \"142a2dc1-069f-4121-a94b-c8a11c7d5570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:47:08.287202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.287063 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-ovn\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.287202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.287087 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-systemd\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.325906 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.325307 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 04 04:47:08.325906 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.325637 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 04 04:47:08.326500 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.326467 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 04 04:47:08.327058 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327040 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.327336 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327321 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 04 04:47:08.327495 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327482 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 04 04:47:08.327578 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327564 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 04 04:47:08.327645 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327628 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.327688 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327674 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.327868 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327853 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.327930 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327885 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.327991 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.327978 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 04 04:47:08.328124 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328111 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 04 04:47:08.328167 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328157 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.328350 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328336 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.328395 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328356 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 04 04:47:08.328485 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328473 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.328528 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328481 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.328642 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328630 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.328684 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328660 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.328858 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328843 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.328971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328933 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.329024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328974 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 04 04:47:08.329082 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329067 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.329125 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329110 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.329182 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329169 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.329224 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329196 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 04 04:47:08.329224 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329213 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 04 04:47:08.329309 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329251 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.329309 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329291 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329352 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329437 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329451 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329456 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329601 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329627 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329614 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.328158 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329679 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329819 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329845 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329888 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.329972 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.330104 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-env-overrides\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.330271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.330183 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3cd79d78-ad19-47ae-942a-360a52bf522f-config-volume\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.331847 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.331830 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 04 04:47:08.332455 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.332435 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.332572 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.332509 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bd96fe8-a858-4742-8b93-75b58c9e48a8-trusted-ca\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.332572 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.332560 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.332873 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.332848 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.333036 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.333019 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-config\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.333366 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.333314 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c148a52-c563-4f42-9d49-0606acf343e6-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.333432 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.333389 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-binary-copy\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.333529 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.333515 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7472ef71-a7e6-495f-8212-189582db5c77-ovnkube-script-lib\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.334093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334066 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.334171 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334097 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.334171 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334098 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6773a478-4dfc-4115-a719-93ed66a03fde-signing-cabundle\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:08.334254 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334179 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dd7863e-8391-4629-9a8d-38324d296e87-konnectivity-ca\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:47:08.334254 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334200 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.334677 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334663 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-serviceca\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.334842 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.334807 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/12dada1b-2c87-4515-ab1f-2022d70d5c1a-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:08.335762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.335742 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.335817 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.335775 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/32dcc5b0-c4fd-485d-bda3-604e8965dcff-iptables-alerter-script\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.335875 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.335862 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-multus-daemon-config\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.336936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.336890 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7676efb4-629c-40eb-bada-087789bc737f-cni-binary-copy\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.339675 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.339658 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f45l\" (UniqueName: \"kubernetes.io/projected/32dcc5b0-c4fd-485d-bda3-604e8965dcff-kube-api-access-7f45l\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.340308 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.340281 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m28pd\" (UniqueName: \"kubernetes.io/projected/1c148a52-c563-4f42-9d49-0606acf343e6-kube-api-access-m28pd\") pod \"insights-operator-7c4986d449-25b7z\" (UID: \"1c148a52-c563-4f42-9d49-0606acf343e6\") " pod="openshift-insights/insights-operator-7c4986d449-25b7z" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.340748 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvl9\" (UniqueName: \"kubernetes.io/projected/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kube-api-access-2nvl9\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.340860 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5p59\" (UniqueName: \"kubernetes.io/projected/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-kube-api-access-g5p59\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.340939 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpggk\" (UniqueName: \"kubernetes.io/projected/8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf-kube-api-access-tpggk\") pod \"kas-connection-checker-685895c7c9-5t5wk\" (UID: \"8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf\") " pod="kube-system/kas-connection-checker-685895c7c9-5t5wk" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.340969 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5s7b\" (UniqueName: \"kubernetes.io/projected/3c90286e-b41c-4649-8468-b583b6fcbcef-kube-api-access-v5s7b\") pod \"migrator-66df5d496b-x6fc7\" (UID: \"3c90286e-b41c-4649-8468-b583b6fcbcef\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x6fc7" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.340981 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7nnj\" (UniqueName: \"kubernetes.io/projected/e9abd182-e801-44f6-a8ba-b9087aa0dca6-kube-api-access-r7nnj\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341185 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbhxl\" (UniqueName: \"kubernetes.io/projected/0d2b9220-c17e-4f7a-8263-a00a86a03c81-kube-api-access-bbhxl\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341220 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslwv\" (UniqueName: \"kubernetes.io/projected/6bd96fe8-a858-4742-8b93-75b58c9e48a8-kube-api-access-bslwv\") pod \"console-operator-7cd56b8dbc-mqqtb\" (UID: \"6bd96fe8-a858-4742-8b93-75b58c9e48a8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341330 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5jf\" (UniqueName: \"kubernetes.io/projected/6773a478-4dfc-4115-a719-93ed66a03fde-kube-api-access-8s5jf\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:08.341479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341418 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnfw9\" (UniqueName: \"kubernetes.io/projected/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-kube-api-access-rnfw9\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.341895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341588 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.341895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341631 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv6vh\" (UniqueName: \"kubernetes.io/projected/1944e222-fe66-4a8b-a407-184928fdc15a-kube-api-access-tv6vh\") pod \"network-check-source-6f78d59f99-dl259\" (UID: \"1944e222-fe66-4a8b-a407-184928fdc15a\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-dl259" Nov 04 04:47:08.341895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341715 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz2ws\" (UniqueName: \"kubernetes.io/projected/4867d39c-aede-492d-bdd5-51b57b9baed4-kube-api-access-lz2ws\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.341895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341715 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x992\" (UniqueName: \"kubernetes.io/projected/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-kube-api-access-7x992\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.341895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341778 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh6lx\" (UniqueName: \"kubernetes.io/projected/8fc13008-7b5b-4964-baf6-3320a2e3078e-kube-api-access-dh6lx\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.341895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.341867 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7hw\" (UniqueName: \"kubernetes.io/projected/3d019953-b35c-4683-bba1-7fa5f86ed823-kube-api-access-mg7hw\") pod \"kas-connection-checker-685895c7c9-97npv\" (UID: \"3d019953-b35c-4683-bba1-7fa5f86ed823\") " pod="kube-system/kas-connection-checker-685895c7c9-97npv" Nov 04 04:47:08.342071 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.342056 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.342367 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.342351 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwc8\" (UniqueName: \"kubernetes.io/projected/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-kube-api-access-hxwc8\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.342830 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.342814 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lq9l\" (UniqueName: \"kubernetes.io/projected/3cd79d78-ad19-47ae-942a-360a52bf522f-kube-api-access-5lq9l\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.344314 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.344298 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7txj\" (UniqueName: \"kubernetes.io/projected/7676efb4-629c-40eb-bada-087789bc737f-kube-api-access-n7txj\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.345300 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.345285 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmh4m\" (UniqueName: \"kubernetes.io/projected/9b081972-8fb4-4f6b-a930-5e45e9a933d5-kube-api-access-mmh4m\") pod \"migrator-66df5d496b-lh7qv\" (UID: \"9b081972-8fb4-4f6b-a930-5e45e9a933d5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-lh7qv" Nov 04 04:47:08.345549 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.345532 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") pod \"periodic-gathering-hs56x-94wmn\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:47:08.345937 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.345923 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbz86\" (UniqueName: \"kubernetes.io/projected/f8638b06-49e9-43bb-bc66-ea3fd87fd136-kube-api-access-tbz86\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.346051 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.346037 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.346087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.346074 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkqls\" (UniqueName: \"kubernetes.io/projected/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-kube-api-access-hkqls\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.346503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.346488 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.347340 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.347324 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjtk\" (UniqueName: \"kubernetes.io/projected/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-api-access-hwjtk\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.347683 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.347663 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzqs7\" (UniqueName: \"kubernetes.io/projected/7472ef71-a7e6-495f-8212-189582db5c77-kube-api-access-jzqs7\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.347757 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.347741 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hndv8\" (UniqueName: \"kubernetes.io/projected/142a2dc1-069f-4121-a94b-c8a11c7d5570-kube-api-access-hndv8\") pod \"volume-data-source-validator-58c9f5f46d-bpm6p\" (UID: \"142a2dc1-069f-4121-a94b-c8a11c7d5570\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bpm6p" Nov 04 04:47:08.347998 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.347982 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jh7\" (UniqueName: \"kubernetes.io/projected/a06238b1-20bb-4835-bdac-4fdd5fa9ce2b-kube-api-access-g7jh7\") pod \"kas-connection-checker-685895c7c9-6jczj\" (UID: \"a06238b1-20bb-4835-bdac-4fdd5fa9ce2b\") " pod="kube-system/kas-connection-checker-685895c7c9-6jczj" Nov 04 04:47:08.348121 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.348102 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdrz\" (UniqueName: \"kubernetes.io/projected/ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b-kube-api-access-psdrz\") pod \"network-check-target-nrkxh\" (UID: \"ae4b01da-24ff-42a9-ad6b-e73f8c6b2c7b\") " pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:47:08.348171 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.348153 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdndc\" (UniqueName: \"kubernetes.io/projected/2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80-kube-api-access-tdndc\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m\" (UID: \"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" Nov 04 04:47:08.348367 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.348352 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.359912 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.359887 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 04 04:47:08.360420 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360406 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 04 04:47:08.360532 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360434 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 04 04:47:08.360618 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360569 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 04 04:47:08.360618 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360598 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 04 04:47:08.360742 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360727 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6sxpx\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360742 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-6x6qg\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360744 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360754 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jwpjv\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360833 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tqbjc\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360846 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360886 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g79lj\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360891 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 04 04:47:08.360903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360897 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-n7w7t\"" Nov 04 04:47:08.361392 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360911 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kgq44\"" Nov 04 04:47:08.361392 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.360940 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvrn2\"" Nov 04 04:47:08.361392 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361004 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ssxrh\"" Nov 04 04:47:08.361392 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361010 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 04 04:47:08.361392 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361091 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 04 04:47:08.361392 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361386 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-jqdfn\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361419 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zsr9v\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361437 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361442 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mkkxt\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361452 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361483 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-shz8v\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361489 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hrfp5\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361496 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9cn8l\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361507 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mrmbg\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361492 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-psc56\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361516 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361510 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361546 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvvjk\"" Nov 04 04:47:08.361602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361580 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-w4xfx\"" Nov 04 04:47:08.361940 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.361625 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vmp7s\"" Nov 04 04:47:08.362446 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.362430 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e9abd182-e801-44f6-a8ba-b9087aa0dca6-cert\") pod \"ingress-canary-gpnl8\" (UID: \"e9abd182-e801-44f6-a8ba-b9087aa0dca6\") " pod="openshift-ingress-canary/ingress-canary-gpnl8" Nov 04 04:47:08.363572 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.363558 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.363610 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.363565 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6773a478-4dfc-4115-a719-93ed66a03fde-signing-key\") pod \"service-ca-5fffc97bdf-bzzbz\" (UID: \"6773a478-4dfc-4115-a719-93ed66a03fde\") " pod="openshift-service-ca/service-ca-5fffc97bdf-bzzbz" Nov 04 04:47:08.364721 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.364690 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7472ef71-a7e6-495f-8212-189582db5c77-ovn-node-metrics-cert\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.364850 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.364728 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.364908 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.364865 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-original-pull-secret\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.365894 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.365879 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.367000 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.366984 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.370244 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.370228 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-q5r74\"" Nov 04 04:47:08.370326 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.370233 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 04 04:47:08.372424 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.372407 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/07ef7ea9-2699-46f3-8448-53a7b72b2e0b-serving-cert\") pod \"service-ca-operator-544d749c8c-424gx\" (UID: \"07ef7ea9-2699-46f3-8448-53a7b72b2e0b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" Nov 04 04:47:08.372581 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.372560 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dd7863e-8391-4629-9a8d-38324d296e87-agent-certs\") pod \"konnectivity-agent-ksbdr\" (UID: \"1dd7863e-8391-4629-9a8d-38324d296e87\") " pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:47:08.385065 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.385039 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-x6fc7_3c90286e-b41c-4649-8468-b583b6fcbcef/migrator/0.log" Nov 04 04:47:08.387867 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387842 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-multus-certs\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.387951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387871 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.387951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387888 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-systemd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.387951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387903 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.387951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387920 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:08.387951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387945 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-bin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387960 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-multus-certs\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387965 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387966 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-conf-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387995 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387971 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-systemd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388002 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-bin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388035 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-system-cni-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.387995 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-conf-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388063 5019 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388093 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-system-cni-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388063 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.388132 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388121 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388144 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.88812576 +0000 UTC m=+1.930540388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388147 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388163 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-modprobe-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388194 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-kubernetes\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388217 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388240 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.888220619 +0000 UTC m=+1.930635239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388270 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388283 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388286 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388298 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-modprobe-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388318 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.888307039 +0000 UTC m=+1.930721665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388268 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-kubernetes\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388345 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-log-socket\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388352 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388364 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388380 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-netns\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388395 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-etc-kubernetes\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388423 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-netd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388422 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388439 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-netns\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388458 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-etc-kubernetes\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388465 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-log-socket\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388460 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-netd\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388492 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388509 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-slash\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388525 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-netns\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388544 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-kubelet\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388554 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-slash\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388560 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cnibin\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388562 5019 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388586 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-run-netns\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388596 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-kubelet\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.388589 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388610 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.888600397 +0000 UTC m=+1.931015003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388599 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-cnibin\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388624 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388651 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-socket-dir-parent\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388664 5019 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388675 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-socket-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388706 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-systemd-units\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.388711 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls podName:3cd79d78-ad19-47ae-942a-360a52bf522f nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.888700021 +0000 UTC m=+1.931114643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls") pod "dns-default-2c596" (UID: "3cd79d78-ad19-47ae-942a-360a52bf522f") : secret "dns-default-metrics-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388713 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-socket-dir-parent\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388736 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-ovn\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388760 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-socket-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388772 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-ovn\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388807 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-systemd\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388823 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-systemd-units\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388847 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-system-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388884 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-systemd\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388902 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-host\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388918 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-system-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388942 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.388974 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-kubelet-config\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389002 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b15c33eb-ef11-4c4f-8ee0-c67a30150de3-host\") pod \"node-ca-5gfpr\" (UID: \"b15c33eb-ef11-4c4f-8ee0-c67a30150de3\") " pod="openshift-image-registry/node-ca-5gfpr" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389018 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-multus-cni-dir\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389040 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-var-lib-kubelet\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389062 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-var-lib-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389076 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-run\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389092 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-hostroot\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389107 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-k8s-cni-cncf-io\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389106 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-var-lib-kubelet\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389121 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-cnibin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389151 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-kubelet-config\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389165 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-cnibin\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389173 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-var-lib-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389176 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-run-k8s-cni-cncf-io\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389174 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-run\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389183 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-hostroot\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389190 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-sys-fs\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389217 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-dbus\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389234 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-etc-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389262 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389281 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-sys-fs\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389287 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dcc5b0-c4fd-485d-bda3-604e8965dcff-host-slash\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389296 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-etc-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389283 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e2ff9d2-73c3-4635-a07a-ca5579d71d65-dbus\") pod \"global-pull-secret-syncer-sf9x7\" (UID: \"5e2ff9d2-73c3-4635-a07a-ca5579d71d65\") " pod="kube-system/global-pull-secret-syncer-sf9x7" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389317 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389326 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/32dcc5b0-c4fd-485d-bda3-604e8965dcff-host-slash\") pod \"iptables-alerter-c8qfx\" (UID: \"32dcc5b0-c4fd-485d-bda3-604e8965dcff\") " pod="openshift-network-operator/iptables-alerter-c8qfx" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389396 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-multus\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.389423 5019 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389428 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-cni-multus\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389448 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-host\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389424 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-host\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.389467 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.889458333 +0000 UTC m=+1.931872959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389497 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-bin\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389518 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389534 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-registration-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389550 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-lib-modules\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389551 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-host-cni-bin\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389561 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8638b06-49e9-43bb-bc66-ea3fd87fd136-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4l4df\" (UID: \"f8638b06-49e9-43bb-bc66-ea3fd87fd136\") " pod="openshift-multus/multus-additional-cni-plugins-4l4df" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389571 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389554 5019 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389611 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-registration-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.389644 5019 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389664 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-lib-modules\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389671 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42385bf-b692-423c-95a5-c29d1a3532d7-crio-socket\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.389686 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.889673005 +0000 UTC m=+1.932087613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:47:08.389679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389715 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-conf\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389759 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389784 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc13008-7b5b-4964-baf6-3320a2e3078e-hosts-file\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389834 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-conf\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389716 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f42385bf-b692-423c-95a5-c29d1a3532d7-crio-socket\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389806 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-run-openvswitch\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389831 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysconfig\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389862 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8fc13008-7b5b-4964-baf6-3320a2e3078e-hosts-file\") pod \"node-resolver-ltftm\" (UID: \"8fc13008-7b5b-4964-baf6-3320a2e3078e\") " pod="openshift-dns/node-resolver-ltftm" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389874 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysconfig\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389884 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-sys\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389912 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-device-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389936 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389946 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-sys\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389966 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389973 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1443a9c8-ac47-4262-a21f-88ce5140b3f9-device-dir\") pod \"aws-ebs-csi-driver-node-25hs2\" (UID: \"1443a9c8-ac47-4262-a21f-88ce5140b3f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-25hs2" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.389989 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-kubelet\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390012 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-node-log\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390033 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390057 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390062 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7676efb4-629c-40eb-bada-087789bc737f-host-var-lib-kubelet\") pod \"multus-gzztp\" (UID: \"7676efb4-629c-40eb-bada-087789bc737f\") " pod="openshift-multus/multus-gzztp" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.390174 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:08.890161404 +0000 UTC m=+1.932576037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390201 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa-etc-sysctl-d\") pod \"tuned-nnsqw\" (UID: \"ac8a274b-5fa3-4d9c-96a5-44633e6b1cfa\") " pod="openshift-cluster-node-tuning-operator/tuned-nnsqw" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390215 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7472ef71-a7e6-495f-8212-189582db5c77-node-log\") pod \"ovnkube-node-xtqv6\" (UID: \"7472ef71-a7e6-495f-8212-189582db5c77\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.391827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.390712 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f42385bf-b692-423c-95a5-c29d1a3532d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.392630 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.392613 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4867d39c-aede-492d-bdd5-51b57b9baed4-metrics-certs\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.392700 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.392673 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f6a25f-ca01-4224-bd59-ff0205c1aa17-metrics-certs\") pod \"network-metrics-daemon-5wzcr\" (UID: \"e9f6a25f-ca01-4224-bd59-ff0205c1aa17\") " pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.519151 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.519120 5019 scope.go:122] "RemoveContainer" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" Nov 04 04:47:08.530196 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.530170 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5wzcr" Nov 04 04:47:08.589149 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.589082 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m_2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80/kube-storage-version-migrator-operator/0.log" Nov 04 04:47:08.609618 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.609589 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.682890 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.682867 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:08.894877 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.894785 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:08.894877 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.894842 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.894908 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.894932 5019 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.894942 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.894989 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.894974925 +0000 UTC m=+2.937389553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895012 5019 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895013 5019 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:47:08.895071 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895056 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.895042011 +0000 UTC m=+2.937456622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895077 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.895070746 +0000 UTC m=+2.937485353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895088 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.89508245 +0000 UTC m=+2.937497056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.895106 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.895146 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895161 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895169 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.895176 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895194 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.895184367 +0000 UTC m=+2.937598974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895230 5019 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.895229 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895256 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.895249031 +0000 UTC m=+2.937663638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895270 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:08.895286 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895280 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:47:08.895720 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:08.895312 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:09.895301162 +0000 UTC m=+2.937715789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:47:08.897504 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.897488 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3cd79d78-ad19-47ae-942a-360a52bf522f-metrics-tls\") pod \"dns-default-2c596\" (UID: \"3cd79d78-ad19-47ae-942a-360a52bf522f\") " pod="openshift-dns/dns-default-2c596" Nov 04 04:47:08.936654 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.936632 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5wzcr"] Nov 04 04:47:08.939945 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:08.939919 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f6a25f_ca01_4224_bd59_ff0205c1aa17.slice/crio-37c3fe3ce3101c0d8a11a8fbf6d698b692101b3621772ae8eb9da4ba53867f68 WatchSource:0}: Error finding container 37c3fe3ce3101c0d8a11a8fbf6d698b692101b3621772ae8eb9da4ba53867f68: Status 404 returned error can't find the container with id 37c3fe3ce3101c0d8a11a8fbf6d698b692101b3621772ae8eb9da4ba53867f68 Nov 04 04:47:08.941935 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:08.941920 5019 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:47:09.132781 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.132750 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2c596" Nov 04 04:47:09.187189 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.187161 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wzcr" event={"ID":"e9f6a25f-ca01-4224-bd59-ff0205c1aa17","Type":"ContainerStarted","Data":"37c3fe3ce3101c0d8a11a8fbf6d698b692101b3621772ae8eb9da4ba53867f68"} Nov 04 04:47:09.188762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.188740 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:47:09.189192 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.189175 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/1.log" Nov 04 04:47:09.189296 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.189210 5019 generic.go:356] "Generic (PLEG): container finished" podID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" containerID="a370c89677c679df1ac8b56d251541eab646246a61d1c4ad50f4fa7d2a720962" exitCode=255 Nov 04 04:47:09.189347 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.189293 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" event={"ID":"6bd96fe8-a858-4742-8b93-75b58c9e48a8","Type":"ContainerDied","Data":"a370c89677c679df1ac8b56d251541eab646246a61d1c4ad50f4fa7d2a720962"} Nov 04 04:47:09.189347 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.189341 5019 scope.go:122] "RemoveContainer" containerID="7b0db3c9a3386a42930e05bc5c894eaae64a2d18cc9627716e264d33af6bb69d" Nov 04 04:47:09.190318 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.190295 5019 scope.go:122] "RemoveContainer" containerID="a370c89677c679df1ac8b56d251541eab646246a61d1c4ad50f4fa7d2a720962" Nov 04 04:47:09.190465 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.190445 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-mqqtb_openshift-console-operator(6bd96fe8-a858-4742-8b93-75b58c9e48a8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" podUID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" Nov 04 04:47:09.535820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.535771 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2c596"] Nov 04 04:47:09.539431 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:09.539409 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd79d78_ad19_47ae_942a_360a52bf522f.slice/crio-8494c83dc6ac6d73a01931409a714e68b740d1ec3e3e24948959860a48e319cd WatchSource:0}: Error finding container 8494c83dc6ac6d73a01931409a714e68b740d1ec3e3e24948959860a48e319cd: Status 404 returned error can't find the container with id 8494c83dc6ac6d73a01931409a714e68b740d1ec3e3e24948959860a48e319cd Nov 04 04:47:09.579297 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.579265 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:09.905614 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905525 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:09.905614 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905571 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:09.905614 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905593 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:09.905614 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905610 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905628 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905653 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905699 5019 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905729 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.905705876 +0000 UTC m=+4.948120488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905743 5019 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905757 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:09.905706 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905769 5019 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905759 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.905744169 +0000 UTC m=+4.948158788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905774 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905850 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905858 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905699 5019 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905861 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.905831755 +0000 UTC m=+4.948246370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:09.905936 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905913 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.90590166 +0000 UTC m=+4.948316266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:09.906435 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905962 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.905953037 +0000 UTC m=+4.948367643 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:47:09.906435 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905981 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.905973884 +0000 UTC m=+4.948388493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:47:09.906435 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:09.905997 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:11.905989884 +0000 UTC m=+4.948404494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:47:10.195157 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:10.195078 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:47:10.195603 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:10.195576 5019 scope.go:122] "RemoveContainer" containerID="a370c89677c679df1ac8b56d251541eab646246a61d1c4ad50f4fa7d2a720962" Nov 04 04:47:10.195911 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:10.195882 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-mqqtb_openshift-console-operator(6bd96fe8-a858-4742-8b93-75b58c9e48a8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" podUID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" Nov 04 04:47:10.197206 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:10.197181 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c596" event={"ID":"3cd79d78-ad19-47ae-942a-360a52bf522f","Type":"ContainerStarted","Data":"8494c83dc6ac6d73a01931409a714e68b740d1ec3e3e24948959860a48e319cd"} Nov 04 04:47:10.197303 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:10.197287 5019 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:47:11.203541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.203502 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wzcr" event={"ID":"e9f6a25f-ca01-4224-bd59-ff0205c1aa17","Type":"ContainerStarted","Data":"58fb5bace71953b8eab7bb8696cf60084f650a2ee05bf36167b9677f022000cc"} Nov 04 04:47:11.203973 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.203560 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5wzcr" event={"ID":"e9f6a25f-ca01-4224-bd59-ff0205c1aa17","Type":"ContainerStarted","Data":"b6c77d10456c8866df318c8ff04934b3470151e372ec5510538c28076d1d84b6"} Nov 04 04:47:11.839536 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.838919 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:47:11.929213 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929188 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:11.929328 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929222 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:11.929328 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929244 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:11.929328 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929269 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:11.929328 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929305 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929332 5019 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929343 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle podName:4867d39c-aede-492d-bdd5-51b57b9baed4 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.929322935 +0000 UTC m=+8.971737545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle") pod "router-default-74447c8475-62kjf" (UID: "4867d39c-aede-492d-bdd5-51b57b9baed4") : configmap references non-existent config key: service-ca.crt Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929387 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.929371022 +0000 UTC m=+8.971785648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929387 5019 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929397 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929398 5019 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929409 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cbb59b655-6pcvb: secret "image-registry-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929415 5019 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74898b77c8-h48lw: secret "image-registry-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929433 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls podName:d9d32ce2-2b5d-4f8b-904e-486f556d9e8e nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.929421043 +0000 UTC m=+8.971835692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-sfzpb" (UID: "d9d32ce2-2b5d-4f8b-904e-486f556d9e8e") : secret "cluster-monitoring-operator-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929453 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls podName:c1e06a2c-e799-452d-9154-1470a26915b8 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.929443491 +0000 UTC m=+8.971858103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls") pod "image-registry-cbb59b655-6pcvb" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8") : secret "image-registry-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929471 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls podName:b8737327-9a63-4ff6-899b-905c18fa2dcd nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.929461543 +0000 UTC m=+8.971876173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls") pod "image-registry-74898b77c8-h48lw" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd") : secret "image-registry-tls" not found Nov 04 04:47:11.929513 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929498 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:11.929902 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:11.929534 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:11.929902 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929607 5019 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:47:11.929902 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929630 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.92962457 +0000 UTC m=+8.972039176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:47:11.929902 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929663 5019 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:11.929902 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:11.929687 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:15.929677964 +0000 UTC m=+8.972092572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:12.208616 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:12.208545 5019 generic.go:356] "Generic (PLEG): container finished" podID="2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80" containerID="a09eb0405aa5dadac1a5f45042abb5efb96030518bc5fa5c5cc8af9014f672b4" exitCode=0 Nov 04 04:47:12.209087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:12.208615 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" event={"ID":"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80","Type":"ContainerDied","Data":"a09eb0405aa5dadac1a5f45042abb5efb96030518bc5fa5c5cc8af9014f672b4"} Nov 04 04:47:12.209087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:12.209009 5019 scope.go:122] "RemoveContainer" containerID="a09eb0405aa5dadac1a5f45042abb5efb96030518bc5fa5c5cc8af9014f672b4" Nov 04 04:47:12.211538 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:12.211512 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c596" event={"ID":"3cd79d78-ad19-47ae-942a-360a52bf522f","Type":"ContainerStarted","Data":"e3c80c0c4d6a47f31ea929b0d27c3df6ad64aff172f768d1ac96bf1f96691b1c"} Nov 04 04:47:12.211658 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:12.211576 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2c596" event={"ID":"3cd79d78-ad19-47ae-942a-360a52bf522f","Type":"ContainerStarted","Data":"499d2d034394235cefdbcb8afe6613086d9aa5e90c2f79afeb9d7ee64b04d16e"} Nov 04 04:47:12.983176 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:12.983142 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ksbdr" Nov 04 04:47:13.217026 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:13.216997 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-9dz6m" event={"ID":"2ff5a0f6-ec54-42d0-ba0e-397ab74c2c80","Type":"ContainerStarted","Data":"f0c41ae9cfd0ae85e4f12b3a0583a5ee3df1f7cd0d9316b4ecd98523a799e2ec"} Nov 04 04:47:13.217473 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:13.217139 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2c596" Nov 04 04:47:15.967736 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967695 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967745 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967782 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967829 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967856 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967887 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:15.967888 5019 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.967922 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:15.967927 5019 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:15.967965 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls podName:f42385bf-b692-423c-95a5-c29d1a3532d7 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:23.967943949 +0000 UTC m=+17.010358575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sqh8z" (UID: "f42385bf-b692-423c-95a5-c29d1a3532d7") : secret "insights-runtime-extractor-tls" not found Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:15.967961 5019 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:15.967988 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls podName:0d2b9220-c17e-4f7a-8263-a00a86a03c81 nodeName:}" failed. No retries permitted until 2026-11-04 04:47:23.96797789 +0000 UTC m=+17.010392502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-jkpn2" (UID: "0d2b9220-c17e-4f7a-8263-a00a86a03c81") : secret "samples-operator-tls" not found Nov 04 04:47:15.968229 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:15.968016 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert podName:12dada1b-2c87-4515-ab1f-2022d70d5c1a nodeName:}" failed. No retries permitted until 2026-11-04 04:47:23.967998216 +0000 UTC m=+17.010412839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pnlsz" (UID: "12dada1b-2c87-4515-ab1f-2022d70d5c1a") : secret "networking-console-plugin-cert" not found Nov 04 04:47:15.968828 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.968788 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4867d39c-aede-492d-bdd5-51b57b9baed4-service-ca-bundle\") pod \"router-default-74447c8475-62kjf\" (UID: \"4867d39c-aede-492d-bdd5-51b57b9baed4\") " pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:15.970899 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.970876 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9d32ce2-2b5d-4f8b-904e-486f556d9e8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-sfzpb\" (UID: \"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:15.971010 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.970898 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"image-registry-cbb59b655-6pcvb\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:15.971010 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:15.970996 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"image-registry-74898b77c8-h48lw\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:16.018802 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.018755 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" Nov 04 04:47:16.019111 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.019084 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:16.021084 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.021057 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:16.031909 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.031878 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:16.426402 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.426370 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb"] Nov 04 04:47:16.450514 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:16.450479 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d32ce2_2b5d_4f8b_904e_486f556d9e8e.slice/crio-30c73e5d2115503c69f175b61b98ef4cf25d41a6a3b213883c3d33f5063508a9 WatchSource:0}: Error finding container 30c73e5d2115503c69f175b61b98ef4cf25d41a6a3b213883c3d33f5063508a9: Status 404 returned error can't find the container with id 30c73e5d2115503c69f175b61b98ef4cf25d41a6a3b213883c3d33f5063508a9 Nov 04 04:47:16.463171 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:16.463146 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8737327_9a63_4ff6_899b_905c18fa2dcd.slice/crio-d218c831a984faa061bfea4a865b53b184198b76ca0fbf51dc8cced06d0fc6d0 WatchSource:0}: Error finding container d218c831a984faa061bfea4a865b53b184198b76ca0fbf51dc8cced06d0fc6d0: Status 404 returned error can't find the container with id d218c831a984faa061bfea4a865b53b184198b76ca0fbf51dc8cced06d0fc6d0 Nov 04 04:47:16.476888 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.476861 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74898b77c8-h48lw"] Nov 04 04:47:16.513141 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:16.513113 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4867d39c_aede_492d_bdd5_51b57b9baed4.slice/crio-5cfb906f125e3d1f193057a0e4fbfa917e0935ed187c90d11707ab31564ff5c2 WatchSource:0}: Error finding container 5cfb906f125e3d1f193057a0e4fbfa917e0935ed187c90d11707ab31564ff5c2: Status 404 returned error can't find the container with id 5cfb906f125e3d1f193057a0e4fbfa917e0935ed187c90d11707ab31564ff5c2 Nov 04 04:47:16.516316 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:16.516290 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e06a2c_e799_452d_9154_1470a26915b8.slice/crio-32cae6184c7dc73696c23a1567190c4786708de1fd986369e44225af0fdb2137 WatchSource:0}: Error finding container 32cae6184c7dc73696c23a1567190c4786708de1fd986369e44225af0fdb2137: Status 404 returned error can't find the container with id 32cae6184c7dc73696c23a1567190c4786708de1fd986369e44225af0fdb2137 Nov 04 04:47:16.523379 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.523357 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74447c8475-62kjf"] Nov 04 04:47:16.527532 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:16.527508 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cbb59b655-6pcvb"] Nov 04 04:47:17.231540 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.231508 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" event={"ID":"c1e06a2c-e799-452d-9154-1470a26915b8","Type":"ContainerStarted","Data":"d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3"} Nov 04 04:47:17.232017 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.231558 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" event={"ID":"c1e06a2c-e799-452d-9154-1470a26915b8","Type":"ContainerStarted","Data":"32cae6184c7dc73696c23a1567190c4786708de1fd986369e44225af0fdb2137"} Nov 04 04:47:17.233163 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.233136 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74447c8475-62kjf" event={"ID":"4867d39c-aede-492d-bdd5-51b57b9baed4","Type":"ContainerStarted","Data":"c9fdf7c111d7e724271d1dcf55324b4b976d8016198b918fccb43271f376ab27"} Nov 04 04:47:17.233303 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.233178 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74447c8475-62kjf" event={"ID":"4867d39c-aede-492d-bdd5-51b57b9baed4","Type":"ContainerStarted","Data":"5cfb906f125e3d1f193057a0e4fbfa917e0935ed187c90d11707ab31564ff5c2"} Nov 04 04:47:17.234558 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.234541 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" event={"ID":"b8737327-9a63-4ff6-899b-905c18fa2dcd","Type":"ContainerStarted","Data":"084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb"} Nov 04 04:47:17.234644 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.234570 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" event={"ID":"b8737327-9a63-4ff6-899b-905c18fa2dcd","Type":"ContainerStarted","Data":"d218c831a984faa061bfea4a865b53b184198b76ca0fbf51dc8cced06d0fc6d0"} Nov 04 04:47:17.235809 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.235779 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" event={"ID":"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e","Type":"ContainerStarted","Data":"30c73e5d2115503c69f175b61b98ef4cf25d41a6a3b213883c3d33f5063508a9"} Nov 04 04:47:17.566080 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:17.566050 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtqv6" Nov 04 04:47:18.019501 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:18.019467 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:18.022454 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:18.022432 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:18.240019 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:18.239989 5019 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:47:18.240019 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:18.239992 5019 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:47:18.251149 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:18.251116 5019 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:18.251593 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:18.251576 5019 scope.go:122] "RemoveContainer" containerID="a370c89677c679df1ac8b56d251541eab646246a61d1c4ad50f4fa7d2a720962" Nov 04 04:47:18.251843 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:18.251783 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-mqqtb_openshift-console-operator(6bd96fe8-a858-4742-8b93-75b58c9e48a8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" podUID="6bd96fe8-a858-4742-8b93-75b58c9e48a8" Nov 04 04:47:19.245891 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:19.245852 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-sfzpb" event={"ID":"d9d32ce2-2b5d-4f8b-904e-486f556d9e8e","Type":"ContainerStarted","Data":"0fe32580a7236f0e3506462eac12d3e0e5ad91a93b626dfccf910b51b9651e27"} Nov 04 04:47:19.246435 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:19.245904 5019 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:47:19.246435 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:19.246348 5019 scope.go:122] "RemoveContainer" containerID="a370c89677c679df1ac8b56d251541eab646246a61d1c4ad50f4fa7d2a720962" Nov 04 04:47:20.251631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:20.251606 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:47:20.252072 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:20.251721 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" event={"ID":"6bd96fe8-a858-4742-8b93-75b58c9e48a8","Type":"ContainerStarted","Data":"fdcae7221bfa334726f42c5464d7bb679efd56309204401fb8316bab6a8d03eb"} Nov 04 04:47:20.252136 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:20.252119 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:20.256564 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:20.256544 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-mqqtb" Nov 04 04:47:21.956549 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:21.956513 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:22.953051 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:22.953007 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:23.223319 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:23.223243 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2c596" Nov 04 04:47:24.038571 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.038538 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:24.038571 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.038577 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:24.038776 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.038610 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:24.041221 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.041181 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9220-c17e-4f7a-8263-a00a86a03c81-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-jkpn2\" (UID: \"0d2b9220-c17e-4f7a-8263-a00a86a03c81\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:24.041221 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.041185 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f42385bf-b692-423c-95a5-c29d1a3532d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqh8z\" (UID: \"f42385bf-b692-423c-95a5-c29d1a3532d7\") " pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:24.041388 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.041240 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12dada1b-2c87-4515-ab1f-2022d70d5c1a-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pnlsz\" (UID: \"12dada1b-2c87-4515-ab1f-2022d70d5c1a\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:24.120612 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.120589 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" Nov 04 04:47:24.121669 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.121653 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" Nov 04 04:47:24.134040 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.134019 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqh8z" Nov 04 04:47:24.496843 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.496816 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pnlsz"] Nov 04 04:47:24.540414 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:24.540385 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12dada1b_2c87_4515_ab1f_2022d70d5c1a.slice/crio-f2f6fe53c096d9b9ddc4812ea6f5f3b1951d6ff71e7094266e0bd16aba5c8f1b WatchSource:0}: Error finding container f2f6fe53c096d9b9ddc4812ea6f5f3b1951d6ff71e7094266e0bd16aba5c8f1b: Status 404 returned error can't find the container with id f2f6fe53c096d9b9ddc4812ea6f5f3b1951d6ff71e7094266e0bd16aba5c8f1b Nov 04 04:47:24.549116 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.549064 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sqh8z"] Nov 04 04:47:24.551558 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:24.551530 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42385bf_b692_423c_95a5_c29d1a3532d7.slice/crio-6503d295b35d406de21c8002cd2060ff1a2bcb83e74b6968c3a543cf79e0086b WatchSource:0}: Error finding container 6503d295b35d406de21c8002cd2060ff1a2bcb83e74b6968c3a543cf79e0086b: Status 404 returned error can't find the container with id 6503d295b35d406de21c8002cd2060ff1a2bcb83e74b6968c3a543cf79e0086b Nov 04 04:47:24.599063 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:24.599039 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2"] Nov 04 04:47:25.247110 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.247077 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:25.247270 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.247200 5019 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 04 04:47:25.248317 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.248294 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74447c8475-62kjf" Nov 04 04:47:25.275257 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.275221 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqh8z" event={"ID":"f42385bf-b692-423c-95a5-c29d1a3532d7","Type":"ContainerStarted","Data":"fc02a47b012fe79171a9a51a49c43afce28936e86dc5155372839d2815701a72"} Nov 04 04:47:25.275383 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.275304 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqh8z" event={"ID":"f42385bf-b692-423c-95a5-c29d1a3532d7","Type":"ContainerStarted","Data":"6503d295b35d406de21c8002cd2060ff1a2bcb83e74b6968c3a543cf79e0086b"} Nov 04 04:47:25.276440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.276415 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" event={"ID":"12dada1b-2c87-4515-ab1f-2022d70d5c1a","Type":"ContainerStarted","Data":"f2f6fe53c096d9b9ddc4812ea6f5f3b1951d6ff71e7094266e0bd16aba5c8f1b"} Nov 04 04:47:25.277495 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:25.277476 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" event={"ID":"0d2b9220-c17e-4f7a-8263-a00a86a03c81","Type":"ContainerStarted","Data":"879f1e09e810c827f1b1ba44ba749c9251a84250131425a610c92e256a20165a"} Nov 04 04:47:26.283496 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:26.283458 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pnlsz" event={"ID":"12dada1b-2c87-4515-ab1f-2022d70d5c1a","Type":"ContainerStarted","Data":"4df5d35e1aba3b85eb05db990c5df5d2e77dc09617e308bf426faf630f943bcc"} Nov 04 04:47:26.285489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:26.285453 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqh8z" event={"ID":"f42385bf-b692-423c-95a5-c29d1a3532d7","Type":"ContainerStarted","Data":"e92db0e9e78d0273d1c5b35f6e922e32551c1897f240d4f4615481851a315296"} Nov 04 04:47:27.293263 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:27.293212 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" event={"ID":"0d2b9220-c17e-4f7a-8263-a00a86a03c81","Type":"ContainerStarted","Data":"303949353e012d976082478ced3e10f41924d54fbd8a0c6b633534a0255c6d46"} Nov 04 04:47:27.293729 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:27.293281 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-jkpn2" event={"ID":"0d2b9220-c17e-4f7a-8263-a00a86a03c81","Type":"ContainerStarted","Data":"010cda22dda55dbf0169595a5bcc108ffed895d7acc07db68ee0952e90a398b0"} Nov 04 04:47:28.299670 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:28.299591 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqh8z" event={"ID":"f42385bf-b692-423c-95a5-c29d1a3532d7","Type":"ContainerStarted","Data":"45fc2eb7b493373c8939918261af5d73c12d423253dd9185bd70886765012b15"} Nov 04 04:47:30.353896 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:30.353857 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74898b77c8-h48lw"] Nov 04 04:47:32.958095 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:32.958055 5019 patch_prober.go:29] interesting pod/image-registry-cbb59b655-6pcvb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 04:47:32.958502 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:32.958113 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 04:47:36.542038 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:36.542006 5019 patch_prober.go:29] interesting pod/image-registry-cbb59b655-6pcvb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Nov 04 04:47:36.542497 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:36.542056 5019 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 04:47:40.360024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.359997 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:40.871304 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.871269 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hvpst"] Nov 04 04:47:40.895709 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.895675 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.973676 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.973641 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzfnb\" (UniqueName: \"kubernetes.io/projected/af134e2c-d766-4786-8c2d-c0b9d3e17039-kube-api-access-fzfnb\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.973676 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.973680 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-sys\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.973906 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.973699 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-tls\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.973906 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.973758 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af134e2c-d766-4786-8c2d-c0b9d3e17039-metrics-client-ca\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.973971 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.973926 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-accelerators-collector-config\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.974007 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.973989 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-textfile\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.974041 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.974025 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-root\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.974075 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.974041 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:40.974107 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:40.974092 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-wtmp\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.060552 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.060518 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 04 04:47:41.060552 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.060555 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 04 04:47:41.060843 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.060618 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dxmws\"" Nov 04 04:47:41.060843 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.060699 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 04 04:47:41.060843 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.060732 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 04 04:47:41.075148 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075119 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzfnb\" (UniqueName: \"kubernetes.io/projected/af134e2c-d766-4786-8c2d-c0b9d3e17039-kube-api-access-fzfnb\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075148 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075155 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-sys\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075171 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-tls\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075190 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af134e2c-d766-4786-8c2d-c0b9d3e17039-metrics-client-ca\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075225 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-accelerators-collector-config\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075258 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-textfile\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075283 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-root\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075299 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075255 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-sys\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075329 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-wtmp\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075376 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-root\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075885 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075502 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-wtmp\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075885 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075707 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-textfile\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075909 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-accelerators-collector-config\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.075988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.075935 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af134e2c-d766-4786-8c2d-c0b9d3e17039-metrics-client-ca\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.077824 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.077785 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-tls\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.077891 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.077846 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af134e2c-d766-4786-8c2d-c0b9d3e17039-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.131887 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.131816 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzfnb\" (UniqueName: \"kubernetes.io/projected/af134e2c-d766-4786-8c2d-c0b9d3e17039-kube-api-access-fzfnb\") pod \"node-exporter-hvpst\" (UID: \"af134e2c-d766-4786-8c2d-c0b9d3e17039\") " pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.245664 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.245625 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hvpst" Nov 04 04:47:41.258630 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:47:41.258602 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf134e2c_d766_4786_8c2d_c0b9d3e17039.slice/crio-9b7f850311a264f58aa205d113e73bf5ecf733b68a4c9029b951461980119ab0 WatchSource:0}: Error finding container 9b7f850311a264f58aa205d113e73bf5ecf733b68a4c9029b951461980119ab0: Status 404 returned error can't find the container with id 9b7f850311a264f58aa205d113e73bf5ecf733b68a4c9029b951461980119ab0 Nov 04 04:47:41.351443 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.351410 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvpst" event={"ID":"af134e2c-d766-4786-8c2d-c0b9d3e17039","Type":"ContainerStarted","Data":"9b7f850311a264f58aa205d113e73bf5ecf733b68a4c9029b951461980119ab0"} Nov 04 04:47:41.842866 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:41.842834 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nrkxh" Nov 04 04:47:42.962004 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:42.961927 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:47:43.362116 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:43.362085 5019 generic.go:356] "Generic (PLEG): container finished" podID="af134e2c-d766-4786-8c2d-c0b9d3e17039" containerID="90dc5203549d72181e8bdce5239d1f92eabdcd2136657a1e8b0fb2f12a5370bc" exitCode=0 Nov 04 04:47:43.362333 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:43.362167 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvpst" event={"ID":"af134e2c-d766-4786-8c2d-c0b9d3e17039","Type":"ContainerDied","Data":"90dc5203549d72181e8bdce5239d1f92eabdcd2136657a1e8b0fb2f12a5370bc"} Nov 04 04:47:44.369521 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:44.369487 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvpst" event={"ID":"af134e2c-d766-4786-8c2d-c0b9d3e17039","Type":"ContainerStarted","Data":"197f92cad676ac95dcefd50e1fb40e9c174ccc219445012f9c46817b89a37b79"} Nov 04 04:47:44.369924 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:44.369536 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hvpst" event={"ID":"af134e2c-d766-4786-8c2d-c0b9d3e17039","Type":"ContainerStarted","Data":"5a6f9c45e2038264ff84ce59a6c04c37aea85db109966fc28b54fbd0845973e2"} Nov 04 04:47:44.486482 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:44.486422 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hvpst" podStartSLOduration=3.052634155 podStartE2EDuration="4.486408307s" totalImagesPullingTime="1.356529972s" totalInitContainerRuntime="77.24418ms" isStatefulPod=true podCreationTimestamp="2026-11-04 04:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:47:44.485097642 +0000 UTC m=+37.527512271" watchObservedRunningTime="2026-11-04 04:47:44.486408307 +0000 UTC m=+37.528822933" Nov 04 04:47:51.488121 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:51.488042 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:47:52.502714 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:52.502682 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cbb59b655-6pcvb"] Nov 04 04:47:55.380566 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.380499 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" podUID="b8737327-9a63-4ff6-899b-905c18fa2dcd" containerName="registry" containerID="cri-o://084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb" gracePeriod=30 Nov 04 04:47:55.638635 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.638573 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:55.716060 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716027 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716070 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716093 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716114 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716132 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716165 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716211 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716266 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716246 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") pod \"b8737327-9a63-4ff6-899b-905c18fa2dcd\" (UID: \"b8737327-9a63-4ff6-899b-905c18fa2dcd\") " Nov 04 04:47:55.716729 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716691 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:47:55.716874 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.716763 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:47:55.719371 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.719341 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:47:55.719484 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.719452 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:47:55.719484 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.719461 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:47:55.719592 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.719498 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:47:55.719592 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.719557 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "kube-api-access-8trp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:47:55.723745 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.723716 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted" pod "b8737327-9a63-4ff6-899b-905c18fa2dcd" (UID: "b8737327-9a63-4ff6-899b-905c18fa2dcd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:47:55.817678 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817646 5019 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-bound-sa-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817678 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817673 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8trp6\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-kube-api-access-8trp6\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817678 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817685 5019 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-image-registry-private-configuration\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817919 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817694 5019 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8737327-9a63-4ff6-899b-905c18fa2dcd-ca-trust-extracted\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817919 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817703 5019 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8737327-9a63-4ff6-899b-905c18fa2dcd-installation-pull-secrets\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817919 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817712 5019 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-certificates\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817919 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817720 5019 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8737327-9a63-4ff6-899b-905c18fa2dcd-registry-tls\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:55.817919 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:55.817731 5019 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8737327-9a63-4ff6-899b-905c18fa2dcd-trusted-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:47:56.420311 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.420277 5019 generic.go:356] "Generic (PLEG): container finished" podID="b8737327-9a63-4ff6-899b-905c18fa2dcd" containerID="084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb" exitCode=0 Nov 04 04:47:56.420758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.420318 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" Nov 04 04:47:56.420758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.420390 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" event={"ID":"b8737327-9a63-4ff6-899b-905c18fa2dcd","Type":"ContainerDied","Data":"084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb"} Nov 04 04:47:56.420758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.420439 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74898b77c8-h48lw" event={"ID":"b8737327-9a63-4ff6-899b-905c18fa2dcd","Type":"ContainerDied","Data":"d218c831a984faa061bfea4a865b53b184198b76ca0fbf51dc8cced06d0fc6d0"} Nov 04 04:47:56.420758 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.420461 5019 scope.go:122] "RemoveContainer" containerID="084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb" Nov 04 04:47:56.429084 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.429069 5019 scope.go:122] "RemoveContainer" containerID="084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb" Nov 04 04:47:56.429351 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:47:56.429335 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb\": container with ID starting with 084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb not found: ID does not exist" containerID="084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb" Nov 04 04:47:56.429400 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.429358 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb"} err="failed to get container status \"084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb\": rpc error: code = NotFound desc = could not find container \"084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb\": container with ID starting with 084ce11614cbd39074d4461b77e2feadec7845521df5a415bd2e87ecc7b53ecb not found: ID does not exist" Nov 04 04:47:56.635003 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.634966 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74898b77c8-h48lw"] Nov 04 04:47:56.685134 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:56.685060 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74898b77c8-h48lw"] Nov 04 04:47:57.122859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:47:57.122821 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b8737327-9a63-4ff6-899b-905c18fa2dcd" path="/var/lib/kubelet/pods/b8737327-9a63-4ff6-899b-905c18fa2dcd/volumes" Nov 04 04:48:17.522542 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.522503 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" containerName="registry" containerID="cri-o://d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3" gracePeriod=30 Nov 04 04:48:17.788105 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.788074 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:48:17.901348 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901316 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901354 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901384 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901412 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901433 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901480 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901509 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.901585 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.901560 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") pod \"c1e06a2c-e799-452d-9154-1470a26915b8\" (UID: \"c1e06a2c-e799-452d-9154-1470a26915b8\") " Nov 04 04:48:17.902132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.902103 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:48:17.902373 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.902311 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:48:17.904195 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.904168 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:48:17.904358 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.904324 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:48:17.904508 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.904491 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:48:17.904569 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.904543 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "kube-api-access-skkbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:48:17.904979 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.904958 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:48:17.909091 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:17.909027 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted" pod "c1e06a2c-e799-452d-9154-1470a26915b8" (UID: "c1e06a2c-e799-452d-9154-1470a26915b8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:48:18.002450 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002411 5019 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-registry-tls\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002450 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002442 5019 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-bound-sa-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002450 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002453 5019 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-registry-certificates\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002681 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002465 5019 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1e06a2c-e799-452d-9154-1470a26915b8-trusted-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002681 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002476 5019 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c1e06a2c-e799-452d-9154-1470a26915b8-ca-trust-extracted\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002681 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002485 5019 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-installation-pull-secrets\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002681 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002493 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skkbl\" (UniqueName: \"kubernetes.io/projected/c1e06a2c-e799-452d-9154-1470a26915b8-kube-api-access-skkbl\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.002681 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.002503 5019 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c1e06a2c-e799-452d-9154-1470a26915b8-image-registry-private-configuration\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:18.508516 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.508483 5019 generic.go:356] "Generic (PLEG): container finished" podID="c1e06a2c-e799-452d-9154-1470a26915b8" containerID="d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3" exitCode=0 Nov 04 04:48:18.508686 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.508527 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" Nov 04 04:48:18.508686 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.508547 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" event={"ID":"c1e06a2c-e799-452d-9154-1470a26915b8","Type":"ContainerDied","Data":"d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3"} Nov 04 04:48:18.508686 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.508587 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cbb59b655-6pcvb" event={"ID":"c1e06a2c-e799-452d-9154-1470a26915b8","Type":"ContainerDied","Data":"32cae6184c7dc73696c23a1567190c4786708de1fd986369e44225af0fdb2137"} Nov 04 04:48:18.508686 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.508607 5019 scope.go:122] "RemoveContainer" containerID="d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3" Nov 04 04:48:18.517084 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.517067 5019 scope.go:122] "RemoveContainer" containerID="d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3" Nov 04 04:48:18.517389 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:48:18.517368 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3\": container with ID starting with d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3 not found: ID does not exist" containerID="d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3" Nov 04 04:48:18.517436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.517399 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3"} err="failed to get container status \"d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3\": rpc error: code = NotFound desc = could not find container \"d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3\": container with ID starting with d878635cb4fe89ffc6b278938f314c7585d5a49f371016f6e0c69303234db3e3 not found: ID does not exist" Nov 04 04:48:18.723598 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.723560 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cbb59b655-6pcvb"] Nov 04 04:48:18.775043 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:18.774962 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cbb59b655-6pcvb"] Nov 04 04:48:19.122950 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:19.122877 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" path="/var/lib/kubelet/pods/c1e06a2c-e799-452d-9154-1470a26915b8/volumes" Nov 04 04:48:21.488340 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:48:21.488307 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:48:33.568932 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:33.568891 5019 generic.go:356] "Generic (PLEG): container finished" podID="07ef7ea9-2699-46f3-8448-53a7b72b2e0b" containerID="0dfc01708746232b8119c1575895fcb905e7dfa9d3165896dd968eb2f8c34268" exitCode=0 Nov 04 04:48:33.569396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:33.568968 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" event={"ID":"07ef7ea9-2699-46f3-8448-53a7b72b2e0b","Type":"ContainerDied","Data":"0dfc01708746232b8119c1575895fcb905e7dfa9d3165896dd968eb2f8c34268"} Nov 04 04:48:33.569819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:33.569604 5019 scope.go:122] "RemoveContainer" containerID="0dfc01708746232b8119c1575895fcb905e7dfa9d3165896dd968eb2f8c34268" Nov 04 04:48:34.575162 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:34.575127 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-424gx" event={"ID":"07ef7ea9-2699-46f3-8448-53a7b72b2e0b","Type":"ContainerStarted","Data":"b5d62ed49210bc56f26c83d31c389383f1f7ca628336b661656c38bd15f9cc99"} Nov 04 04:48:36.585047 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:36.585014 5019 generic.go:356] "Generic (PLEG): container finished" podID="1c148a52-c563-4f42-9d49-0606acf343e6" containerID="7bf5dd471060b69ec5b10036bc915b17970682cca2a9efa1d8aee1f35a6938c0" exitCode=0 Nov 04 04:48:36.585437 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:36.585060 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-25b7z" event={"ID":"1c148a52-c563-4f42-9d49-0606acf343e6","Type":"ContainerDied","Data":"7bf5dd471060b69ec5b10036bc915b17970682cca2a9efa1d8aee1f35a6938c0"} Nov 04 04:48:36.585437 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:36.585380 5019 scope.go:122] "RemoveContainer" containerID="7bf5dd471060b69ec5b10036bc915b17970682cca2a9efa1d8aee1f35a6938c0" Nov 04 04:48:37.524197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.524161 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-hs56x-94wmn"] Nov 04 04:48:37.524393 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.524365 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-hs56x-94wmn" podUID="b1fc023b-934d-4884-b04f-78472b636238" containerName="insights-gathering" containerID="cri-o://eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98" gracePeriod=30 Nov 04 04:48:37.590389 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.590355 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-25b7z" event={"ID":"1c148a52-c563-4f42-9d49-0606acf343e6","Type":"ContainerStarted","Data":"66eec25fe001f7604807302e3b78c8ba97ef4574bf3843416ca31a0be7f5c9c3"} Nov 04 04:48:37.795557 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.795515 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:48:37.867256 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867224 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") pod \"b1fc023b-934d-4884-b04f-78472b636238\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " Nov 04 04:48:37.867449 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867279 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") pod \"b1fc023b-934d-4884-b04f-78472b636238\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " Nov 04 04:48:37.867449 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867311 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") pod \"b1fc023b-934d-4884-b04f-78472b636238\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " Nov 04 04:48:37.867449 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867343 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") pod \"b1fc023b-934d-4884-b04f-78472b636238\" (UID: \"b1fc023b-934d-4884-b04f-78472b636238\") " Nov 04 04:48:37.867659 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867631 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path" pod "b1fc023b-934d-4884-b04f-78472b636238" (UID: "b1fc023b-934d-4884-b04f-78472b636238"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:48:37.867724 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867678 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle" pod "b1fc023b-934d-4884-b04f-78472b636238" (UID: "b1fc023b-934d-4884-b04f-78472b636238"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:48:37.867724 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.867700 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle" pod "b1fc023b-934d-4884-b04f-78472b636238" (UID: "b1fc023b-934d-4884-b04f-78472b636238"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:48:37.869724 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.869702 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6" pod "b1fc023b-934d-4884-b04f-78472b636238" (UID: "b1fc023b-934d-4884-b04f-78472b636238"). InnerVolumeSpecName "kube-api-access-68pv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:48:37.946189 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946160 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-kk4nc-f6vvb"] Nov 04 04:48:37.946489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946476 5019 cpu_manager.go:414] "containerMap: removing container" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" containerName="registry" Nov 04 04:48:37.946541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946492 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" containerName="registry" Nov 04 04:48:37.946541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946509 5019 cpu_manager.go:414] "containerMap: removing container" podUID="b8737327-9a63-4ff6-899b-905c18fa2dcd" containerName="registry" Nov 04 04:48:37.946541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946514 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8737327-9a63-4ff6-899b-905c18fa2dcd" containerName="registry" Nov 04 04:48:37.946541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946522 5019 cpu_manager.go:414] "containerMap: removing container" podUID="b1fc023b-934d-4884-b04f-78472b636238" containerName="insights-gathering" Nov 04 04:48:37.946541 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946527 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1fc023b-934d-4884-b04f-78472b636238" containerName="insights-gathering" Nov 04 04:48:37.946679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946586 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1e06a2c-e799-452d-9154-1470a26915b8" containerName="registry" Nov 04 04:48:37.946679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946595 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8737327-9a63-4ff6-899b-905c18fa2dcd" containerName="registry" Nov 04 04:48:37.946679 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.946600 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1fc023b-934d-4884-b04f-78472b636238" containerName="insights-gathering" Nov 04 04:48:37.949462 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.949447 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:37.968176 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968146 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:37.968176 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968179 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:37.968333 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968195 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txppr\" (UniqueName: \"kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:37.968364 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968338 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:37.968398 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968386 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68pv6\" (UniqueName: \"kubernetes.io/projected/b1fc023b-934d-4884-b04f-78472b636238-kube-api-access-68pv6\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:37.968433 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968403 5019 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-service-ca-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:37.968433 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968418 5019 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1fc023b-934d-4884-b04f-78472b636238-trusted-ca-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:37.968433 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:37.968428 5019 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/b1fc023b-934d-4884-b04f-78472b636238-archives-path\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:48:38.005731 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.005700 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-kk4nc-f6vvb"] Nov 04 04:48:38.068931 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.068846 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.068931 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.068890 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.068931 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.068910 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.068931 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.068926 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txppr\" (UniqueName: \"kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.069396 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.069371 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.069597 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.069579 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.069913 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.069893 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.126924 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.126895 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txppr\" (UniqueName: \"kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr\") pod \"periodic-gathering-kk4nc-f6vvb\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.261109 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.261081 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:48:38.595946 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.595914 5019 generic.go:356] "Generic (PLEG): container finished" podID="b1fc023b-934d-4884-b04f-78472b636238" containerID="eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98" exitCode=2 Nov 04 04:48:38.596326 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.595963 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-hs56x-94wmn" event={"ID":"b1fc023b-934d-4884-b04f-78472b636238","Type":"ContainerDied","Data":"eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98"} Nov 04 04:48:38.596326 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.596003 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-hs56x-94wmn" event={"ID":"b1fc023b-934d-4884-b04f-78472b636238","Type":"ContainerDied","Data":"f6341e72ede12ac2764c44480d5b2e2089327a19dba430c58a9c09f7c10946a0"} Nov 04 04:48:38.596326 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.596022 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-hs56x-94wmn" Nov 04 04:48:38.596326 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.596025 5019 scope.go:122] "RemoveContainer" containerID="eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98" Nov 04 04:48:38.604626 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.604606 5019 scope.go:122] "RemoveContainer" containerID="eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98" Nov 04 04:48:38.604932 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:48:38.604914 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98\": container with ID starting with eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98 not found: ID does not exist" containerID="eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98" Nov 04 04:48:38.605009 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.604941 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98"} err="failed to get container status \"eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98\": rpc error: code = NotFound desc = could not find container \"eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98\": container with ID starting with eb5e86634da395c481fa4b7e7e161838f5782ddce74bb578a0c11b35ac67ec98 not found: ID does not exist" Nov 04 04:48:38.628049 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.628029 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-kk4nc-f6vvb"] Nov 04 04:48:38.630412 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:48:38.630371 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639e1f27_e699_4812_bb57_b33e9016ab21.slice/crio-277c80d7b3667a34618fccbc77450cd2c9781ece39c96fbe45f9bcd031f9a0f5 WatchSource:0}: Error finding container 277c80d7b3667a34618fccbc77450cd2c9781ece39c96fbe45f9bcd031f9a0f5: Status 404 returned error can't find the container with id 277c80d7b3667a34618fccbc77450cd2c9781ece39c96fbe45f9bcd031f9a0f5 Nov 04 04:48:38.760911 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.760877 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-hs56x-94wmn"] Nov 04 04:48:38.771777 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:38.771747 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-hs56x-94wmn"] Nov 04 04:48:39.122218 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:39.122185 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1fc023b-934d-4884-b04f-78472b636238" path="/var/lib/kubelet/pods/b1fc023b-934d-4884-b04f-78472b636238/volumes" Nov 04 04:48:39.602191 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:39.602151 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" event={"ID":"639e1f27-e699-4812-bb57-b33e9016ab21","Type":"ContainerStarted","Data":"c5919783be49aad0084da05142dd5b0a5b00698bca1de53c5f40b953c0a5e6b7"} Nov 04 04:48:39.602613 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:39.602226 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" event={"ID":"639e1f27-e699-4812-bb57-b33e9016ab21","Type":"ContainerStarted","Data":"277c80d7b3667a34618fccbc77450cd2c9781ece39c96fbe45f9bcd031f9a0f5"} Nov 04 04:48:39.717974 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:48:39.717918 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" podStartSLOduration=2.717902891 podStartE2EDuration="2.717902891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:48:39.716897282 +0000 UTC m=+92.759311912" watchObservedRunningTime="2026-11-04 04:48:39.717902891 +0000 UTC m=+92.760317561" Nov 04 04:48:51.487739 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:48:51.487695 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:49:21.487382 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:49:21.487301 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:49:51.486500 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:49:51.486456 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:50:04.944604 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:04.944571 5019 generic.go:356] "Generic (PLEG): container finished" podID="639e1f27-e699-4812-bb57-b33e9016ab21" containerID="c5919783be49aad0084da05142dd5b0a5b00698bca1de53c5f40b953c0a5e6b7" exitCode=0 Nov 04 04:50:04.944996 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:04.944653 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" event={"ID":"639e1f27-e699-4812-bb57-b33e9016ab21","Type":"ContainerDied","Data":"c5919783be49aad0084da05142dd5b0a5b00698bca1de53c5f40b953c0a5e6b7"} Nov 04 04:50:06.080721 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.080693 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:50:06.136045 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.136017 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle\") pod \"639e1f27-e699-4812-bb57-b33e9016ab21\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " Nov 04 04:50:06.136177 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.136060 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle\") pod \"639e1f27-e699-4812-bb57-b33e9016ab21\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " Nov 04 04:50:06.136395 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.136374 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle" pod "639e1f27-e699-4812-bb57-b33e9016ab21" (UID: "639e1f27-e699-4812-bb57-b33e9016ab21"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:50:06.136430 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.136389 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle" pod "639e1f27-e699-4812-bb57-b33e9016ab21" (UID: "639e1f27-e699-4812-bb57-b33e9016ab21"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:50:06.237203 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.237126 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path\") pod \"639e1f27-e699-4812-bb57-b33e9016ab21\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " Nov 04 04:50:06.237203 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.237163 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr\" (UniqueName: \"kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr\") pod \"639e1f27-e699-4812-bb57-b33e9016ab21\" (UID: \"639e1f27-e699-4812-bb57-b33e9016ab21\") " Nov 04 04:50:06.237409 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.237392 5019 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-trusted-ca-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:50:06.237444 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.237417 5019 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/639e1f27-e699-4812-bb57-b33e9016ab21-service-ca-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:50:06.237475 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.237459 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path" pod "639e1f27-e699-4812-bb57-b33e9016ab21" (UID: "639e1f27-e699-4812-bb57-b33e9016ab21"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:50:06.239341 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.239317 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr" pod "639e1f27-e699-4812-bb57-b33e9016ab21" (UID: "639e1f27-e699-4812-bb57-b33e9016ab21"). InnerVolumeSpecName "kube-api-access-txppr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:50:06.338183 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.338148 5019 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/639e1f27-e699-4812-bb57-b33e9016ab21-archives-path\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:50:06.338183 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.338181 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txppr\" (UniqueName: \"kubernetes.io/projected/639e1f27-e699-4812-bb57-b33e9016ab21-kube-api-access-txppr\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:50:06.952884 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.952857 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" Nov 04 04:50:06.953052 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.952894 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-kk4nc-f6vvb" event={"ID":"639e1f27-e699-4812-bb57-b33e9016ab21","Type":"ContainerDied","Data":"277c80d7b3667a34618fccbc77450cd2c9781ece39c96fbe45f9bcd031f9a0f5"} Nov 04 04:50:06.953052 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:06.952931 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="277c80d7b3667a34618fccbc77450cd2c9781ece39c96fbe45f9bcd031f9a0f5" Nov 04 04:50:21.487383 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:50:21.487349 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:50:51.487657 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:50:51.487577 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:50:53.522811 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.522760 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc"] Nov 04 04:50:53.523177 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.523101 5019 cpu_manager.go:414] "containerMap: removing container" podUID="639e1f27-e699-4812-bb57-b33e9016ab21" containerName="insights-gathering" Nov 04 04:50:53.523177 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.523113 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="639e1f27-e699-4812-bb57-b33e9016ab21" containerName="insights-gathering" Nov 04 04:50:53.523243 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.523181 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="639e1f27-e699-4812-bb57-b33e9016ab21" containerName="insights-gathering" Nov 04 04:50:53.526185 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.526170 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.582185 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.582140 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.582502 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.582373 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2qkm\" (UniqueName: \"kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.582502 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.582445 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.629126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.629099 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 04 04:50:53.629126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.629100 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 04 04:50:53.629268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.629144 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-c5wvt\"" Nov 04 04:50:53.630208 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.630185 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc"] Nov 04 04:50:53.630980 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.630964 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr"] Nov 04 04:50:53.634243 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.634230 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.682912 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.682882 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.683085 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.682933 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2qkm\" (UniqueName: \"kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.683085 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.682996 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.683085 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.683035 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.683253 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.683104 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c672v\" (UniqueName: \"kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.683253 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.683154 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.684348 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.684325 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.684500 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.684372 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.686874 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.686854 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-cfxkm\"" Nov 04 04:50:53.691617 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.691595 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr"] Nov 04 04:50:53.733306 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.733285 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt"] Nov 04 04:50:53.736505 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.736492 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.744954 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.744934 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2qkm\" (UniqueName: \"kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.784497 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784450 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nz44\" (UniqueName: \"kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.784497 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784493 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.784622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784517 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c672v\" (UniqueName: \"kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.784622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784574 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.784705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784623 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.784705 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784644 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.784986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784970 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.785020 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.784985 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.789202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.789186 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-p98qn\"" Nov 04 04:50:53.796445 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.796422 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt"] Nov 04 04:50:53.824939 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.824914 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5"] Nov 04 04:50:53.828209 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.828192 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.840506 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.840489 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:50:53.841689 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.841670 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c672v\" (UniqueName: \"kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.885748 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5"] Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.885949 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzn6\" (UniqueName: \"kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.885996 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nz44\" (UniqueName: \"kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.886076 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.886099 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.886153 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.886177 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.887039 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.887831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.887328 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.890607 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.890351 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-d2tch\"" Nov 04 04:50:53.943617 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.943586 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nz44\" (UniqueName: \"kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:53.949412 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.949393 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:50:53.986900 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.986861 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.987037 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.986937 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.987037 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.986970 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzn6\" (UniqueName: \"kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.987411 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.987388 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:53.987522 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:53.987474 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:54.044352 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.044295 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzn6\" (UniqueName: \"kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:54.051146 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.051128 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:50:54.143911 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.143881 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:50:54.211365 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.211338 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc"] Nov 04 04:50:54.212046 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:50:54.212017 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9936949a_6e51_4dc2_b98b_a3b547021a0d.slice/crio-1a24e6c0af7239d1e67323563b42fb7914d2f5322f5c9068d3f37f810a70f3f9 WatchSource:0}: Error finding container 1a24e6c0af7239d1e67323563b42fb7914d2f5322f5c9068d3f37f810a70f3f9: Status 404 returned error can't find the container with id 1a24e6c0af7239d1e67323563b42fb7914d2f5322f5c9068d3f37f810a70f3f9 Nov 04 04:50:54.316159 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.316141 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr"] Nov 04 04:50:54.318380 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:50:54.318347 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d07b989_00c2_4763_9b5f_fb0a505c0c1a.slice/crio-17149c0ba2a5d011ffffb87ba9b1cbd7006e5cf17a885b35630254e9acb70edc WatchSource:0}: Error finding container 17149c0ba2a5d011ffffb87ba9b1cbd7006e5cf17a885b35630254e9acb70edc: Status 404 returned error can't find the container with id 17149c0ba2a5d011ffffb87ba9b1cbd7006e5cf17a885b35630254e9acb70edc Nov 04 04:50:54.421018 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.420983 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt"] Nov 04 04:50:54.422876 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:50:54.422841 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea908ee_3b4c_41d0_8e1f_8271be266444.slice/crio-73541af3f565e10a51923793ad6f1141f640eb791804e9dfb42245604edbf3ce WatchSource:0}: Error finding container 73541af3f565e10a51923793ad6f1141f640eb791804e9dfb42245604edbf3ce: Status 404 returned error can't find the container with id 73541af3f565e10a51923793ad6f1141f640eb791804e9dfb42245604edbf3ce Nov 04 04:50:54.509303 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.509282 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5"] Nov 04 04:50:54.511606 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:50:54.511586 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4b053a_10fd_491f_b41a_72d5c1286f39.slice/crio-61e85813a01bd06ab982b3898347e0dff4ee4d95ebe7518ff8aec50374fce0b6 WatchSource:0}: Error finding container 61e85813a01bd06ab982b3898347e0dff4ee4d95ebe7518ff8aec50374fce0b6: Status 404 returned error can't find the container with id 61e85813a01bd06ab982b3898347e0dff4ee4d95ebe7518ff8aec50374fce0b6 Nov 04 04:50:54.948257 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.948223 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8"] Nov 04 04:50:54.952703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:54.952685 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.009724 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.009701 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-9mxqn\"" Nov 04 04:50:55.010754 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.010730 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8"] Nov 04 04:50:55.095321 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.095288 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqhc\" (UniqueName: \"kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.095487 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.095354 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.095487 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.095442 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.134703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.134673 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" event={"ID":"6d07b989-00c2-4763-9b5f-fb0a505c0c1a","Type":"ContainerStarted","Data":"17149c0ba2a5d011ffffb87ba9b1cbd7006e5cf17a885b35630254e9acb70edc"} Nov 04 04:50:55.135845 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.135821 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerStarted","Data":"73541af3f565e10a51923793ad6f1141f640eb791804e9dfb42245604edbf3ce"} Nov 04 04:50:55.136845 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.136825 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" event={"ID":"9936949a-6e51-4dc2-b98b-a3b547021a0d","Type":"ContainerStarted","Data":"1a24e6c0af7239d1e67323563b42fb7914d2f5322f5c9068d3f37f810a70f3f9"} Nov 04 04:50:55.137808 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.137781 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" event={"ID":"ea4b053a-10fd-491f-b41a-72d5c1286f39","Type":"ContainerStarted","Data":"61e85813a01bd06ab982b3898347e0dff4ee4d95ebe7518ff8aec50374fce0b6"} Nov 04 04:50:55.196410 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.196386 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqhc\" (UniqueName: \"kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.196514 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.196457 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.196514 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.196486 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.196903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.196873 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.196903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.196886 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.255116 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.255085 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqhc\" (UniqueName: \"kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.267939 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.267914 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:50:55.647662 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:55.647519 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8"] Nov 04 04:50:55.650005 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:50:55.649972 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd458804_b0f1_4a13_860a_99742bf5e21c.slice/crio-3b587de63634252377fa455e46c44aae65a651a8bb7f5f18c70982ea58a33418 WatchSource:0}: Error finding container 3b587de63634252377fa455e46c44aae65a651a8bb7f5f18c70982ea58a33418: Status 404 returned error can't find the container with id 3b587de63634252377fa455e46c44aae65a651a8bb7f5f18c70982ea58a33418 Nov 04 04:50:56.038827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.038324 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx"] Nov 04 04:50:56.042663 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.042638 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.096192 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.096165 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-xmggd\"" Nov 04 04:50:56.105150 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.105083 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.105280 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.105170 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8h2k\" (UniqueName: \"kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.105280 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.105242 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.147333 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.147305 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx"] Nov 04 04:50:56.149066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.149033 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerStarted","Data":"3b587de63634252377fa455e46c44aae65a651a8bb7f5f18c70982ea58a33418"} Nov 04 04:50:56.205783 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.205753 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.205958 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.205824 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8h2k\" (UniqueName: \"kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.205958 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.205853 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.206429 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.206251 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.206429 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.206335 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.267808 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.267705 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8h2k\" (UniqueName: \"kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.364635 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.364341 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:50:56.776910 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:56.776820 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx"] Nov 04 04:50:56.784026 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:50:56.783994 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13c12f8_4176_4bfa_abc0_38990bc22bdd.slice/crio-4c95dce9f58eaec1c6746d7e9323ce60eb6487e3a99ed95bac51d8319d1f8467 WatchSource:0}: Error finding container 4c95dce9f58eaec1c6746d7e9323ce60eb6487e3a99ed95bac51d8319d1f8467: Status 404 returned error can't find the container with id 4c95dce9f58eaec1c6746d7e9323ce60eb6487e3a99ed95bac51d8319d1f8467 Nov 04 04:50:57.158159 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:50:57.158080 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerStarted","Data":"4c95dce9f58eaec1c6746d7e9323ce60eb6487e3a99ed95bac51d8319d1f8467"} Nov 04 04:51:00.010660 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.010624 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs"] Nov 04 04:51:00.016429 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.016404 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.070698 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.070573 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-p9hzm\"" Nov 04 04:51:00.070698 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.070660 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 04 04:51:00.123011 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.122979 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs"] Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.143965 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144022 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144058 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144103 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144139 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144164 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27zcw\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144193 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144241 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.144460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.144269 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259255 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259214 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259273 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259299 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27zcw\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259324 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259359 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259389 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259440 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259429 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259727 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259469 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.259727 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.259506 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.260603 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.260572 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.260920 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.260869 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.261382 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.261359 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.269900 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.269090 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.269900 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.269555 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.274968 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.274923 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.275570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.275547 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.307243 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.305497 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8"] Nov 04 04:51:00.311048 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.310497 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.320519 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.320374 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27zcw\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.325331 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.325288 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-tl7xs\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.342136 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.342119 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:00.363815 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.363132 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-9bzg7\"" Nov 04 04:51:00.371158 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.371087 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8"] Nov 04 04:51:00.461449 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461416 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461578 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461475 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461578 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461528 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461578 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461563 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461745 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461588 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461745 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461619 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461745 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461658 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461745 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461702 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwwsr\" (UniqueName: \"kubernetes.io/projected/6159a6e2-03d3-4e4c-89e3-cd90a6538852-kube-api-access-mwwsr\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.461745 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.461731 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562575 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwwsr\" (UniqueName: \"kubernetes.io/projected/6159a6e2-03d3-4e4c-89e3-cd90a6538852-kube-api-access-mwwsr\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562626 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562670 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562711 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562770 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562822 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562849 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562880 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.564268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.562919 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.566044 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.565305 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.566044 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.565619 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.566044 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.565849 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.566044 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.565952 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.566328 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.566091 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.567958 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.567918 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.575327 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.575210 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.621656 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.621628 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6159a6e2-03d3-4e4c-89e3-cd90a6538852-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.628624 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.628508 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwwsr\" (UniqueName: \"kubernetes.io/projected/6159a6e2-03d3-4e4c-89e3-cd90a6538852-kube-api-access-mwwsr\") pod \"openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8\" (UID: \"6159a6e2-03d3-4e4c-89e3-cd90a6538852\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.655550 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.655226 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:00.812845 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.812720 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs"] Nov 04 04:51:00.819877 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:00.819837 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06e6d66_7580_4d6e_967f_47ee102ba0ad.slice/crio-0bbcef64b9bb7c87988d666a450d90dc7ecbfdaeb8c37ea2e845055b739ec3c9 WatchSource:0}: Error finding container 0bbcef64b9bb7c87988d666a450d90dc7ecbfdaeb8c37ea2e845055b739ec3c9: Status 404 returned error can't find the container with id 0bbcef64b9bb7c87988d666a450d90dc7ecbfdaeb8c37ea2e845055b739ec3c9 Nov 04 04:51:00.901454 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.901104 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl"] Nov 04 04:51:00.909403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.908901 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:00.960876 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:00.960809 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl"] Nov 04 04:51:01.069868 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.069525 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkvm\" (UniqueName: \"kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.069868 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.069580 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.069868 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.069654 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.076444 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.076346 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8"] Nov 04 04:51:01.085142 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:01.085111 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6159a6e2_03d3_4e4c_89e3_cd90a6538852.slice/crio-e8e3d9ae3507c2cb24d6f3f48bc1b223d88328daefd8ceb01702849457ca2b22 WatchSource:0}: Error finding container e8e3d9ae3507c2cb24d6f3f48bc1b223d88328daefd8ceb01702849457ca2b22: Status 404 returned error can't find the container with id e8e3d9ae3507c2cb24d6f3f48bc1b223d88328daefd8ceb01702849457ca2b22 Nov 04 04:51:01.170921 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.170884 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkvm\" (UniqueName: \"kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.171097 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.170936 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.171097 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.171012 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.171506 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.171481 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.172101 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.172077 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.192354 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.192297 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" event={"ID":"6159a6e2-03d3-4e4c-89e3-cd90a6538852","Type":"ContainerStarted","Data":"e8e3d9ae3507c2cb24d6f3f48bc1b223d88328daefd8ceb01702849457ca2b22"} Nov 04 04:51:01.195594 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.195568 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" event={"ID":"c06e6d66-7580-4d6e-967f-47ee102ba0ad","Type":"ContainerStarted","Data":"0bbcef64b9bb7c87988d666a450d90dc7ecbfdaeb8c37ea2e845055b739ec3c9"} Nov 04 04:51:01.233172 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.233140 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkvm\" (UniqueName: \"kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.532240 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.532003 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:01.957437 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:01.957384 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl"] Nov 04 04:51:01.960463 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:01.960431 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8600de25_27d3_4071_b4b5_8b9542db7b70.slice/crio-22ec366ff5d410fd3eaf32dc2e6b6919cbff696e561ce16abf59aee620d0cb4b WatchSource:0}: Error finding container 22ec366ff5d410fd3eaf32dc2e6b6919cbff696e561ce16abf59aee620d0cb4b: Status 404 returned error can't find the container with id 22ec366ff5d410fd3eaf32dc2e6b6919cbff696e561ce16abf59aee620d0cb4b Nov 04 04:51:02.220894 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:02.220811 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" event={"ID":"8600de25-27d3-4071-b4b5-8b9542db7b70","Type":"ContainerStarted","Data":"22ec366ff5d410fd3eaf32dc2e6b6919cbff696e561ce16abf59aee620d0cb4b"} Nov 04 04:51:08.285067 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:08.284147 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" event={"ID":"9936949a-6e51-4dc2-b98b-a3b547021a0d","Type":"ContainerStarted","Data":"b631ba7e4de3b2643724ae382d8e8b63e724eb18d961adbaceb2a6e9bd6c1c5b"} Nov 04 04:51:08.289028 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:08.288470 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerStarted","Data":"df236bc859a830893814ca2fd459f3e93a8e8288213e566168473ade600ccba2"} Nov 04 04:51:09.300234 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.299209 5019 generic.go:356] "Generic (PLEG): container finished" podID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerID="83f729fb621fe9178754a394cf680a210093ecbe695fcde524077fac981c7efc" exitCode=0 Nov 04 04:51:09.300234 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.299321 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" event={"ID":"ea4b053a-10fd-491f-b41a-72d5c1286f39","Type":"ContainerDied","Data":"83f729fb621fe9178754a394cf680a210093ecbe695fcde524077fac981c7efc"} Nov 04 04:51:09.305944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.305835 5019 generic.go:356] "Generic (PLEG): container finished" podID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerID="76783155f445d897be47175429795f95240739d1fa86361fe6b986f481d836e9" exitCode=0 Nov 04 04:51:09.305944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.305922 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" event={"ID":"6d07b989-00c2-4763-9b5f-fb0a505c0c1a","Type":"ContainerDied","Data":"76783155f445d897be47175429795f95240739d1fa86361fe6b986f481d836e9"} Nov 04 04:51:09.310358 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.310329 5019 generic.go:356] "Generic (PLEG): container finished" podID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerID="df236bc859a830893814ca2fd459f3e93a8e8288213e566168473ade600ccba2" exitCode=0 Nov 04 04:51:09.311198 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.310461 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerDied","Data":"df236bc859a830893814ca2fd459f3e93a8e8288213e566168473ade600ccba2"} Nov 04 04:51:09.316220 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.315451 5019 generic.go:356] "Generic (PLEG): container finished" podID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerID="b631ba7e4de3b2643724ae382d8e8b63e724eb18d961adbaceb2a6e9bd6c1c5b" exitCode=0 Nov 04 04:51:09.316220 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:09.315516 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" event={"ID":"9936949a-6e51-4dc2-b98b-a3b547021a0d","Type":"ContainerDied","Data":"b631ba7e4de3b2643724ae382d8e8b63e724eb18d961adbaceb2a6e9bd6c1c5b"} Nov 04 04:51:10.322032 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:10.321995 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:51:10.322403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:10.322083 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:51:10.322403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:10.322123 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:51:10.333362 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:10.333328 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:51:10.333450 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:10.333400 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:51:10.333450 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:10.333445 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:51:11.327340 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.327315 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerStarted","Data":"139d9045f044f174a393e2c5a7e678dc7a5575237165e18879e30ab4b8011bd1"} Nov 04 04:51:11.329031 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.329004 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" event={"ID":"6159a6e2-03d3-4e4c-89e3-cd90a6538852","Type":"ContainerStarted","Data":"0b07ed3defaa16003ecf319bc430a14f4d23c9c669795885a4374b33d70c2016"} Nov 04 04:51:11.330746 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.330718 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" event={"ID":"c06e6d66-7580-4d6e-967f-47ee102ba0ad","Type":"ContainerStarted","Data":"c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7"} Nov 04 04:51:11.332403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.332377 5019 generic.go:356] "Generic (PLEG): container finished" podID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerID="ccd9393f606c39a38e10cd6770bbf16f818fe9067b4c26d8afacb6fd72dd327c" exitCode=0 Nov 04 04:51:11.332521 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.332466 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerDied","Data":"ccd9393f606c39a38e10cd6770bbf16f818fe9067b4c26d8afacb6fd72dd327c"} Nov 04 04:51:11.334106 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.334075 5019 generic.go:356] "Generic (PLEG): container finished" podID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerID="128441ea92682c50b7d2263bd735df0cb43bd97d228fbd8a161695723e60db77" exitCode=0 Nov 04 04:51:11.334254 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.334147 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" event={"ID":"8600de25-27d3-4071-b4b5-8b9542db7b70","Type":"ContainerDied","Data":"128441ea92682c50b7d2263bd735df0cb43bd97d228fbd8a161695723e60db77"} Nov 04 04:51:11.336036 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.335950 5019 generic.go:356] "Generic (PLEG): container finished" podID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerID="83a95dfc15a03633a99d5f8f4469a0d056acfe082a6dc086eb1cf31fe32666d2" exitCode=0 Nov 04 04:51:11.336036 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.335994 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerDied","Data":"83a95dfc15a03633a99d5f8f4469a0d056acfe082a6dc086eb1cf31fe32666d2"} Nov 04 04:51:11.353822 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.343834 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:11.353822 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.350420 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:11.483037 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.482947 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" podStartSLOduration=2.242957281 podStartE2EDuration="11.482933088s" totalImagesPullingTime="9.239975807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:11.482413017 +0000 UTC m=+244.524827654" watchObservedRunningTime="2026-11-04 04:51:11.482933088 +0000 UTC m=+244.525347712" Nov 04 04:51:11.656241 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.656216 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:11.660632 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.660614 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:11.830353 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:11.830310 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podStartSLOduration=3.331763901 podStartE2EDuration="12.830297546s" totalImagesPullingTime="9.498533645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:11.829092181 +0000 UTC m=+244.871506800" watchObservedRunningTime="2026-11-04 04:51:11.830297546 +0000 UTC m=+244.872712165" Nov 04 04:51:12.342551 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.342516 5019 generic.go:356] "Generic (PLEG): container finished" podID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerID="1de691b395a75e5e7a95b710f50ba0f37727d1f8baa9f40e7b4387aa4e0d62a1" exitCode=0 Nov 04 04:51:12.342910 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.342608 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" event={"ID":"ea4b053a-10fd-491f-b41a-72d5c1286f39","Type":"ContainerDied","Data":"1de691b395a75e5e7a95b710f50ba0f37727d1f8baa9f40e7b4387aa4e0d62a1"} Nov 04 04:51:12.345991 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.345966 5019 generic.go:356] "Generic (PLEG): container finished" podID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerID="a6bce852777dc1cbd00599a48e04039b86444e672ca98eeec9d7302ada3f90f9" exitCode=0 Nov 04 04:51:12.346102 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.346044 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" event={"ID":"6d07b989-00c2-4763-9b5f-fb0a505c0c1a","Type":"ContainerDied","Data":"a6bce852777dc1cbd00599a48e04039b86444e672ca98eeec9d7302ada3f90f9"} Nov 04 04:51:12.349132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.349087 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerStarted","Data":"46f6baccfb6118c5ca05bec04fab1ee6f5dab2e95efb3e786c9c8293952a5bc6"} Nov 04 04:51:12.351149 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.351099 5019 generic.go:356] "Generic (PLEG): container finished" podID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerID="139d9045f044f174a393e2c5a7e678dc7a5575237165e18879e30ab4b8011bd1" exitCode=0 Nov 04 04:51:12.351199 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.351170 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerDied","Data":"139d9045f044f174a393e2c5a7e678dc7a5575237165e18879e30ab4b8011bd1"} Nov 04 04:51:12.353355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.353326 5019 generic.go:356] "Generic (PLEG): container finished" podID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerID="2d551e15d8a3fc1e622421082c1ecebebd03fcc2a1f7709cf7936cfecca46fff" exitCode=0 Nov 04 04:51:12.353581 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.353412 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" event={"ID":"9936949a-6e51-4dc2-b98b-a3b547021a0d","Type":"ContainerDied","Data":"2d551e15d8a3fc1e622421082c1ecebebd03fcc2a1f7709cf7936cfecca46fff"} Nov 04 04:51:12.353581 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.353558 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:12.353860 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.353843 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:12.354629 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.354612 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:51:12.354850 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:12.354836 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8" Nov 04 04:51:13.367354 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:13.367309 5019 generic.go:356] "Generic (PLEG): container finished" podID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerID="6be0880805bb1e2d641ad989596b771e3b6a8c685402f362dce8d2a8db73a95e" exitCode=0 Nov 04 04:51:13.367873 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:13.367461 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" event={"ID":"8600de25-27d3-4071-b4b5-8b9542db7b70","Type":"ContainerDied","Data":"6be0880805bb1e2d641ad989596b771e3b6a8c685402f362dce8d2a8db73a95e"} Nov 04 04:51:13.373498 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:13.373471 5019 generic.go:356] "Generic (PLEG): container finished" podID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerID="46f6baccfb6118c5ca05bec04fab1ee6f5dab2e95efb3e786c9c8293952a5bc6" exitCode=0 Nov 04 04:51:13.373959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:13.373927 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerDied","Data":"46f6baccfb6118c5ca05bec04fab1ee6f5dab2e95efb3e786c9c8293952a5bc6"} Nov 04 04:51:15.402474 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:15.402437 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerStarted","Data":"88674e3fe9e3becefcc3d2d65e49d5d2f26fde4d5c7909e4f242ce57a2d26ed9"} Nov 04 04:51:16.413537 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:16.413498 5019 generic.go:356] "Generic (PLEG): container finished" podID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerID="88674e3fe9e3becefcc3d2d65e49d5d2f26fde4d5c7909e4f242ce57a2d26ed9" exitCode=0 Nov 04 04:51:16.414096 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:16.413588 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerDied","Data":"88674e3fe9e3becefcc3d2d65e49d5d2f26fde4d5c7909e4f242ce57a2d26ed9"} Nov 04 04:51:21.521823 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:51:21.521765 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:51:27.509147 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:27.508888 5019 generic.go:356] "Generic (PLEG): container finished" podID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerID="f3e788187c4aeec4675f16e5685702c6b8be7512b80861f3a823901551e985a2" exitCode=0 Nov 04 04:51:27.509147 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:27.509059 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" event={"ID":"9936949a-6e51-4dc2-b98b-a3b547021a0d","Type":"ContainerDied","Data":"f3e788187c4aeec4675f16e5685702c6b8be7512b80861f3a823901551e985a2"} Nov 04 04:51:27.511868 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:27.511841 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" event={"ID":"6d07b989-00c2-4763-9b5f-fb0a505c0c1a","Type":"ContainerStarted","Data":"77943670283ac38f0d90df6d6aefeb26d761721525199e9b2dbebf0c2cc51317"} Nov 04 04:51:27.516183 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:27.516145 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerStarted","Data":"a7bcc070054cc2a614cba4d57bdf9e169bf81c410e96ef494566db8360fd9b78"} Nov 04 04:51:27.744480 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:27.744415 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" podStartSLOduration=3.179343828 podStartE2EDuration="34.744396645s" totalImagesPullingTime="31.565052817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:27.743420727 +0000 UTC m=+260.785835354" watchObservedRunningTime="2026-11-04 04:51:27.744396645 +0000 UTC m=+260.786811271" Nov 04 04:51:27.862538 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:27.862361 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" podStartSLOduration=4.63015515 podStartE2EDuration="34.862340456s" totalImagesPullingTime="30.232185306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:27.860679294 +0000 UTC m=+260.903093921" watchObservedRunningTime="2026-11-04 04:51:27.862340456 +0000 UTC m=+260.904755082" Nov 04 04:51:28.524318 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.524286 5019 generic.go:356] "Generic (PLEG): container finished" podID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerID="77943670283ac38f0d90df6d6aefeb26d761721525199e9b2dbebf0c2cc51317" exitCode=0 Nov 04 04:51:28.524673 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.524619 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" event={"ID":"6d07b989-00c2-4763-9b5f-fb0a505c0c1a","Type":"ContainerDied","Data":"77943670283ac38f0d90df6d6aefeb26d761721525199e9b2dbebf0c2cc51317"} Nov 04 04:51:28.527305 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.527274 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerStarted","Data":"a02cb39af56ffbc30aea2921acbd1e6345ae5ebb1f2a61cb30d5a4d21108d353"} Nov 04 04:51:28.530013 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.529984 5019 generic.go:356] "Generic (PLEG): container finished" podID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerID="a7bcc070054cc2a614cba4d57bdf9e169bf81c410e96ef494566db8360fd9b78" exitCode=0 Nov 04 04:51:28.530149 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.530084 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerDied","Data":"a7bcc070054cc2a614cba4d57bdf9e169bf81c410e96ef494566db8360fd9b78"} Nov 04 04:51:28.532720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.532696 5019 generic.go:356] "Generic (PLEG): container finished" podID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerID="1e00181bff13e16d3780cfeda860d16572faaa060f740eb78d2cf2b8e1fbcd6e" exitCode=0 Nov 04 04:51:28.532842 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.532777 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" event={"ID":"ea4b053a-10fd-491f-b41a-72d5c1286f39","Type":"ContainerDied","Data":"1e00181bff13e16d3780cfeda860d16572faaa060f740eb78d2cf2b8e1fbcd6e"} Nov 04 04:51:28.686938 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.685463 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:51:28.753894 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.753858 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util\") pod \"9936949a-6e51-4dc2-b98b-a3b547021a0d\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " Nov 04 04:51:28.754086 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.753910 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle\") pod \"9936949a-6e51-4dc2-b98b-a3b547021a0d\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " Nov 04 04:51:28.754086 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.753995 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm\" (UniqueName: \"kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm\") pod \"9936949a-6e51-4dc2-b98b-a3b547021a0d\" (UID: \"9936949a-6e51-4dc2-b98b-a3b547021a0d\") " Nov 04 04:51:28.754581 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.754527 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle" pod "9936949a-6e51-4dc2-b98b-a3b547021a0d" (UID: "9936949a-6e51-4dc2-b98b-a3b547021a0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:28.756943 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.756915 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm" pod "9936949a-6e51-4dc2-b98b-a3b547021a0d" (UID: "9936949a-6e51-4dc2-b98b-a3b547021a0d"). InnerVolumeSpecName "kube-api-access-r2qkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:28.760126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.760087 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util" pod "9936949a-6e51-4dc2-b98b-a3b547021a0d" (UID: "9936949a-6e51-4dc2-b98b-a3b547021a0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:28.855432 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.855405 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:28.855432 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.855431 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9936949a-6e51-4dc2-b98b-a3b547021a0d-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:28.855432 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.855446 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2qkm\" (UniqueName: \"kubernetes.io/projected/9936949a-6e51-4dc2-b98b-a3b547021a0d-kube-api-access-r2qkm\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:28.994959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:28.994900 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" podStartSLOduration=3.870718236 podStartE2EDuration="33.994883114s" totalImagesPullingTime="30.124164878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:28.993477607 +0000 UTC m=+262.035892247" watchObservedRunningTime="2026-11-04 04:51:28.994883114 +0000 UTC m=+262.037297743" Nov 04 04:51:29.540333 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.540296 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" event={"ID":"9936949a-6e51-4dc2-b98b-a3b547021a0d","Type":"ContainerDied","Data":"1a24e6c0af7239d1e67323563b42fb7914d2f5322f5c9068d3f37f810a70f3f9"} Nov 04 04:51:29.540774 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.540349 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a24e6c0af7239d1e67323563b42fb7914d2f5322f5c9068d3f37f810a70f3f9" Nov 04 04:51:29.540774 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.540366 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wlbbc" Nov 04 04:51:29.542954 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.542861 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerStarted","Data":"d5b6f104dd438e6d9508316f2faa6594283bb1a639f423b3e260ad5eb77c7fe2"} Nov 04 04:51:29.545943 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.545917 5019 generic.go:356] "Generic (PLEG): container finished" podID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerID="34647a896cb7e1ab8c997ef99eda048bc70d881d8c9dcd30faecbed40555727b" exitCode=0 Nov 04 04:51:29.546065 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.546000 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" event={"ID":"8600de25-27d3-4071-b4b5-8b9542db7b70","Type":"ContainerDied","Data":"34647a896cb7e1ab8c997ef99eda048bc70d881d8c9dcd30faecbed40555727b"} Nov 04 04:51:29.548271 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.548239 5019 generic.go:356] "Generic (PLEG): container finished" podID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerID="a02cb39af56ffbc30aea2921acbd1e6345ae5ebb1f2a61cb30d5a4d21108d353" exitCode=0 Nov 04 04:51:29.548378 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.548335 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerDied","Data":"a02cb39af56ffbc30aea2921acbd1e6345ae5ebb1f2a61cb30d5a4d21108d353"} Nov 04 04:51:29.660934 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.659726 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" podStartSLOduration=3.838850965 podStartE2EDuration="35.65971114s" totalImagesPullingTime="31.820860175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:50:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:29.657875047 +0000 UTC m=+262.700289677" watchObservedRunningTime="2026-11-04 04:51:29.65971114 +0000 UTC m=+262.702125769" Nov 04 04:51:29.693927 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.693902 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:51:29.719996 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.719977 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:51:29.724961 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.724942 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:51:29.764198 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764169 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle\") pod \"ea4b053a-10fd-491f-b41a-72d5c1286f39\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " Nov 04 04:51:29.764355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764235 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle\") pod \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " Nov 04 04:51:29.764355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764260 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6\" (UniqueName: \"kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6\") pod \"ea4b053a-10fd-491f-b41a-72d5c1286f39\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " Nov 04 04:51:29.764355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764285 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util\") pod \"ea4b053a-10fd-491f-b41a-72d5c1286f39\" (UID: \"ea4b053a-10fd-491f-b41a-72d5c1286f39\") " Nov 04 04:51:29.764355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764320 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44\" (UniqueName: \"kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44\") pod \"8ea908ee-3b4c-41d0-8e1f-8271be266444\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " Nov 04 04:51:29.764355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764347 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util\") pod \"8ea908ee-3b4c-41d0-8e1f-8271be266444\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " Nov 04 04:51:29.764605 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764398 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle\") pod \"8ea908ee-3b4c-41d0-8e1f-8271be266444\" (UID: \"8ea908ee-3b4c-41d0-8e1f-8271be266444\") " Nov 04 04:51:29.764605 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764432 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util\") pod \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " Nov 04 04:51:29.765534 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.764969 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle" pod "6d07b989-00c2-4763-9b5f-fb0a505c0c1a" (UID: "6d07b989-00c2-4763-9b5f-fb0a505c0c1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:29.765534 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.765178 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v\" (UniqueName: \"kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v\") pod \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\" (UID: \"6d07b989-00c2-4763-9b5f-fb0a505c0c1a\") " Nov 04 04:51:29.765534 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.765197 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle" pod "ea4b053a-10fd-491f-b41a-72d5c1286f39" (UID: "ea4b053a-10fd-491f-b41a-72d5c1286f39"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:29.765534 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.765448 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.765534 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.765468 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.766201 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.766126 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle" pod "8ea908ee-3b4c-41d0-8e1f-8271be266444" (UID: "8ea908ee-3b4c-41d0-8e1f-8271be266444"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:29.767080 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.767049 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6" pod "ea4b053a-10fd-491f-b41a-72d5c1286f39" (UID: "ea4b053a-10fd-491f-b41a-72d5c1286f39"). InnerVolumeSpecName "kube-api-access-vgzn6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:29.767160 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.767104 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44" pod "8ea908ee-3b4c-41d0-8e1f-8271be266444" (UID: "8ea908ee-3b4c-41d0-8e1f-8271be266444"). InnerVolumeSpecName "kube-api-access-5nz44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:29.767613 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.767588 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v" pod "6d07b989-00c2-4763-9b5f-fb0a505c0c1a" (UID: "6d07b989-00c2-4763-9b5f-fb0a505c0c1a"). InnerVolumeSpecName "kube-api-access-c672v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:29.771193 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.771173 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util" pod "6d07b989-00c2-4763-9b5f-fb0a505c0c1a" (UID: "6d07b989-00c2-4763-9b5f-fb0a505c0c1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:29.771253 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.771226 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util" pod "8ea908ee-3b4c-41d0-8e1f-8271be266444" (UID: "8ea908ee-3b4c-41d0-8e1f-8271be266444"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:29.772620 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.772602 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util" pod "ea4b053a-10fd-491f-b41a-72d5c1286f39" (UID: "ea4b053a-10fd-491f-b41a-72d5c1286f39"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:29.866197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866166 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgzn6\" (UniqueName: \"kubernetes.io/projected/ea4b053a-10fd-491f-b41a-72d5c1286f39-kube-api-access-vgzn6\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.866197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866195 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4b053a-10fd-491f-b41a-72d5c1286f39-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.866405 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866206 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nz44\" (UniqueName: \"kubernetes.io/projected/8ea908ee-3b4c-41d0-8e1f-8271be266444-kube-api-access-5nz44\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.866405 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866214 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.866405 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866223 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ea908ee-3b4c-41d0-8e1f-8271be266444-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.866405 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866231 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:29.866405 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:29.866238 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c672v\" (UniqueName: \"kubernetes.io/projected/6d07b989-00c2-4763-9b5f-fb0a505c0c1a-kube-api-access-c672v\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:30.555155 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.555118 5019 generic.go:356] "Generic (PLEG): container finished" podID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerID="d5b6f104dd438e6d9508316f2faa6594283bb1a639f423b3e260ad5eb77c7fe2" exitCode=0 Nov 04 04:51:30.555622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.555181 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerDied","Data":"d5b6f104dd438e6d9508316f2faa6594283bb1a639f423b3e260ad5eb77c7fe2"} Nov 04 04:51:30.557092 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.557074 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" Nov 04 04:51:30.557202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.557094 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847akjbd5" event={"ID":"ea4b053a-10fd-491f-b41a-72d5c1286f39","Type":"ContainerDied","Data":"61e85813a01bd06ab982b3898347e0dff4ee4d95ebe7518ff8aec50374fce0b6"} Nov 04 04:51:30.557202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.557129 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61e85813a01bd06ab982b3898347e0dff4ee4d95ebe7518ff8aec50374fce0b6" Nov 04 04:51:30.559067 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.559051 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" Nov 04 04:51:30.559067 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.559058 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6jccqr" event={"ID":"6d07b989-00c2-4763-9b5f-fb0a505c0c1a","Type":"ContainerDied","Data":"17149c0ba2a5d011ffffb87ba9b1cbd7006e5cf17a885b35630254e9acb70edc"} Nov 04 04:51:30.559211 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.559085 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17149c0ba2a5d011ffffb87ba9b1cbd7006e5cf17a885b35630254e9acb70edc" Nov 04 04:51:30.561012 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.560990 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" event={"ID":"8ea908ee-3b4c-41d0-8e1f-8271be266444","Type":"ContainerDied","Data":"73541af3f565e10a51923793ad6f1141f640eb791804e9dfb42245604edbf3ce"} Nov 04 04:51:30.561118 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.561022 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwl4qt" Nov 04 04:51:30.561118 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.561026 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73541af3f565e10a51923793ad6f1141f640eb791804e9dfb42245604edbf3ce" Nov 04 04:51:30.718487 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.718461 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:51:30.721309 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.721289 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:30.775499 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.775461 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k\" (UniqueName: \"kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k\") pod \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " Nov 04 04:51:30.775657 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.775518 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle\") pod \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " Nov 04 04:51:30.775657 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.775565 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle\") pod \"8600de25-27d3-4071-b4b5-8b9542db7b70\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " Nov 04 04:51:30.775657 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.775600 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm\" (UniqueName: \"kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm\") pod \"8600de25-27d3-4071-b4b5-8b9542db7b70\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " Nov 04 04:51:30.775657 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.775651 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util\") pod \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\" (UID: \"a13c12f8-4176-4bfa-abc0-38990bc22bdd\") " Nov 04 04:51:30.775946 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.775703 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util\") pod \"8600de25-27d3-4071-b4b5-8b9542db7b70\" (UID: \"8600de25-27d3-4071-b4b5-8b9542db7b70\") " Nov 04 04:51:30.776371 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.776339 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle" pod "8600de25-27d3-4071-b4b5-8b9542db7b70" (UID: "8600de25-27d3-4071-b4b5-8b9542db7b70"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:30.776488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.776463 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle" pod "a13c12f8-4176-4bfa-abc0-38990bc22bdd" (UID: "a13c12f8-4176-4bfa-abc0-38990bc22bdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:30.777870 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.777840 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm" pod "8600de25-27d3-4071-b4b5-8b9542db7b70" (UID: "8600de25-27d3-4071-b4b5-8b9542db7b70"). InnerVolumeSpecName "kube-api-access-ppkvm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:30.778094 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.778077 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k" pod "a13c12f8-4176-4bfa-abc0-38990bc22bdd" (UID: "a13c12f8-4176-4bfa-abc0-38990bc22bdd"). InnerVolumeSpecName "kube-api-access-s8h2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:30.780598 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.780576 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util" pod "a13c12f8-4176-4bfa-abc0-38990bc22bdd" (UID: "a13c12f8-4176-4bfa-abc0-38990bc22bdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:30.781522 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.781502 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util" pod "8600de25-27d3-4071-b4b5-8b9542db7b70" (UID: "8600de25-27d3-4071-b4b5-8b9542db7b70"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:30.877479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.877397 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:30.877479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.877427 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8h2k\" (UniqueName: \"kubernetes.io/projected/a13c12f8-4176-4bfa-abc0-38990bc22bdd-kube-api-access-s8h2k\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:30.877479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.877442 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:30.877479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.877451 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8600de25-27d3-4071-b4b5-8b9542db7b70-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:30.877479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.877459 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppkvm\" (UniqueName: \"kubernetes.io/projected/8600de25-27d3-4071-b4b5-8b9542db7b70-kube-api-access-ppkvm\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:30.877479 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:30.877466 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a13c12f8-4176-4bfa-abc0-38990bc22bdd-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:31.567712 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.567672 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" Nov 04 04:51:31.568172 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.567672 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a2bbkl" event={"ID":"8600de25-27d3-4071-b4b5-8b9542db7b70","Type":"ContainerDied","Data":"22ec366ff5d410fd3eaf32dc2e6b6919cbff696e561ce16abf59aee620d0cb4b"} Nov 04 04:51:31.568172 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.567854 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22ec366ff5d410fd3eaf32dc2e6b6919cbff696e561ce16abf59aee620d0cb4b" Nov 04 04:51:31.569749 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.569715 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" event={"ID":"a13c12f8-4176-4bfa-abc0-38990bc22bdd","Type":"ContainerDied","Data":"4c95dce9f58eaec1c6746d7e9323ce60eb6487e3a99ed95bac51d8319d1f8467"} Nov 04 04:51:31.569903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.569778 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71xlfwx" Nov 04 04:51:31.569903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.569785 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c95dce9f58eaec1c6746d7e9323ce60eb6487e3a99ed95bac51d8319d1f8467" Nov 04 04:51:31.697153 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.697123 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:51:31.785806 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.785774 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle\") pod \"cd458804-b0f1-4a13-860a-99742bf5e21c\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " Nov 04 04:51:31.785977 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.785905 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util\") pod \"cd458804-b0f1-4a13-860a-99742bf5e21c\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " Nov 04 04:51:31.786039 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.785987 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc\" (UniqueName: \"kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc\") pod \"cd458804-b0f1-4a13-860a-99742bf5e21c\" (UID: \"cd458804-b0f1-4a13-860a-99742bf5e21c\") " Nov 04 04:51:31.786243 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.786222 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle" pod "cd458804-b0f1-4a13-860a-99742bf5e21c" (UID: "cd458804-b0f1-4a13-860a-99742bf5e21c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:31.788177 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.788153 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc" pod "cd458804-b0f1-4a13-860a-99742bf5e21c" (UID: "cd458804-b0f1-4a13-860a-99742bf5e21c"). InnerVolumeSpecName "kube-api-access-btqhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:51:31.791715 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.791691 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util" pod "cd458804-b0f1-4a13-860a-99742bf5e21c" (UID: "cd458804-b0f1-4a13-860a-99742bf5e21c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:51:31.886627 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.886546 5019 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-util\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:31.886627 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.886573 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btqhc\" (UniqueName: \"kubernetes.io/projected/cd458804-b0f1-4a13-860a-99742bf5e21c-kube-api-access-btqhc\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:31.886627 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:31.886582 5019 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd458804-b0f1-4a13-860a-99742bf5e21c-bundle\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:51:32.288162 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288134 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl"] Nov 04 04:51:32.288460 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288448 5019 cpu_manager.go:414] "containerMap: removing container" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="pull" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288462 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="pull" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288473 5019 cpu_manager.go:414] "containerMap: removing container" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="extract" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288478 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="extract" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288488 5019 cpu_manager.go:414] "containerMap: removing container" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="util" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288492 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="util" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288497 5019 cpu_manager.go:414] "containerMap: removing container" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="extract" Nov 04 04:51:32.288503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288502 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288515 5019 cpu_manager.go:414] "containerMap: removing container" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288523 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288529 5019 cpu_manager.go:414] "containerMap: removing container" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288533 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288538 5019 cpu_manager.go:414] "containerMap: removing container" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288542 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288548 5019 cpu_manager.go:414] "containerMap: removing container" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288552 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288558 5019 cpu_manager.go:414] "containerMap: removing container" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288562 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288567 5019 cpu_manager.go:414] "containerMap: removing container" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288570 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288575 5019 cpu_manager.go:414] "containerMap: removing container" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288579 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288583 5019 cpu_manager.go:414] "containerMap: removing container" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288590 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288603 5019 cpu_manager.go:414] "containerMap: removing container" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288608 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288614 5019 cpu_manager.go:414] "containerMap: removing container" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288618 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288628 5019 cpu_manager.go:414] "containerMap: removing container" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288632 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288639 5019 cpu_manager.go:414] "containerMap: removing container" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288644 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288649 5019 cpu_manager.go:414] "containerMap: removing container" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288653 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="pull" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288659 5019 cpu_manager.go:414] "containerMap: removing container" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288663 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288683 5019 cpu_manager.go:414] "containerMap: removing container" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288688 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="util" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288693 5019 cpu_manager.go:414] "containerMap: removing container" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288698 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288703 5019 cpu_manager.go:414] "containerMap: removing container" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="extract" Nov 04 04:51:32.288693 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288707 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288759 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="a13c12f8-4176-4bfa-abc0-38990bc22bdd" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288769 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea4b053a-10fd-491f-b41a-72d5c1286f39" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288774 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ea908ee-3b4c-41d0-8e1f-8271be266444" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288779 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d07b989-00c2-4763-9b5f-fb0a505c0c1a" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288787 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="9936949a-6e51-4dc2-b98b-a3b547021a0d" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288805 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd458804-b0f1-4a13-860a-99742bf5e21c" containerName="extract" Nov 04 04:51:32.289628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.288810 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="8600de25-27d3-4071-b4b5-8b9542db7b70" containerName="extract" Nov 04 04:51:32.290759 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.290745 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.353151 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.353129 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dx4fw\"" Nov 04 04:51:32.354467 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.354449 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 04 04:51:32.354570 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.354559 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 04 04:51:32.390724 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.390697 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8mt\" (UniqueName: \"kubernetes.io/projected/1c80e7d5-9041-48c5-8b22-c3e7cc705be9-kube-api-access-rx8mt\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl\" (UID: \"1c80e7d5-9041-48c5-8b22-c3e7cc705be9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.390854 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.390735 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c80e7d5-9041-48c5-8b22-c3e7cc705be9-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl\" (UID: \"1c80e7d5-9041-48c5-8b22-c3e7cc705be9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.413777 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.413746 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl"] Nov 04 04:51:32.491199 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.491167 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8mt\" (UniqueName: \"kubernetes.io/projected/1c80e7d5-9041-48c5-8b22-c3e7cc705be9-kube-api-access-rx8mt\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl\" (UID: \"1c80e7d5-9041-48c5-8b22-c3e7cc705be9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.491365 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.491209 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c80e7d5-9041-48c5-8b22-c3e7cc705be9-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl\" (UID: \"1c80e7d5-9041-48c5-8b22-c3e7cc705be9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.491518 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.491503 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c80e7d5-9041-48c5-8b22-c3e7cc705be9-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl\" (UID: \"1c80e7d5-9041-48c5-8b22-c3e7cc705be9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.548894 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.548828 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8mt\" (UniqueName: \"kubernetes.io/projected/1c80e7d5-9041-48c5-8b22-c3e7cc705be9-kube-api-access-rx8mt\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl\" (UID: \"1c80e7d5-9041-48c5-8b22-c3e7cc705be9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:32.575673 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.575648 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" Nov 04 04:51:32.576077 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.575646 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644h65q8" event={"ID":"cd458804-b0f1-4a13-860a-99742bf5e21c","Type":"ContainerDied","Data":"3b587de63634252377fa455e46c44aae65a651a8bb7f5f18c70982ea58a33418"} Nov 04 04:51:32.576077 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.575760 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b587de63634252377fa455e46c44aae65a651a8bb7f5f18c70982ea58a33418" Nov 04 04:51:32.600725 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:32.600701 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" Nov 04 04:51:33.019817 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:33.019770 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl"] Nov 04 04:51:33.022000 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:33.021964 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c80e7d5_9041_48c5_8b22_c3e7cc705be9.slice/crio-658e42d1e9dbe717fc7cced725081a2af703f3bfa11dceb0fdec87949318125f WatchSource:0}: Error finding container 658e42d1e9dbe717fc7cced725081a2af703f3bfa11dceb0fdec87949318125f: Status 404 returned error can't find the container with id 658e42d1e9dbe717fc7cced725081a2af703f3bfa11dceb0fdec87949318125f Nov 04 04:51:33.581935 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:33.581901 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" event={"ID":"1c80e7d5-9041-48c5-8b22-c3e7cc705be9","Type":"ContainerStarted","Data":"658e42d1e9dbe717fc7cced725081a2af703f3bfa11dceb0fdec87949318125f"} Nov 04 04:51:37.602504 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:37.602472 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" event={"ID":"1c80e7d5-9041-48c5-8b22-c3e7cc705be9","Type":"ContainerStarted","Data":"9f75725d14ea70fb483f929b05a2aa73a79c2e5129f6a9974860d73d923b1fc3"} Nov 04 04:51:37.821203 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:37.821151 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-sz8gl" podStartSLOduration=2.239351742 podStartE2EDuration="5.821136972s" totalImagesPullingTime="3.58178523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:37.769262165 +0000 UTC m=+270.811676783" watchObservedRunningTime="2026-11-04 04:51:37.821136972 +0000 UTC m=+270.863551600" Nov 04 04:51:45.375488 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.375450 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx"] Nov 04 04:51:45.377701 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.377685 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.483083 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.483054 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 04 04:51:45.483083 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.483048 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qwfr6\"" Nov 04 04:51:45.483341 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.483088 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 04 04:51:45.484669 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.484648 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx"] Nov 04 04:51:45.500815 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.500765 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-9svrx\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.500963 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.500824 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qgdx\" (UniqueName: \"kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx\") pod \"kuadrant-operator-controller-manager-cf8469d7b-9svrx\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.602410 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.602373 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-9svrx\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.602598 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.602430 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qgdx\" (UniqueName: \"kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx\") pod \"kuadrant-operator-controller-manager-cf8469d7b-9svrx\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.602777 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.602757 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-9svrx\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.662465 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.662395 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qgdx\" (UniqueName: \"kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx\") pod \"kuadrant-operator-controller-manager-cf8469d7b-9svrx\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:45.689272 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:45.689239 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:46.161360 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:46.161325 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx"] Nov 04 04:51:46.200313 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:46.200287 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e4748b_535e_43a8_8a60_95ee2ba9515f.slice/crio-cb1a3b169aa51bf42f49a2ac438519f757ee8b34a9681ae864f21c262547ef47 WatchSource:0}: Error finding container cb1a3b169aa51bf42f49a2ac438519f757ee8b34a9681ae864f21c262547ef47: Status 404 returned error can't find the container with id cb1a3b169aa51bf42f49a2ac438519f757ee8b34a9681ae864f21c262547ef47 Nov 04 04:51:46.646646 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:46.646610 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" event={"ID":"c0e4748b-535e-43a8-8a60-95ee2ba9515f","Type":"ContainerStarted","Data":"cb1a3b169aa51bf42f49a2ac438519f757ee8b34a9681ae864f21c262547ef47"} Nov 04 04:51:49.299014 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.298978 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4"] Nov 04 04:51:49.305480 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.305456 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.411493 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.411454 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 04 04:51:49.411493 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.411475 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 04 04:51:49.411699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.411453 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 04 04:51:49.411699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.411536 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-nj9j7\"" Nov 04 04:51:49.413703 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.413628 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4"] Nov 04 04:51:49.436944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.436920 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 04 04:51:49.436944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.436934 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 04 04:51:49.439247 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.439222 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-metrics-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.439331 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.439263 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-tmp\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.439331 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.439282 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.439331 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.439304 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-manifests\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.439448 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.439365 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.439483 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.439459 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scs2j\" (UniqueName: \"kubernetes.io/projected/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-kube-api-access-scs2j\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.540708 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.540675 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scs2j\" (UniqueName: \"kubernetes.io/projected/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-kube-api-access-scs2j\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.540882 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.540730 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-metrics-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.540882 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.540820 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-tmp\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.540882 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.540852 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.541029 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.540884 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-manifests\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.541029 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.540910 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.541578 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.541524 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-manifests\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.543776 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.543753 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.543930 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.543907 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.544406 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.544380 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-tmp\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.544523 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.544507 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-metrics-cert\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.600076 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.600008 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scs2j\" (UniqueName: \"kubernetes.io/projected/1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef-kube-api-access-scs2j\") pod \"opendatahub-operator-controller-manager-84f7664b48-sksj4\" (UID: \"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.623600 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.623579 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:49.694956 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.694922 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz"] Nov 04 04:51:49.697844 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.697818 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:51:49.751382 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.751356 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Nov 04 04:51:49.751382 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.751369 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zc9f8\"" Nov 04 04:51:49.757268 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.757243 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz"] Nov 04 04:51:49.842964 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.842926 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hjxh\" (UniqueName: \"kubernetes.io/projected/708f70d2-e22e-4fd0-a723-60f10ce100d1-kube-api-access-5hjxh\") pod \"dns-operator-controller-manager-8557cbdb84-qprvz\" (UID: \"708f70d2-e22e-4fd0-a723-60f10ce100d1\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:51:49.944339 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:49.944263 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hjxh\" (UniqueName: \"kubernetes.io/projected/708f70d2-e22e-4fd0-a723-60f10ce100d1-kube-api-access-5hjxh\") pod \"dns-operator-controller-manager-8557cbdb84-qprvz\" (UID: \"708f70d2-e22e-4fd0-a723-60f10ce100d1\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:51:50.013299 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:50.013264 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hjxh\" (UniqueName: \"kubernetes.io/projected/708f70d2-e22e-4fd0-a723-60f10ce100d1-kube-api-access-5hjxh\") pod \"dns-operator-controller-manager-8557cbdb84-qprvz\" (UID: \"708f70d2-e22e-4fd0-a723-60f10ce100d1\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:51:50.163512 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:50.163482 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e50d848_9bcf_4f48_b3fd_8ae451d8f2ef.slice/crio-173d071300ba6fa22294a39330457a4936af90607e74901295c4d6756c5c13e9 WatchSource:0}: Error finding container 173d071300ba6fa22294a39330457a4936af90607e74901295c4d6756c5c13e9: Status 404 returned error can't find the container with id 173d071300ba6fa22294a39330457a4936af90607e74901295c4d6756c5c13e9 Nov 04 04:51:50.165418 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:50.165389 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4"] Nov 04 04:51:50.312645 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:50.312615 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:51:50.669286 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:50.669210 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" event={"ID":"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef","Type":"ContainerStarted","Data":"173d071300ba6fa22294a39330457a4936af90607e74901295c4d6756c5c13e9"} Nov 04 04:51:50.691886 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:50.691862 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz"] Nov 04 04:51:50.694598 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:50.694568 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708f70d2_e22e_4fd0_a723_60f10ce100d1.slice/crio-0cb427ea180b7640fed2eb2279425ab0f717ac53afa864b1e3fbde8204b65c64 WatchSource:0}: Error finding container 0cb427ea180b7640fed2eb2279425ab0f717ac53afa864b1e3fbde8204b65c64: Status 404 returned error can't find the container with id 0cb427ea180b7640fed2eb2279425ab0f717ac53afa864b1e3fbde8204b65c64 Nov 04 04:51:51.494556 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:51:51.494515 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:51:51.679293 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:51.679255 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" event={"ID":"708f70d2-e22e-4fd0-a723-60f10ce100d1","Type":"ContainerStarted","Data":"0cb427ea180b7640fed2eb2279425ab0f717ac53afa864b1e3fbde8204b65c64"} Nov 04 04:51:51.681087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:51.681056 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" event={"ID":"c0e4748b-535e-43a8-8a60-95ee2ba9515f","Type":"ContainerStarted","Data":"6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc"} Nov 04 04:51:51.681857 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:51.681838 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:51:51.800480 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:51.800378 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" podStartSLOduration=2.037148127 podStartE2EDuration="6.800360489s" totalImagesPullingTime="4.763212362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:51.797886019 +0000 UTC m=+284.840300647" watchObservedRunningTime="2026-11-04 04:51:51.800360489 +0000 UTC m=+284.842775117" Nov 04 04:51:53.692981 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:53.692950 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" event={"ID":"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef","Type":"ContainerStarted","Data":"b6d825ff4cde6e22437aa91027247171d7dc35527777a38ad068db3947a6b9da"} Nov 04 04:51:53.694709 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:53.694684 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" event={"ID":"708f70d2-e22e-4fd0-a723-60f10ce100d1","Type":"ContainerStarted","Data":"7a56995be21eb30be6f79ded47268c547edc9c5916a68993d610cc969ffd6fb8"} Nov 04 04:51:53.694926 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:53.694912 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:51:54.038810 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.038746 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" podStartSLOduration=2.382699196 podStartE2EDuration="5.038733829s" totalImagesPullingTime="2.656034633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:54.037716601 +0000 UTC m=+287.080131229" watchObservedRunningTime="2026-11-04 04:51:54.038733829 +0000 UTC m=+287.081148457" Nov 04 04:51:54.168026 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.167992 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4"] Nov 04 04:51:54.170104 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.170090 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:51:54.230275 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.230258 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ftm5h\"" Nov 04 04:51:54.236911 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.236889 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4"] Nov 04 04:51:54.284972 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.284950 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm2wt\" (UniqueName: \"kubernetes.io/projected/33138c5b-ae00-4b20-95e9-43b222ad57b8-kube-api-access-mm2wt\") pod \"limitador-operator-controller-manager-5778bb4449-htgr4\" (UID: \"33138c5b-ae00-4b20-95e9-43b222ad57b8\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:51:54.385358 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.385304 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm2wt\" (UniqueName: \"kubernetes.io/projected/33138c5b-ae00-4b20-95e9-43b222ad57b8-kube-api-access-mm2wt\") pod \"limitador-operator-controller-manager-5778bb4449-htgr4\" (UID: \"33138c5b-ae00-4b20-95e9-43b222ad57b8\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:51:54.446819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.446766 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm2wt\" (UniqueName: \"kubernetes.io/projected/33138c5b-ae00-4b20-95e9-43b222ad57b8-kube-api-access-mm2wt\") pod \"limitador-operator-controller-manager-5778bb4449-htgr4\" (UID: \"33138c5b-ae00-4b20-95e9-43b222ad57b8\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:51:54.516716 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.516690 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:51:54.701192 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.701119 5019 generic.go:356] "Generic (PLEG): container finished" podID="1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef" containerID="b6d825ff4cde6e22437aa91027247171d7dc35527777a38ad068db3947a6b9da" exitCode=0 Nov 04 04:51:54.701602 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.701199 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" event={"ID":"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef","Type":"ContainerDied","Data":"b6d825ff4cde6e22437aa91027247171d7dc35527777a38ad068db3947a6b9da"} Nov 04 04:51:54.885471 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:54.885438 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4"] Nov 04 04:51:54.893054 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:54.893022 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33138c5b_ae00_4b20_95e9_43b222ad57b8.slice/crio-2564a7859dc5686010b184ba2fd0f82a069954003c4f9046c7727b79a4a03a9f WatchSource:0}: Error finding container 2564a7859dc5686010b184ba2fd0f82a069954003c4f9046c7727b79a4a03a9f: Status 404 returned error can't find the container with id 2564a7859dc5686010b184ba2fd0f82a069954003c4f9046c7727b79a4a03a9f Nov 04 04:51:55.706900 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:55.706869 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" event={"ID":"33138c5b-ae00-4b20-95e9-43b222ad57b8","Type":"ContainerStarted","Data":"2564a7859dc5686010b184ba2fd0f82a069954003c4f9046c7727b79a4a03a9f"} Nov 04 04:51:55.708853 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:55.708827 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" event={"ID":"1e50d848-9bcf-4f48-b3fd-8ae451d8f2ef","Type":"ContainerStarted","Data":"91f5014a5cdd5646a1456edf46d9a86cd7e9423b055e0dfc8cdc1ccfaa1d03de"} Nov 04 04:51:55.708988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:55.708901 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:51:55.841099 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:55.841008 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" podStartSLOduration=2.135742063 podStartE2EDuration="6.8409967s" totalImagesPullingTime="4.241374075s" totalInitContainerRuntime="463.880562ms" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:55.839886899 +0000 UTC m=+288.882301520" watchObservedRunningTime="2026-11-04 04:51:55.8409967 +0000 UTC m=+288.883411328" Nov 04 04:51:57.951593 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:57.951511 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-h4866"] Nov 04 04:51:57.964808 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:57.964772 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:51:58.013760 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.013732 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-h4866"] Nov 04 04:51:58.061910 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.061877 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j5wp4\"" Nov 04 04:51:58.118812 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.118765 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz4hf\" (UniqueName: \"kubernetes.io/projected/5e564626-363b-4150-bd74-73ec39725fa2-kube-api-access-cz4hf\") pod \"authorino-operator-7b7bb4bc77-h4866\" (UID: \"5e564626-363b-4150-bd74-73ec39725fa2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:51:58.220125 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.220044 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz4hf\" (UniqueName: \"kubernetes.io/projected/5e564626-363b-4150-bd74-73ec39725fa2-kube-api-access-cz4hf\") pod \"authorino-operator-7b7bb4bc77-h4866\" (UID: \"5e564626-363b-4150-bd74-73ec39725fa2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:51:58.277557 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.277518 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz4hf\" (UniqueName: \"kubernetes.io/projected/5e564626-363b-4150-bd74-73ec39725fa2-kube-api-access-cz4hf\") pod \"authorino-operator-7b7bb4bc77-h4866\" (UID: \"5e564626-363b-4150-bd74-73ec39725fa2\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:51:58.287349 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.287325 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:51:58.677633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.677606 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-h4866"] Nov 04 04:51:58.678754 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:51:58.678726 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e564626_363b_4150_bd74_73ec39725fa2.slice/crio-21ca159e99c9c875ef1688f42ef7301304d255479f3f5e5c3d90b08abb03d26d WatchSource:0}: Error finding container 21ca159e99c9c875ef1688f42ef7301304d255479f3f5e5c3d90b08abb03d26d: Status 404 returned error can't find the container with id 21ca159e99c9c875ef1688f42ef7301304d255479f3f5e5c3d90b08abb03d26d Nov 04 04:51:58.726027 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.726003 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" event={"ID":"5e564626-363b-4150-bd74-73ec39725fa2","Type":"ContainerStarted","Data":"21ca159e99c9c875ef1688f42ef7301304d255479f3f5e5c3d90b08abb03d26d"} Nov 04 04:51:58.727636 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.727610 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" event={"ID":"33138c5b-ae00-4b20-95e9-43b222ad57b8","Type":"ContainerStarted","Data":"4a4ea5972896704fc51d9f14f5f116597931583e05af0e270b3b13032b23d251"} Nov 04 04:51:58.727754 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.727743 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:51:58.847832 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:51:58.847765 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" podStartSLOduration=2.075118945 podStartE2EDuration="4.847750677s" totalImagesPullingTime="2.772631732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:51:58.846460621 +0000 UTC m=+291.888875248" watchObservedRunningTime="2026-11-04 04:51:58.847750677 +0000 UTC m=+291.890165304" Nov 04 04:52:01.748644 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:01.748608 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" event={"ID":"5e564626-363b-4150-bd74-73ec39725fa2","Type":"ContainerStarted","Data":"35bda23069b9cc7c8437cd32eb8294659fcccad242da01c6a678ec25a4cc5183"} Nov 04 04:52:01.749047 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:01.748675 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:52:01.864443 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:01.864392 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" podStartSLOduration=2.733818134 podStartE2EDuration="4.864379363s" totalImagesPullingTime="2.130561229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:01.863697036 +0000 UTC m=+294.906111673" watchObservedRunningTime="2026-11-04 04:52:01.864379363 +0000 UTC m=+294.906793990" Nov 04 04:52:03.696844 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:03.696817 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:52:04.415087 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.415057 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn"] Nov 04 04:52:04.417244 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.417229 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.465616 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.465588 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d567m\" (UniqueName: \"kubernetes.io/projected/988e7776-5b62-4ae0-963c-1b45489f4c57-kube-api-access-d567m\") pod \"kuadrant-operator-controller-manager-678d87766f-khhsn\" (UID: \"988e7776-5b62-4ae0-963c-1b45489f4c57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.465736 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.465647 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/988e7776-5b62-4ae0-963c-1b45489f4c57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-khhsn\" (UID: \"988e7776-5b62-4ae0-963c-1b45489f4c57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.521281 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.521258 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn"] Nov 04 04:52:04.566924 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.566897 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d567m\" (UniqueName: \"kubernetes.io/projected/988e7776-5b62-4ae0-963c-1b45489f4c57-kube-api-access-d567m\") pod \"kuadrant-operator-controller-manager-678d87766f-khhsn\" (UID: \"988e7776-5b62-4ae0-963c-1b45489f4c57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.567066 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.566957 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/988e7776-5b62-4ae0-963c-1b45489f4c57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-khhsn\" (UID: \"988e7776-5b62-4ae0-963c-1b45489f4c57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.567312 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.567294 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/988e7776-5b62-4ae0-963c-1b45489f4c57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-khhsn\" (UID: \"988e7776-5b62-4ae0-963c-1b45489f4c57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.625390 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.625360 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d567m\" (UniqueName: \"kubernetes.io/projected/988e7776-5b62-4ae0-963c-1b45489f4c57-kube-api-access-d567m\") pod \"kuadrant-operator-controller-manager-678d87766f-khhsn\" (UID: \"988e7776-5b62-4ae0-963c-1b45489f4c57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:04.703986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.703928 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-qprvz" Nov 04 04:52:04.728463 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:04.728440 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:05.148544 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:05.148524 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn"] Nov 04 04:52:05.150491 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:52:05.150462 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988e7776_5b62_4ae0_963c_1b45489f4c57.slice/crio-d32b9c165afea0b4766645a24f40ec7d0256cd4040043a60e8d37211946583d9 WatchSource:0}: Error finding container d32b9c165afea0b4766645a24f40ec7d0256cd4040043a60e8d37211946583d9: Status 404 returned error can't find the container with id d32b9c165afea0b4766645a24f40ec7d0256cd4040043a60e8d37211946583d9 Nov 04 04:52:05.769274 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:05.769239 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" event={"ID":"988e7776-5b62-4ae0-963c-1b45489f4c57","Type":"ContainerStarted","Data":"3d364e5f66110e26a56518078432ca00e39000cc20a9179bf3951ebad26b9372"} Nov 04 04:52:05.769646 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:05.769321 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" event={"ID":"988e7776-5b62-4ae0-963c-1b45489f4c57","Type":"ContainerStarted","Data":"d32b9c165afea0b4766645a24f40ec7d0256cd4040043a60e8d37211946583d9"} Nov 04 04:52:05.769646 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:05.769388 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:05.994011 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:05.993961 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" podStartSLOduration=1.993947868 podStartE2EDuration="1.993947868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:05.99199381 +0000 UTC m=+299.034408438" watchObservedRunningTime="2026-11-04 04:52:05.993947868 +0000 UTC m=+299.036362496" Nov 04 04:52:06.717108 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:06.717084 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-84f7664b48-sksj4" Nov 04 04:52:07.148317 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:07.148290 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:52:07.148750 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:07.148499 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:52:07.156691 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:07.156673 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:52:07.156947 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:07.156934 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:52:09.734613 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:09.734583 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-htgr4" Nov 04 04:52:12.756061 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:12.756036 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h4866" Nov 04 04:52:16.776684 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:16.776647 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-khhsn" Nov 04 04:52:16.998020 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:16.997989 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx"] Nov 04 04:52:16.998302 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:16.998269 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" podUID="c0e4748b-535e-43a8-8a60-95ee2ba9515f" containerName="manager" containerID="cri-o://6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc" gracePeriod=10 Nov 04 04:52:17.239774 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.239751 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:52:17.258652 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.258622 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume\") pod \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " Nov 04 04:52:17.258771 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.258710 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx\" (UniqueName: \"kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx\") pod \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\" (UID: \"c0e4748b-535e-43a8-8a60-95ee2ba9515f\") " Nov 04 04:52:17.259018 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.258997 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume" pod "c0e4748b-535e-43a8-8a60-95ee2ba9515f" (UID: "c0e4748b-535e-43a8-8a60-95ee2ba9515f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 04:52:17.260901 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.260872 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx" pod "c0e4748b-535e-43a8-8a60-95ee2ba9515f" (UID: "c0e4748b-535e-43a8-8a60-95ee2ba9515f"). InnerVolumeSpecName "kube-api-access-7qgdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:52:17.359514 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.359492 5019 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e4748b-535e-43a8-8a60-95ee2ba9515f-extensions-socket-volume\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:52:17.359514 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.359514 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qgdx\" (UniqueName: \"kubernetes.io/projected/c0e4748b-535e-43a8-8a60-95ee2ba9515f-kube-api-access-7qgdx\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:52:17.831024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.830953 5019 generic.go:356] "Generic (PLEG): container finished" podID="c0e4748b-535e-43a8-8a60-95ee2ba9515f" containerID="6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc" exitCode=0 Nov 04 04:52:17.831024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.831000 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" event={"ID":"c0e4748b-535e-43a8-8a60-95ee2ba9515f","Type":"ContainerDied","Data":"6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc"} Nov 04 04:52:17.831024 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.831003 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" Nov 04 04:52:17.831473 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.831041 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx" event={"ID":"c0e4748b-535e-43a8-8a60-95ee2ba9515f","Type":"ContainerDied","Data":"cb1a3b169aa51bf42f49a2ac438519f757ee8b34a9681ae864f21c262547ef47"} Nov 04 04:52:17.831473 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.831062 5019 scope.go:122] "RemoveContainer" containerID="6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc" Nov 04 04:52:17.839677 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.839658 5019 scope.go:122] "RemoveContainer" containerID="6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc" Nov 04 04:52:17.839964 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:52:17.839947 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc\": container with ID starting with 6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc not found: ID does not exist" containerID="6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc" Nov 04 04:52:17.840020 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:17.839974 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc"} err="failed to get container status \"6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc\": rpc error: code = NotFound desc = could not find container \"6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc\": container with ID starting with 6fe4318c19a11d5f7f02b1fd98e74894365b8e62d94e30024439226510c09dbc not found: ID does not exist" Nov 04 04:52:18.017397 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:18.017373 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx"] Nov 04 04:52:18.067848 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:18.067820 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-9svrx"] Nov 04 04:52:19.123137 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:19.123108 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c0e4748b-535e-43a8-8a60-95ee2ba9515f" path="/var/lib/kubelet/pods/c0e4748b-535e-43a8-8a60-95ee2ba9515f/volumes" Nov 04 04:52:20.917105 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.917072 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr"] Nov 04 04:52:20.917631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.917608 5019 cpu_manager.go:414] "containerMap: removing container" podUID="c0e4748b-535e-43a8-8a60-95ee2ba9515f" containerName="manager" Nov 04 04:52:20.917631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.917626 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0e4748b-535e-43a8-8a60-95ee2ba9515f" containerName="manager" Nov 04 04:52:20.917784 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.917757 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0e4748b-535e-43a8-8a60-95ee2ba9515f" containerName="manager" Nov 04 04:52:20.967045 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.967016 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.981159 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.981136 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr"] Nov 04 04:52:20.989381 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989356 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989498 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989393 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989498 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989469 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989592 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989576 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47a6a3e2-7e77-4271-8268-6e923215052b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989639 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989626 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmpq9\" (UniqueName: \"kubernetes.io/projected/47a6a3e2-7e77-4271-8268-6e923215052b-kube-api-access-rmpq9\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989689 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989675 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989744 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989732 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47a6a3e2-7e77-4271-8268-6e923215052b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989783 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989751 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47a6a3e2-7e77-4271-8268-6e923215052b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:20.989783 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:20.989768 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.029314 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.029287 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pvmqk\"" Nov 04 04:52:21.090676 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.090651 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.090817 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.090687 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47a6a3e2-7e77-4271-8268-6e923215052b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.090817 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.090707 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmpq9\" (UniqueName: \"kubernetes.io/projected/47a6a3e2-7e77-4271-8268-6e923215052b-kube-api-access-rmpq9\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.090817 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.090750 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.090962 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.090935 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47a6a3e2-7e77-4271-8268-6e923215052b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091009 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.090983 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47a6a3e2-7e77-4271-8268-6e923215052b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091059 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091018 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091109 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091073 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091109 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091100 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091212 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091021 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091388 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091366 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091457 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091378 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091457 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091439 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.091613 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.091590 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47a6a3e2-7e77-4271-8268-6e923215052b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.093013 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.092992 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47a6a3e2-7e77-4271-8268-6e923215052b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.093501 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.093480 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47a6a3e2-7e77-4271-8268-6e923215052b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.148282 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.148261 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47a6a3e2-7e77-4271-8268-6e923215052b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.148523 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.148503 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmpq9\" (UniqueName: \"kubernetes.io/projected/47a6a3e2-7e77-4271-8268-6e923215052b-kube-api-access-rmpq9\") pod \"data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr\" (UID: \"47a6a3e2-7e77-4271-8268-6e923215052b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.294915 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.294889 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:21.487954 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:52:21.487914 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:52:21.746652 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.746626 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr"] Nov 04 04:52:21.748898 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:52:21.748870 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a6a3e2_7e77_4271_8268_6e923215052b.slice/crio-db728d456f519df8ef51d04c1ed2e8baf594a23a6822b77e653305e1d6a43b8d WatchSource:0}: Error finding container db728d456f519df8ef51d04c1ed2e8baf594a23a6822b77e653305e1d6a43b8d: Status 404 returned error can't find the container with id db728d456f519df8ef51d04c1ed2e8baf594a23a6822b77e653305e1d6a43b8d Nov 04 04:52:21.750809 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.750764 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:52:21.750874 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.750841 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:52:21.750874 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.750870 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:52:21.853951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.853921 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" event={"ID":"47a6a3e2-7e77-4271-8268-6e923215052b","Type":"ContainerStarted","Data":"a9a93e4044da475f1dfe8eaa958c8998d057b42e7c9db8d51c1cb4f9288e4848"} Nov 04 04:52:21.854082 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.853982 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" event={"ID":"47a6a3e2-7e77-4271-8268-6e923215052b","Type":"ContainerStarted","Data":"db728d456f519df8ef51d04c1ed2e8baf594a23a6822b77e653305e1d6a43b8d"} Nov 04 04:52:21.973954 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:21.973897 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" podStartSLOduration=1.973879521 podStartE2EDuration="1.973879521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:21.971249785 +0000 UTC m=+315.013664450" watchObservedRunningTime="2026-11-04 04:52:21.973879521 +0000 UTC m=+315.016294150" Nov 04 04:52:22.295260 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:22.295222 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:22.300006 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:22.299982 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:22.859558 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:22.859529 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:22.860509 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:22.860493 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr" Nov 04 04:52:39.037071 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.037036 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:52:39.046376 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.046350 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.097020 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.096991 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:52:39.103631 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.103612 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 04 04:52:39.134831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.134783 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file\") pod \"limitador-limitador-74dfcfb894-8mmkn\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.134831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.134829 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvnj2\" (UniqueName: \"kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2\") pod \"limitador-limitador-74dfcfb894-8mmkn\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.144881 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.144862 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m7cqj\"" Nov 04 04:52:39.235861 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.235834 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file\") pod \"limitador-limitador-74dfcfb894-8mmkn\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.235861 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.235868 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvnj2\" (UniqueName: \"kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2\") pod \"limitador-limitador-74dfcfb894-8mmkn\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.236498 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.236462 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file\") pod \"limitador-limitador-74dfcfb894-8mmkn\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.281434 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.281399 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:52:39.294496 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.294440 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvnj2\" (UniqueName: \"kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2\") pod \"limitador-limitador-74dfcfb894-8mmkn\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.360748 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.360717 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:39.735819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.735758 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:52:39.737841 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:52:39.737810 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ca7e3d_3444_4210_8f67_57711b35f5c4.slice/crio-76725295b32c74d375b31384ac62d3146e812eda3a943d96d3f7489bbe2a55b3 WatchSource:0}: Error finding container 76725295b32c74d375b31384ac62d3146e812eda3a943d96d3f7489bbe2a55b3: Status 404 returned error can't find the container with id 76725295b32c74d375b31384ac62d3146e812eda3a943d96d3f7489bbe2a55b3 Nov 04 04:52:39.739927 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.739907 5019 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:52:39.949930 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:39.949890 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" event={"ID":"19ca7e3d-3444-4210-8f67-57711b35f5c4","Type":"ContainerStarted","Data":"76725295b32c74d375b31384ac62d3146e812eda3a943d96d3f7489bbe2a55b3"} Nov 04 04:52:42.968028 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:42.967994 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" event={"ID":"19ca7e3d-3444-4210-8f67-57711b35f5c4","Type":"ContainerStarted","Data":"d507033b158d591b960a09ecd0eaddc165deb20834490e4867c770d58860869f"} Nov 04 04:52:42.968389 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:42.968054 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:43.084507 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.084452 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" podStartSLOduration=2.792062478 podStartE2EDuration="5.084439219s" totalImagesPullingTime="2.292376741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:43.08287556 +0000 UTC m=+336.125290188" watchObservedRunningTime="2026-11-04 04:52:43.084439219 +0000 UTC m=+336.126853847" Nov 04 04:52:43.535373 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.535339 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ds4th"] Nov 04 04:52:43.539096 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.539080 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:52:43.592197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.592156 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zfb5x\"" Nov 04 04:52:43.593095 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.593071 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ds4th"] Nov 04 04:52:43.677976 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.677943 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmkc2\" (UniqueName: \"kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2\") pod \"authorino-56c6c9ddd5-ds4th\" (UID: \"320f58d7-9aa2-47e5-8954-58f167d3cd0a\") " pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:52:43.779169 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.779141 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmkc2\" (UniqueName: \"kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2\") pod \"authorino-56c6c9ddd5-ds4th\" (UID: \"320f58d7-9aa2-47e5-8954-58f167d3cd0a\") " pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:52:43.836321 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.836275 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmkc2\" (UniqueName: \"kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2\") pod \"authorino-56c6c9ddd5-ds4th\" (UID: \"320f58d7-9aa2-47e5-8954-58f167d3cd0a\") " pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:52:43.864095 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:43.864072 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:52:44.234660 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:44.234639 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ds4th"] Nov 04 04:52:44.236631 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:52:44.236604 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod320f58d7_9aa2_47e5_8954_58f167d3cd0a.slice/crio-10b365d9259504eb11ec0dfc8210e7c9d112763ff8c972d0bc998dabe20695a7 WatchSource:0}: Error finding container 10b365d9259504eb11ec0dfc8210e7c9d112763ff8c972d0bc998dabe20695a7: Status 404 returned error can't find the container with id 10b365d9259504eb11ec0dfc8210e7c9d112763ff8c972d0bc998dabe20695a7 Nov 04 04:52:44.979021 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:44.978983 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" event={"ID":"320f58d7-9aa2-47e5-8954-58f167d3cd0a","Type":"ContainerStarted","Data":"10b365d9259504eb11ec0dfc8210e7c9d112763ff8c972d0bc998dabe20695a7"} Nov 04 04:52:46.992216 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:46.992183 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" event={"ID":"320f58d7-9aa2-47e5-8954-58f167d3cd0a","Type":"ContainerStarted","Data":"7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3"} Nov 04 04:52:47.106469 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:47.106423 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" podStartSLOduration=1.8262332209999999 podStartE2EDuration="4.106410305s" totalImagesPullingTime="2.280177084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:52:47.105649235 +0000 UTC m=+340.148064045" watchObservedRunningTime="2026-11-04 04:52:47.106410305 +0000 UTC m=+340.148824933" Nov 04 04:52:51.488457 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:52:51.488419 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:52:53.974683 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:53.974654 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:57.643551 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:57.643520 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:52:57.644025 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:57.643709 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" podUID="19ca7e3d-3444-4210-8f67-57711b35f5c4" containerName="limitador" containerID="cri-o://d507033b158d591b960a09ecd0eaddc165deb20834490e4867c770d58860869f" gracePeriod=30 Nov 04 04:52:58.052769 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.052741 5019 generic.go:356] "Generic (PLEG): container finished" podID="19ca7e3d-3444-4210-8f67-57711b35f5c4" containerID="d507033b158d591b960a09ecd0eaddc165deb20834490e4867c770d58860869f" exitCode=0 Nov 04 04:52:58.052921 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.052817 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" event={"ID":"19ca7e3d-3444-4210-8f67-57711b35f5c4","Type":"ContainerDied","Data":"d507033b158d591b960a09ecd0eaddc165deb20834490e4867c770d58860869f"} Nov 04 04:52:58.592197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.592173 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:58.701921 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.701897 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2\" (UniqueName: \"kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2\") pod \"19ca7e3d-3444-4210-8f67-57711b35f5c4\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " Nov 04 04:52:58.702263 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.701980 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file\" (UniqueName: \"kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file\") pod \"19ca7e3d-3444-4210-8f67-57711b35f5c4\" (UID: \"19ca7e3d-3444-4210-8f67-57711b35f5c4\") " Nov 04 04:52:58.702338 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.702316 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file" pod "19ca7e3d-3444-4210-8f67-57711b35f5c4" (UID: "19ca7e3d-3444-4210-8f67-57711b35f5c4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 04:52:58.703961 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.703939 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2" pod "19ca7e3d-3444-4210-8f67-57711b35f5c4" (UID: "19ca7e3d-3444-4210-8f67-57711b35f5c4"). InnerVolumeSpecName "kube-api-access-fvnj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:52:58.803150 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.803112 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvnj2\" (UniqueName: \"kubernetes.io/projected/19ca7e3d-3444-4210-8f67-57711b35f5c4-kube-api-access-fvnj2\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:52:58.803150 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:58.803146 5019 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/19ca7e3d-3444-4210-8f67-57711b35f5c4-config-file\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:52:59.059713 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:59.059686 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" Nov 04 04:52:59.059902 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:59.059716 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-8mmkn" event={"ID":"19ca7e3d-3444-4210-8f67-57711b35f5c4","Type":"ContainerDied","Data":"76725295b32c74d375b31384ac62d3146e812eda3a943d96d3f7489bbe2a55b3"} Nov 04 04:52:59.059902 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:59.059771 5019 scope.go:122] "RemoveContainer" containerID="d507033b158d591b960a09ecd0eaddc165deb20834490e4867c770d58860869f" Nov 04 04:52:59.225176 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:59.225146 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:52:59.228594 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:52:59.228569 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-8mmkn"] Nov 04 04:53:01.126947 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:01.124293 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="19ca7e3d-3444-4210-8f67-57711b35f5c4" path="/var/lib/kubelet/pods/19ca7e3d-3444-4210-8f67-57711b35f5c4/volumes" Nov 04 04:53:07.326861 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.326820 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg"] Nov 04 04:53:07.327383 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.327363 5019 cpu_manager.go:414] "containerMap: removing container" podUID="19ca7e3d-3444-4210-8f67-57711b35f5c4" containerName="limitador" Nov 04 04:53:07.327483 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.327386 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="19ca7e3d-3444-4210-8f67-57711b35f5c4" containerName="limitador" Nov 04 04:53:07.327536 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.327490 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="19ca7e3d-3444-4210-8f67-57711b35f5c4" containerName="limitador" Nov 04 04:53:07.331981 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.331960 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.376492 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.376458 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstld\" (UniqueName: \"kubernetes.io/projected/9551282a-aa21-4dc4-8cc5-1a968b4176a2-kube-api-access-fstld\") pod \"postgres-7cdbf6dc44-jnjqg\" (UID: \"9551282a-aa21-4dc4-8cc5-1a968b4176a2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.376637 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.376518 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9551282a-aa21-4dc4-8cc5-1a968b4176a2-data\") pod \"postgres-7cdbf6dc44-jnjqg\" (UID: \"9551282a-aa21-4dc4-8cc5-1a968b4176a2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.386186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.386161 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg"] Nov 04 04:53:07.434505 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.434430 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 04 04:53:07.434505 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.434452 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 04 04:53:07.472270 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.472238 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Nov 04 04:53:07.472436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.472354 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-d44wv\"" Nov 04 04:53:07.477773 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.477748 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9551282a-aa21-4dc4-8cc5-1a968b4176a2-data\") pod \"postgres-7cdbf6dc44-jnjqg\" (UID: \"9551282a-aa21-4dc4-8cc5-1a968b4176a2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.477912 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.477842 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstld\" (UniqueName: \"kubernetes.io/projected/9551282a-aa21-4dc4-8cc5-1a968b4176a2-kube-api-access-fstld\") pod \"postgres-7cdbf6dc44-jnjqg\" (UID: \"9551282a-aa21-4dc4-8cc5-1a968b4176a2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.478115 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.478098 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9551282a-aa21-4dc4-8cc5-1a968b4176a2-data\") pod \"postgres-7cdbf6dc44-jnjqg\" (UID: \"9551282a-aa21-4dc4-8cc5-1a968b4176a2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.535207 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.535183 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstld\" (UniqueName: \"kubernetes.io/projected/9551282a-aa21-4dc4-8cc5-1a968b4176a2-kube-api-access-fstld\") pod \"postgres-7cdbf6dc44-jnjqg\" (UID: \"9551282a-aa21-4dc4-8cc5-1a968b4176a2\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:07.644493 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:07.644461 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:08.013525 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:08.013503 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg"] Nov 04 04:53:08.015667 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:53:08.015645 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9551282a_aa21_4dc4_8cc5_1a968b4176a2.slice/crio-4fddb689559d37aceb86e132dd5946190b90f77c9584d30cf3cb1a5a9ccf43db WatchSource:0}: Error finding container 4fddb689559d37aceb86e132dd5946190b90f77c9584d30cf3cb1a5a9ccf43db: Status 404 returned error can't find the container with id 4fddb689559d37aceb86e132dd5946190b90f77c9584d30cf3cb1a5a9ccf43db Nov 04 04:53:08.107113 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:08.107076 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" event={"ID":"9551282a-aa21-4dc4-8cc5-1a968b4176a2","Type":"ContainerStarted","Data":"4fddb689559d37aceb86e132dd5946190b90f77c9584d30cf3cb1a5a9ccf43db"} Nov 04 04:53:15.147093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:15.147059 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" event={"ID":"9551282a-aa21-4dc4-8cc5-1a968b4176a2","Type":"ContainerStarted","Data":"d141e24fa3961c9fdeb7f1fbdaa2ce64ad994b3adea97eab90e227bd6b89cfe8"} Nov 04 04:53:15.147502 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:15.147234 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:15.288994 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:15.288947 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" podStartSLOduration=2.201101261 podStartE2EDuration="8.288934223s" totalImagesPullingTime="6.087832962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:15.286841475 +0000 UTC m=+368.329256096" watchObservedRunningTime="2026-11-04 04:53:15.288934223 +0000 UTC m=+368.331348851" Nov 04 04:53:21.181843 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:21.181813 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-jnjqg" Nov 04 04:53:21.488763 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:21.488681 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:53:28.328721 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.328689 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8b95c9c66-96rnk"] Nov 04 04:53:28.332405 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.332385 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.386026 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.386000 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Nov 04 04:53:28.386157 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.386043 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 04 04:53:28.436126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.436097 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Nov 04 04:53:28.436126 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.436110 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Nov 04 04:53:28.436298 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.436187 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 04 04:53:28.436348 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.436336 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4b7xd\"" Nov 04 04:53:28.438426 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.438407 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-96rnk"] Nov 04 04:53:28.462093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.462070 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.462184 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.462102 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vpwz\" (UniqueName: \"kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.462246 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.462226 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.563307 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.563285 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vpwz\" (UniqueName: \"kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.563436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.563397 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.563507 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.563442 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.566006 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.565986 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.566111 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.566022 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.620952 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.620897 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vpwz\" (UniqueName: \"kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz\") pod \"maas-controller-8b95c9c66-96rnk\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.644326 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.644305 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:28.766976 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.766936 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c56fdf97-qvkx4"] Nov 04 04:53:28.770661 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.770639 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.828417 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.828388 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c56fdf97-qvkx4"] Nov 04 04:53:28.865093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.865060 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hn9b\" (UniqueName: \"kubernetes.io/projected/71dc2299-718d-48c6-9fa4-c65c7e701a86-kube-api-access-2hn9b\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.865264 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.865098 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dc2299-718d-48c6-9fa4-c65c7e701a86-metrics-certs\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.865264 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.865199 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71dc2299-718d-48c6-9fa4-c65c7e701a86-webhook-cert\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.966739 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.966655 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hn9b\" (UniqueName: \"kubernetes.io/projected/71dc2299-718d-48c6-9fa4-c65c7e701a86-kube-api-access-2hn9b\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.966739 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.966693 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dc2299-718d-48c6-9fa4-c65c7e701a86-metrics-certs\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.966985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.966848 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71dc2299-718d-48c6-9fa4-c65c7e701a86-webhook-cert\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.969355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.969327 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71dc2299-718d-48c6-9fa4-c65c7e701a86-webhook-cert\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:28.969355 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:28.969354 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/71dc2299-718d-48c6-9fa4-c65c7e701a86-metrics-certs\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:29.025469 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:29.025443 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hn9b\" (UniqueName: \"kubernetes.io/projected/71dc2299-718d-48c6-9fa4-c65c7e701a86-kube-api-access-2hn9b\") pod \"maas-controller-c56fdf97-qvkx4\" (UID: \"71dc2299-718d-48c6-9fa4-c65c7e701a86\") " pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:29.033676 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:29.033656 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-96rnk"] Nov 04 04:53:29.035261 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:53:29.035236 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a61183a_0553_4388_b276_fae5e469205c.slice/crio-48ed0abbadbc63b910e86f9c94104350330b30d47218ad645422ce7b385ea0d4 WatchSource:0}: Error finding container 48ed0abbadbc63b910e86f9c94104350330b30d47218ad645422ce7b385ea0d4: Status 404 returned error can't find the container with id 48ed0abbadbc63b910e86f9c94104350330b30d47218ad645422ce7b385ea0d4 Nov 04 04:53:29.085610 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:29.085574 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:29.216706 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:29.216673 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-96rnk" event={"ID":"7a61183a-0553-4388-b276-fae5e469205c","Type":"ContainerStarted","Data":"48ed0abbadbc63b910e86f9c94104350330b30d47218ad645422ce7b385ea0d4"} Nov 04 04:53:29.459899 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:29.459866 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c56fdf97-qvkx4"] Nov 04 04:53:29.462649 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:53:29.462620 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dc2299_718d_48c6_9fa4_c65c7e701a86.slice/crio-76d54919026a6eac16390eed58be993cfd1b2e172dfeb9dd68df91cc0fb2da70 WatchSource:0}: Error finding container 76d54919026a6eac16390eed58be993cfd1b2e172dfeb9dd68df91cc0fb2da70: Status 404 returned error can't find the container with id 76d54919026a6eac16390eed58be993cfd1b2e172dfeb9dd68df91cc0fb2da70 Nov 04 04:53:30.224966 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:30.224928 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c56fdf97-qvkx4" event={"ID":"71dc2299-718d-48c6-9fa4-c65c7e701a86","Type":"ContainerStarted","Data":"76d54919026a6eac16390eed58be993cfd1b2e172dfeb9dd68df91cc0fb2da70"} Nov 04 04:53:33.244009 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:33.243969 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-96rnk" event={"ID":"7a61183a-0553-4388-b276-fae5e469205c","Type":"ContainerStarted","Data":"1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14"} Nov 04 04:53:33.244430 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:33.244081 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:33.245696 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:33.245668 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c56fdf97-qvkx4" event={"ID":"71dc2299-718d-48c6-9fa4-c65c7e701a86","Type":"ContainerStarted","Data":"be06d5eb452fe4e48be8a694c000263ae52063562eaf4e026ed407b9036fb3d4"} Nov 04 04:53:33.245835 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:33.245726 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:33.360750 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:33.360699 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-8b95c9c66-96rnk" podStartSLOduration=1.901234622 podStartE2EDuration="5.360682323s" totalImagesPullingTime="3.459447701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:33.359532062 +0000 UTC m=+386.401946690" watchObservedRunningTime="2026-11-04 04:53:33.360682323 +0000 UTC m=+386.403096952" Nov 04 04:53:33.476636 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:33.476585 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-c56fdf97-qvkx4" podStartSLOduration=2.332255173 podStartE2EDuration="5.476569458s" totalImagesPullingTime="3.144314285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:33.473551807 +0000 UTC m=+386.515966436" watchObservedRunningTime="2026-11-04 04:53:33.476569458 +0000 UTC m=+386.518984086" Nov 04 04:53:36.059616 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.059577 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d"] Nov 04 04:53:36.063403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.063382 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.120962 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.120931 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d"] Nov 04 04:53:36.136909 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.136880 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gdb5\" (UniqueName: \"kubernetes.io/projected/0345d91b-bdca-44a2-8c02-04f5f59289c6-kube-api-access-5gdb5\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.137100 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.136925 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.137100 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.137029 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0345d91b-bdca-44a2-8c02-04f5f59289c6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.137100 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.137074 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.168986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.168887 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Nov 04 04:53:36.168986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.168922 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Nov 04 04:53:36.168986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.168925 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Nov 04 04:53:36.168986 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.168974 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-tgv8q\"" Nov 04 04:53:36.238486 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.238454 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.238653 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.238630 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0345d91b-bdca-44a2-8c02-04f5f59289c6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.238726 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:36.238708 5019 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found Nov 04 04:53:36.238778 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.238723 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.238778 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:36.238776 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0345d91b-bdca-44a2-8c02-04f5f59289c6-tls-cert podName:0345d91b-bdca-44a2-8c02-04f5f59289c6 nodeName:}" failed. No retries permitted until 2026-11-04 04:53:36.738753624 +0000 UTC m=+389.781168230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/0345d91b-bdca-44a2-8c02-04f5f59289c6-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" (UID: "0345d91b-bdca-44a2-8c02-04f5f59289c6") : secret "usage-logs-tenancy-proxy-tls" not found Nov 04 04:53:36.238923 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:36.238811 5019 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found Nov 04 04:53:36.238923 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:36.238861 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-proxy-source podName:0345d91b-bdca-44a2-8c02-04f5f59289c6 nodeName:}" failed. No retries permitted until 2026-11-04 04:53:36.738844455 +0000 UTC m=+389.781259074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" (UID: "0345d91b-bdca-44a2-8c02-04f5f59289c6") : configmap "usage-tenancy-proxy-source" not found Nov 04 04:53:36.239026 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.238936 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gdb5\" (UniqueName: \"kubernetes.io/projected/0345d91b-bdca-44a2-8c02-04f5f59289c6-kube-api-access-5gdb5\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.239191 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.239173 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.298441 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.298408 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gdb5\" (UniqueName: \"kubernetes.io/projected/0345d91b-bdca-44a2-8c02-04f5f59289c6-kube-api-access-5gdb5\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.744484 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.744447 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.744660 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.744535 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0345d91b-bdca-44a2-8c02-04f5f59289c6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.745533 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.745506 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/0345d91b-bdca-44a2-8c02-04f5f59289c6-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.746970 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.746945 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0345d91b-bdca-44a2-8c02-04f5f59289c6-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-zvm6d\" (UID: \"0345d91b-bdca-44a2-8c02-04f5f59289c6\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:36.976556 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:36.976517 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:37.354978 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:37.354901 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d"] Nov 04 04:53:37.357232 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:53:37.357202 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0345d91b_bdca_44a2_8c02_04f5f59289c6.slice/crio-000f67cbce9eb156ccd1ef950bd1988a0500d2d75bba87789b4a011774bedc5d WatchSource:0}: Error finding container 000f67cbce9eb156ccd1ef950bd1988a0500d2d75bba87789b4a011774bedc5d: Status 404 returned error can't find the container with id 000f67cbce9eb156ccd1ef950bd1988a0500d2d75bba87789b4a011774bedc5d Nov 04 04:53:38.270960 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:38.270925 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" event={"ID":"0345d91b-bdca-44a2-8c02-04f5f59289c6","Type":"ContainerStarted","Data":"000f67cbce9eb156ccd1ef950bd1988a0500d2d75bba87789b4a011774bedc5d"} Nov 04 04:53:44.254696 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.254661 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:44.255737 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.255707 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:53:44.520432 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.519624 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-96rnk"] Nov 04 04:53:44.520432 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.519873 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-8b95c9c66-96rnk" podUID="7a61183a-0553-4388-b276-fae5e469205c" containerName="manager" containerID="cri-o://1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14" gracePeriod=30 Nov 04 04:53:44.807595 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.807557 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:44.848916 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.848881 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert\") pod \"7a61183a-0553-4388-b276-fae5e469205c\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " Nov 04 04:53:44.849131 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.848962 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs\") pod \"7a61183a-0553-4388-b276-fae5e469205c\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " Nov 04 04:53:44.851680 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.851643 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert" pod "7a61183a-0553-4388-b276-fae5e469205c" (UID: "7a61183a-0553-4388-b276-fae5e469205c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:53:44.851854 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.851819 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs" pod "7a61183a-0553-4388-b276-fae5e469205c" (UID: "7a61183a-0553-4388-b276-fae5e469205c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:53:44.949526 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.949495 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz\" (UniqueName: \"kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz\") pod \"7a61183a-0553-4388-b276-fae5e469205c\" (UID: \"7a61183a-0553-4388-b276-fae5e469205c\") " Nov 04 04:53:44.950014 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.949990 5019 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-webhook-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:53:44.950014 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.950015 5019 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a61183a-0553-4388-b276-fae5e469205c-metrics-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:53:44.952057 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:44.952020 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz" pod "7a61183a-0553-4388-b276-fae5e469205c" (UID: "7a61183a-0553-4388-b276-fae5e469205c"). InnerVolumeSpecName "kube-api-access-5vpwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:53:45.051334 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.051263 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vpwz\" (UniqueName: \"kubernetes.io/projected/7a61183a-0553-4388-b276-fae5e469205c-kube-api-access-5vpwz\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:53:45.319945 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.319859 5019 generic.go:356] "Generic (PLEG): container finished" podID="7a61183a-0553-4388-b276-fae5e469205c" containerID="1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14" exitCode=0 Nov 04 04:53:45.319945 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.319920 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8b95c9c66-96rnk" Nov 04 04:53:45.319945 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.319922 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-96rnk" event={"ID":"7a61183a-0553-4388-b276-fae5e469205c","Type":"ContainerDied","Data":"1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14"} Nov 04 04:53:45.320497 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.319994 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8b95c9c66-96rnk" event={"ID":"7a61183a-0553-4388-b276-fae5e469205c","Type":"ContainerDied","Data":"48ed0abbadbc63b910e86f9c94104350330b30d47218ad645422ce7b385ea0d4"} Nov 04 04:53:45.320497 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.320026 5019 scope.go:122] "RemoveContainer" containerID="1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14" Nov 04 04:53:45.330197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.330163 5019 scope.go:122] "RemoveContainer" containerID="1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14" Nov 04 04:53:45.330586 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:45.330559 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14\": container with ID starting with 1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14 not found: ID does not exist" containerID="1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14" Nov 04 04:53:45.330685 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.330596 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14"} err="failed to get container status \"1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14\": rpc error: code = NotFound desc = could not find container \"1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14\": container with ID starting with 1cb4574090913d27ebe7c8c4e3d1b372a8c84c0af3b3d4705fd19879121ddb14 not found: ID does not exist" Nov 04 04:53:45.485946 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.485909 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-96rnk"] Nov 04 04:53:45.489345 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:45.489313 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8b95c9c66-96rnk"] Nov 04 04:53:47.136089 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:47.136044 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a61183a-0553-4388-b276-fae5e469205c" path="/var/lib/kubelet/pods/7a61183a-0553-4388-b276-fae5e469205c/volumes" Nov 04 04:53:50.352385 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:50.352348 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" event={"ID":"0345d91b-bdca-44a2-8c02-04f5f59289c6","Type":"ContainerStarted","Data":"161d3f4d5dc6dc729d4ebdd1f8a0cfbf0f403bd77c9fc44511f3dd4eec3f1a3b"} Nov 04 04:53:50.352767 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:50.352491 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:53:50.467860 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:50.467813 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" podStartSLOduration=2.047906452 podStartE2EDuration="14.467782381s" totalImagesPullingTime="12.419875929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:50.466580775 +0000 UTC m=+403.508995403" watchObservedRunningTime="2026-11-04 04:53:50.467782381 +0000 UTC m=+403.510197008" Nov 04 04:53:51.009557 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.009521 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-rdlg7"] Nov 04 04:53:51.009983 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.009969 5019 cpu_manager.go:414] "containerMap: removing container" podUID="7a61183a-0553-4388-b276-fae5e469205c" containerName="manager" Nov 04 04:53:51.010031 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.009985 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7a61183a-0553-4388-b276-fae5e469205c" containerName="manager" Nov 04 04:53:51.010106 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.010089 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="7a61183a-0553-4388-b276-fae5e469205c" containerName="manager" Nov 04 04:53:51.013590 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.013567 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.067136 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.067098 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Nov 04 04:53:51.067294 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.067185 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kvsdq\"" Nov 04 04:53:51.069689 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.069661 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-rdlg7"] Nov 04 04:53:51.114912 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.114877 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xt9s\" (UniqueName: \"kubernetes.io/projected/b8971f37-5f49-410d-b2c0-27e3f2525cce-kube-api-access-7xt9s\") pod \"kserve-controller-manager-776cc66d47-rdlg7\" (UID: \"b8971f37-5f49-410d-b2c0-27e3f2525cce\") " pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.114912 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.114915 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8971f37-5f49-410d-b2c0-27e3f2525cce-cert\") pod \"kserve-controller-manager-776cc66d47-rdlg7\" (UID: \"b8971f37-5f49-410d-b2c0-27e3f2525cce\") " pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.123901 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.123876 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652"] Nov 04 04:53:51.127294 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.127279 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.180591 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.180551 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Nov 04 04:53:51.180591 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.180557 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vn7hh\"" Nov 04 04:53:51.183046 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.183019 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652"] Nov 04 04:53:51.215716 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.215687 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xt9s\" (UniqueName: \"kubernetes.io/projected/b8971f37-5f49-410d-b2c0-27e3f2525cce-kube-api-access-7xt9s\") pod \"kserve-controller-manager-776cc66d47-rdlg7\" (UID: \"b8971f37-5f49-410d-b2c0-27e3f2525cce\") " pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.215864 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.215726 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8971f37-5f49-410d-b2c0-27e3f2525cce-cert\") pod \"kserve-controller-manager-776cc66d47-rdlg7\" (UID: \"b8971f37-5f49-410d-b2c0-27e3f2525cce\") " pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.215864 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.215759 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-lq652\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.215864 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.215855 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4l7z\" (UniqueName: \"kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z\") pod \"llmisvc-controller-manager-869d5dcc5d-lq652\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.218223 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.218200 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8971f37-5f49-410d-b2c0-27e3f2525cce-cert\") pod \"kserve-controller-manager-776cc66d47-rdlg7\" (UID: \"b8971f37-5f49-410d-b2c0-27e3f2525cce\") " pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.272959 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.272885 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xt9s\" (UniqueName: \"kubernetes.io/projected/b8971f37-5f49-410d-b2c0-27e3f2525cce-kube-api-access-7xt9s\") pod \"kserve-controller-manager-776cc66d47-rdlg7\" (UID: \"b8971f37-5f49-410d-b2c0-27e3f2525cce\") " pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.316299 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.316267 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-lq652\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.316482 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.316327 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4l7z\" (UniqueName: \"kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z\") pod \"llmisvc-controller-manager-869d5dcc5d-lq652\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.319021 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.318993 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-lq652\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.326600 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.326580 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:51.373664 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.373631 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4l7z\" (UniqueName: \"kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z\") pod \"llmisvc-controller-manager-869d5dcc5d-lq652\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.440014 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.439981 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:51.491834 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:53:51.491281 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:53:51.700951 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.700924 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-rdlg7"] Nov 04 04:53:51.702786 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:53:51.702759 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8971f37_5f49_410d_b2c0_27e3f2525cce.slice/crio-550df68ab23721f1e008c5bf1adb07d4e595a10f3114e324a2c2563ff31957ae WatchSource:0}: Error finding container 550df68ab23721f1e008c5bf1adb07d4e595a10f3114e324a2c2563ff31957ae: Status 404 returned error can't find the container with id 550df68ab23721f1e008c5bf1adb07d4e595a10f3114e324a2c2563ff31957ae Nov 04 04:53:51.811443 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:51.811421 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652"] Nov 04 04:53:51.813267 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:53:51.813237 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod31d9133b_ac0d_43d0_821a_854170c3a7d7.slice/crio-b5c913249b16ba58ea1d5cfe43fee1b11f09fe2cb1b6739fcaab6b57dc51c5b6 WatchSource:0}: Error finding container b5c913249b16ba58ea1d5cfe43fee1b11f09fe2cb1b6739fcaab6b57dc51c5b6: Status 404 returned error can't find the container with id b5c913249b16ba58ea1d5cfe43fee1b11f09fe2cb1b6739fcaab6b57dc51c5b6 Nov 04 04:53:52.365056 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:52.365020 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" event={"ID":"31d9133b-ac0d-43d0-821a-854170c3a7d7","Type":"ContainerStarted","Data":"b5c913249b16ba58ea1d5cfe43fee1b11f09fe2cb1b6739fcaab6b57dc51c5b6"} Nov 04 04:53:52.366286 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:52.366262 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" event={"ID":"b8971f37-5f49-410d-b2c0-27e3f2525cce","Type":"ContainerStarted","Data":"550df68ab23721f1e008c5bf1adb07d4e595a10f3114e324a2c2563ff31957ae"} Nov 04 04:53:55.389186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:55.389087 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" event={"ID":"31d9133b-ac0d-43d0-821a-854170c3a7d7","Type":"ContainerStarted","Data":"a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67"} Nov 04 04:53:55.389186 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:55.389156 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:53:55.390710 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:55.390685 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" event={"ID":"b8971f37-5f49-410d-b2c0-27e3f2525cce","Type":"ContainerStarted","Data":"033cd0e18bf3d3feedb209c661d16dbc41bdf2c7219a712748c97693e4416f96"} Nov 04 04:53:55.390848 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:55.390833 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:53:55.505237 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:55.505186 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" podStartSLOduration=1.144398805 podStartE2EDuration="4.505171066s" totalImagesPullingTime="3.360772261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:55.503557692 +0000 UTC m=+408.545972320" watchObservedRunningTime="2026-11-04 04:53:55.505171066 +0000 UTC m=+408.547585691" Nov 04 04:53:55.619370 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:53:55.619318 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" podStartSLOduration=2.245509753 podStartE2EDuration="5.61930287s" totalImagesPullingTime="3.373793117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:53:55.617209359 +0000 UTC m=+408.659623987" watchObservedRunningTime="2026-11-04 04:53:55.61930287 +0000 UTC m=+408.661717497" Nov 04 04:54:01.364666 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:01.364638 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-zvm6d" Nov 04 04:54:17.833982 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:17.833946 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557cdd9f5b-bfq9d"] Nov 04 04:54:18.085074 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.084998 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557cdd9f5b-bfq9d"] Nov 04 04:54:18.085217 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.085104 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.137492 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.137466 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Nov 04 04:54:18.188568 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.188529 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert\") pod \"authorino-557cdd9f5b-bfq9d\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.188716 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.188668 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5npz\" (UniqueName: \"kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz\") pod \"authorino-557cdd9f5b-bfq9d\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.290129 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.290097 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5npz\" (UniqueName: \"kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz\") pod \"authorino-557cdd9f5b-bfq9d\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.290358 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.290183 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert\") pod \"authorino-557cdd9f5b-bfq9d\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.292722 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.292693 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert\") pod \"authorino-557cdd9f5b-bfq9d\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.347998 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.347929 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5npz\" (UniqueName: \"kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz\") pod \"authorino-557cdd9f5b-bfq9d\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.404721 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.404678 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:54:18.800094 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:18.800068 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557cdd9f5b-bfq9d"] Nov 04 04:54:18.801952 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:54:18.801923 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde6bab19_1440_4f81_abd1_0909a391e5f8.slice/crio-a183e04eaa6d3154b2d9867789eaac9833220cb939c67a41693f60c49fde7138 WatchSource:0}: Error finding container a183e04eaa6d3154b2d9867789eaac9833220cb939c67a41693f60c49fde7138: Status 404 returned error can't find the container with id a183e04eaa6d3154b2d9867789eaac9833220cb939c67a41693f60c49fde7138 Nov 04 04:54:19.525865 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:19.525827 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" event={"ID":"de6bab19-1440-4f81-abd1-0909a391e5f8","Type":"ContainerStarted","Data":"a183e04eaa6d3154b2d9867789eaac9833220cb939c67a41693f60c49fde7138"} Nov 04 04:54:20.533290 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.533261 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" event={"ID":"de6bab19-1440-4f81-abd1-0909a391e5f8","Type":"ContainerStarted","Data":"f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85"} Nov 04 04:54:20.535183 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.535156 5019 generic.go:356] "Generic (PLEG): container finished" podID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerID="c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7" exitCode=0 Nov 04 04:54:20.535280 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.535227 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" event={"ID":"c06e6d66-7580-4d6e-967f-47ee102ba0ad","Type":"ContainerDied","Data":"c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7"} Nov 04 04:54:20.535657 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.535634 5019 scope.go:122] "RemoveContainer" containerID="c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7" Nov 04 04:54:20.536759 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.536724 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:54:20.536902 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.536844 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:54:20.536902 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:20.536885 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:54:21.490741 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:54:21.490693 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:54:21.560819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:21.560061 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" event={"ID":"c06e6d66-7580-4d6e-967f-47ee102ba0ad","Type":"ContainerStarted","Data":"29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067"} Nov 04 04:54:21.680483 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:21.680346 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" podStartSLOduration=3.05669749 podStartE2EDuration="4.680330627s" totalImagesPullingTime="1.623633137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:54:21.677170213 +0000 UTC m=+434.719584842" watchObservedRunningTime="2026-11-04 04:54:21.680330627 +0000 UTC m=+434.722745289" Nov 04 04:54:21.758665 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:21.758632 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ds4th"] Nov 04 04:54:21.759120 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:21.759087 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" podUID="320f58d7-9aa2-47e5-8954-58f167d3cd0a" containerName="authorino" containerID="cri-o://7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3" gracePeriod=30 Nov 04 04:54:22.091882 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.091849 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:54:22.225464 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.225427 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2\" (UniqueName: \"kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2\") pod \"320f58d7-9aa2-47e5-8954-58f167d3cd0a\" (UID: \"320f58d7-9aa2-47e5-8954-58f167d3cd0a\") " Nov 04 04:54:22.253279 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.253232 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2" pod "320f58d7-9aa2-47e5-8954-58f167d3cd0a" (UID: "320f58d7-9aa2-47e5-8954-58f167d3cd0a"). InnerVolumeSpecName "kube-api-access-jmkc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:54:22.351903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.337336 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmkc2\" (UniqueName: \"kubernetes.io/projected/320f58d7-9aa2-47e5-8954-58f167d3cd0a-kube-api-access-jmkc2\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:54:22.351903 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.351486 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:54:22.352128 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.352031 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-tl7xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Nov 04 04:54:22.352128 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.352081 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Nov 04 04:54:22.566367 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.566335 5019 generic.go:356] "Generic (PLEG): container finished" podID="320f58d7-9aa2-47e5-8954-58f167d3cd0a" containerID="7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3" exitCode=0 Nov 04 04:54:22.566859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.566386 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" Nov 04 04:54:22.566859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.566408 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" event={"ID":"320f58d7-9aa2-47e5-8954-58f167d3cd0a","Type":"ContainerDied","Data":"7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3"} Nov 04 04:54:22.566859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.566461 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-ds4th" event={"ID":"320f58d7-9aa2-47e5-8954-58f167d3cd0a","Type":"ContainerDied","Data":"10b365d9259504eb11ec0dfc8210e7c9d112763ff8c972d0bc998dabe20695a7"} Nov 04 04:54:22.566859 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.566479 5019 scope.go:122] "RemoveContainer" containerID="7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3" Nov 04 04:54:22.575764 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.575750 5019 scope.go:122] "RemoveContainer" containerID="7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3" Nov 04 04:54:22.576064 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:54:22.576046 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3\": container with ID starting with 7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3 not found: ID does not exist" containerID="7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3" Nov 04 04:54:22.576108 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.576074 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3"} err="failed to get container status \"7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3\": rpc error: code = NotFound desc = could not find container \"7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3\": container with ID starting with 7246a6770e75bf31bb86c3ced5c5160e057172fe403b6ac259e599d72d6a69c3 not found: ID does not exist" Nov 04 04:54:22.751523 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.734503 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ds4th"] Nov 04 04:54:22.754165 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:22.754132 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-ds4th"] Nov 04 04:54:23.124373 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:23.124294 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="320f58d7-9aa2-47e5-8954-58f167d3cd0a" path="/var/lib/kubelet/pods/320f58d7-9aa2-47e5-8954-58f167d3cd0a/volumes" Nov 04 04:54:23.346839 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:23.346178 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-tl7xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Nov 04 04:54:23.346839 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:23.346264 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Nov 04 04:54:24.346831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:24.346161 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-tl7xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Nov 04 04:54:24.346831 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:24.346223 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Nov 04 04:54:25.349187 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:25.349152 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-tl7xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Nov 04 04:54:25.349763 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:25.349732 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Nov 04 04:54:26.343682 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:26.343646 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-tl7xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Nov 04 04:54:26.343884 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:26.343707 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Nov 04 04:54:26.398068 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:26.398035 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:54:26.401434 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:26.401412 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-rdlg7" Nov 04 04:54:27.347146 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:27.347114 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:54:27.347416 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:27.347380 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:54:27.348197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:54:27.348181 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 04:54:51.487496 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:54:51.487448 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:55:03.027449 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.027410 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8"] Nov 04 04:55:03.028058 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.028037 5019 cpu_manager.go:414] "containerMap: removing container" podUID="320f58d7-9aa2-47e5-8954-58f167d3cd0a" containerName="authorino" Nov 04 04:55:03.028146 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.028060 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="320f58d7-9aa2-47e5-8954-58f167d3cd0a" containerName="authorino" Nov 04 04:55:03.028202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.028180 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="320f58d7-9aa2-47e5-8954-58f167d3cd0a" containerName="authorino" Nov 04 04:55:03.031526 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.031506 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.072652 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.072621 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbvs\" (UniqueName: \"kubernetes.io/projected/d2027186-5958-40d2-8fd9-3e16393fbd0a-kube-api-access-qrbvs\") pod \"llmisvc-controller-manager-6466c554d8-vh4c8\" (UID: \"d2027186-5958-40d2-8fd9-3e16393fbd0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.072776 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.072758 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2027186-5958-40d2-8fd9-3e16393fbd0a-cert\") pod \"llmisvc-controller-manager-6466c554d8-vh4c8\" (UID: \"d2027186-5958-40d2-8fd9-3e16393fbd0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.088445 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.088426 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8"] Nov 04 04:55:03.173969 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.173941 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbvs\" (UniqueName: \"kubernetes.io/projected/d2027186-5958-40d2-8fd9-3e16393fbd0a-kube-api-access-qrbvs\") pod \"llmisvc-controller-manager-6466c554d8-vh4c8\" (UID: \"d2027186-5958-40d2-8fd9-3e16393fbd0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.174091 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.174042 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2027186-5958-40d2-8fd9-3e16393fbd0a-cert\") pod \"llmisvc-controller-manager-6466c554d8-vh4c8\" (UID: \"d2027186-5958-40d2-8fd9-3e16393fbd0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.176464 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.176446 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d2027186-5958-40d2-8fd9-3e16393fbd0a-cert\") pod \"llmisvc-controller-manager-6466c554d8-vh4c8\" (UID: \"d2027186-5958-40d2-8fd9-3e16393fbd0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.231527 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.231501 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbvs\" (UniqueName: \"kubernetes.io/projected/d2027186-5958-40d2-8fd9-3e16393fbd0a-kube-api-access-qrbvs\") pod \"llmisvc-controller-manager-6466c554d8-vh4c8\" (UID: \"d2027186-5958-40d2-8fd9-3e16393fbd0a\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.344173 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.344111 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:03.711929 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.711902 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8"] Nov 04 04:55:03.713894 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:55:03.713867 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2027186_5958_40d2_8fd9_3e16393fbd0a.slice/crio-838f8d366635e6fb006ca618c4cfa538c8423dc87c9e98f3b3d2b5a94d31598a WatchSource:0}: Error finding container 838f8d366635e6fb006ca618c4cfa538c8423dc87c9e98f3b3d2b5a94d31598a: Status 404 returned error can't find the container with id 838f8d366635e6fb006ca618c4cfa538c8423dc87c9e98f3b3d2b5a94d31598a Nov 04 04:55:03.781210 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:03.781184 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" event={"ID":"d2027186-5958-40d2-8fd9-3e16393fbd0a","Type":"ContainerStarted","Data":"838f8d366635e6fb006ca618c4cfa538c8423dc87c9e98f3b3d2b5a94d31598a"} Nov 04 04:55:04.787506 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:04.787469 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" event={"ID":"d2027186-5958-40d2-8fd9-3e16393fbd0a","Type":"ContainerStarted","Data":"83fe16949fbea314581f7ad40a1193968f6ca3ebe4a980391c08e019fdb03de6"} Nov 04 04:55:04.787998 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:04.787626 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:04.903565 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:04.903514 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" podStartSLOduration=2.163659865 podStartE2EDuration="2.903499832s" totalImagesPullingTime="739.839967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:55:04.902034805 +0000 UTC m=+477.944449432" watchObservedRunningTime="2026-11-04 04:55:04.903499832 +0000 UTC m=+477.945914459" Nov 04 04:55:21.487593 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:55:21.487503 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:55:35.794447 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:35.794418 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-vh4c8" Nov 04 04:55:35.961601 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:35.961564 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652"] Nov 04 04:55:35.961858 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:35.961831 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" podUID="31d9133b-ac0d-43d0-821a-854170c3a7d7" containerName="manager" containerID="cri-o://a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67" gracePeriod=30 Nov 04 04:55:36.204480 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.204456 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:55:36.374789 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.374715 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert\" (UniqueName: \"kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert\") pod \"31d9133b-ac0d-43d0-821a-854170c3a7d7\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " Nov 04 04:55:36.374789 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.374778 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z\" (UniqueName: \"kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z\") pod \"31d9133b-ac0d-43d0-821a-854170c3a7d7\" (UID: \"31d9133b-ac0d-43d0-821a-854170c3a7d7\") " Nov 04 04:55:36.376944 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.376908 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert" pod "31d9133b-ac0d-43d0-821a-854170c3a7d7" (UID: "31d9133b-ac0d-43d0-821a-854170c3a7d7"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:55:36.377059 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.377004 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z" pod "31d9133b-ac0d-43d0-821a-854170c3a7d7" (UID: "31d9133b-ac0d-43d0-821a-854170c3a7d7"). InnerVolumeSpecName "kube-api-access-d4l7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:55:36.476263 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.476232 5019 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/31d9133b-ac0d-43d0-821a-854170c3a7d7-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:55:36.476263 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.476259 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4l7z\" (UniqueName: \"kubernetes.io/projected/31d9133b-ac0d-43d0-821a-854170c3a7d7-kube-api-access-d4l7z\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:55:36.953720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.953685 5019 generic.go:356] "Generic (PLEG): container finished" podID="31d9133b-ac0d-43d0-821a-854170c3a7d7" containerID="a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67" exitCode=0 Nov 04 04:55:36.954209 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.953732 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" Nov 04 04:55:36.954209 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.953777 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" event={"ID":"31d9133b-ac0d-43d0-821a-854170c3a7d7","Type":"ContainerDied","Data":"a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67"} Nov 04 04:55:36.954209 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.953870 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652" event={"ID":"31d9133b-ac0d-43d0-821a-854170c3a7d7","Type":"ContainerDied","Data":"b5c913249b16ba58ea1d5cfe43fee1b11f09fe2cb1b6739fcaab6b57dc51c5b6"} Nov 04 04:55:36.954209 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.953905 5019 scope.go:122] "RemoveContainer" containerID="a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67" Nov 04 04:55:36.963501 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.963300 5019 scope.go:122] "RemoveContainer" containerID="a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67" Nov 04 04:55:36.963592 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:55:36.963573 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67\": container with ID starting with a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67 not found: ID does not exist" containerID="a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67" Nov 04 04:55:36.963630 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:36.963600 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67"} err="failed to get container status \"a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67\": rpc error: code = NotFound desc = could not find container \"a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67\": container with ID starting with a241219d0797ca10de6309d6df1586a52b7348f3c7b5272525a48b1c14e5fc67 not found: ID does not exist" Nov 04 04:55:37.126699 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:37.126666 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652"] Nov 04 04:55:37.126885 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:37.126721 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-lq652"] Nov 04 04:55:39.123687 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:55:39.123652 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31d9133b-ac0d-43d0-821a-854170c3a7d7" path="/var/lib/kubelet/pods/31d9133b-ac0d-43d0-821a-854170c3a7d7/volumes" Nov 04 04:55:51.487358 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:55:51.487318 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:56:01.099190 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:01.099142 5019 generic.go:356] "Generic (PLEG): container finished" podID="71dc2299-718d-48c6-9fa4-c65c7e701a86" containerID="be06d5eb452fe4e48be8a694c000263ae52063562eaf4e026ed407b9036fb3d4" exitCode=1 Nov 04 04:56:01.099734 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:01.099233 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c56fdf97-qvkx4" event={"ID":"71dc2299-718d-48c6-9fa4-c65c7e701a86","Type":"ContainerDied","Data":"be06d5eb452fe4e48be8a694c000263ae52063562eaf4e026ed407b9036fb3d4"} Nov 04 04:56:01.099734 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:01.099716 5019 scope.go:122] "RemoveContainer" containerID="be06d5eb452fe4e48be8a694c000263ae52063562eaf4e026ed407b9036fb3d4" Nov 04 04:56:02.106735 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:02.106699 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c56fdf97-qvkx4" event={"ID":"71dc2299-718d-48c6-9fa4-c65c7e701a86","Type":"ContainerStarted","Data":"05b4dfd49ad6e817e9e8f706411c4aa4e0de92661f75088319e46134cd1cd95a"} Nov 04 04:56:02.107197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:02.106931 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:56:13.114586 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:13.114553 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c56fdf97-qvkx4" Nov 04 04:56:21.489918 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:56:21.489876 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:56:46.619512 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.619449 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557cdd9f5b-bfq9d"] Nov 04 04:56:46.620069 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.619790 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" podUID="de6bab19-1440-4f81-abd1-0909a391e5f8" containerName="authorino" containerID="cri-o://f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85" gracePeriod=30 Nov 04 04:56:46.875374 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.875320 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:56:46.911597 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.911572 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert\" (UniqueName: \"kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert\") pod \"de6bab19-1440-4f81-abd1-0909a391e5f8\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " Nov 04 04:56:46.911715 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.911669 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz\" (UniqueName: \"kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz\") pod \"de6bab19-1440-4f81-abd1-0909a391e5f8\" (UID: \"de6bab19-1440-4f81-abd1-0909a391e5f8\") " Nov 04 04:56:46.913723 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.913693 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz" pod "de6bab19-1440-4f81-abd1-0909a391e5f8" (UID: "de6bab19-1440-4f81-abd1-0909a391e5f8"). InnerVolumeSpecName "kube-api-access-w5npz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 04:56:46.922383 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:46.922362 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert" pod "de6bab19-1440-4f81-abd1-0909a391e5f8" (UID: "de6bab19-1440-4f81-abd1-0909a391e5f8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 04:56:47.013197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.013168 5019 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de6bab19-1440-4f81-abd1-0909a391e5f8-tls-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:56:47.013197 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.013192 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5npz\" (UniqueName: \"kubernetes.io/projected/de6bab19-1440-4f81-abd1-0909a391e5f8-kube-api-access-w5npz\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 04:56:47.375947 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.375909 5019 generic.go:356] "Generic (PLEG): container finished" podID="de6bab19-1440-4f81-abd1-0909a391e5f8" containerID="f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85" exitCode=0 Nov 04 04:56:47.375947 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.375947 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" Nov 04 04:56:47.376202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.375951 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" event={"ID":"de6bab19-1440-4f81-abd1-0909a391e5f8","Type":"ContainerDied","Data":"f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85"} Nov 04 04:56:47.376202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.375992 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557cdd9f5b-bfq9d" event={"ID":"de6bab19-1440-4f81-abd1-0909a391e5f8","Type":"ContainerDied","Data":"a183e04eaa6d3154b2d9867789eaac9833220cb939c67a41693f60c49fde7138"} Nov 04 04:56:47.376202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.376008 5019 scope.go:122] "RemoveContainer" containerID="f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85" Nov 04 04:56:47.386089 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.386079 5019 scope.go:122] "RemoveContainer" containerID="f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85" Nov 04 04:56:47.386328 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:56:47.386299 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85\": container with ID starting with f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85 not found: ID does not exist" containerID="f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85" Nov 04 04:56:47.386403 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.386332 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85"} err="failed to get container status \"f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85\": rpc error: code = NotFound desc = could not find container \"f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85\": container with ID starting with f518ac0c2cd046abb99effd3aa27e7150ce2638e0dd682619d040767f4033b85 not found: ID does not exist" Nov 04 04:56:47.542085 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.542009 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557cdd9f5b-bfq9d"] Nov 04 04:56:47.545848 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:47.545819 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557cdd9f5b-bfq9d"] Nov 04 04:56:49.124749 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:56:49.124719 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de6bab19-1440-4f81-abd1-0909a391e5f8" path="/var/lib/kubelet/pods/de6bab19-1440-4f81-abd1-0909a391e5f8/volumes" Nov 04 04:56:51.488971 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:56:51.488935 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:57:07.183762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:07.183732 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:57:07.184789 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:07.184765 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 04:57:07.193232 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:07.193213 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:57:07.193742 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:07.193722 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 04:57:21.486961 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:57:21.486925 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:57:30.418933 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.418901 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9"] Nov 04 04:57:30.419622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.419356 5019 cpu_manager.go:414] "containerMap: removing container" podUID="de6bab19-1440-4f81-abd1-0909a391e5f8" containerName="authorino" Nov 04 04:57:30.419622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.419369 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de6bab19-1440-4f81-abd1-0909a391e5f8" containerName="authorino" Nov 04 04:57:30.419622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.419382 5019 cpu_manager.go:414] "containerMap: removing container" podUID="31d9133b-ac0d-43d0-821a-854170c3a7d7" containerName="manager" Nov 04 04:57:30.419622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.419387 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31d9133b-ac0d-43d0-821a-854170c3a7d7" containerName="manager" Nov 04 04:57:30.419622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.419454 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="de6bab19-1440-4f81-abd1-0909a391e5f8" containerName="authorino" Nov 04 04:57:30.419622 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.419462 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="31d9133b-ac0d-43d0-821a-854170c3a7d7" containerName="manager" Nov 04 04:57:30.422886 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.422871 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503069 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503034 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503069 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503068 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503277 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503092 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503277 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503149 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5fss\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503341 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503271 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503341 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503298 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503341 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503318 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503341 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503332 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.503458 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.503411 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.526415 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.526383 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9"] Nov 04 04:57:30.603956 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.603919 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.603956 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.603957 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.603978 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604001 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5fss\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604046 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604071 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604099 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604118 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604202 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604144 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604664 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604602 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604757 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604642 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604757 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604730 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.604895 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.604753 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.605384 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.605361 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.606762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.606741 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.606929 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.606902 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.661628 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.661597 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.661922 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.661900 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5fss\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss\") pod \"maas-default-gateway-openshift-default-6886b96f9-rl9f9\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:30.736993 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:30.736915 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:31.163315 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.163276 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9"] Nov 04 04:57:31.165608 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:57:31.165579 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd834832_a97c_4b3c_964e_cf1bfd6dde40.slice/crio-26921222743afb34fa501961d0047e435de10f45fdd9883c0d27ff1f8513a0e4 WatchSource:0}: Error finding container 26921222743afb34fa501961d0047e435de10f45fdd9883c0d27ff1f8513a0e4: Status 404 returned error can't find the container with id 26921222743afb34fa501961d0047e435de10f45fdd9883c0d27ff1f8513a0e4 Nov 04 04:57:31.167782 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.167750 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:57:31.167891 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.167857 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:57:31.167930 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.167892 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:57:31.635363 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.635314 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" event={"ID":"bd834832-a97c-4b3c-964e-cf1bfd6dde40","Type":"ContainerStarted","Data":"274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f"} Nov 04 04:57:31.636144 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.636114 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" event={"ID":"bd834832-a97c-4b3c-964e-cf1bfd6dde40","Type":"ContainerStarted","Data":"26921222743afb34fa501961d0047e435de10f45fdd9883c0d27ff1f8513a0e4"} Nov 04 04:57:31.740936 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:31.740892 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:32.751514 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:32.751475 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-rl9f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 04 04:57:32.751939 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:32.751530 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 04 04:57:33.750818 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:33.747245 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-rl9f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 04 04:57:33.750818 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:33.747308 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 04 04:57:34.741276 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:34.741231 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-rl9f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 04 04:57:34.741911 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:34.741875 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 04 04:57:35.746820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:35.746110 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-rl9f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 04 04:57:35.746820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:35.746185 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 04 04:57:36.743119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:36.743085 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-rl9f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 04 04:57:36.743409 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:36.743380 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 04 04:57:37.737594 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:37.737554 5019 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6886b96f9-rl9f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Nov 04 04:57:37.738044 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:37.737625 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Nov 04 04:57:39.504015 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:39.503979 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:39.504530 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:39.504281 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:39.505100 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:39.505076 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 04:57:39.675667 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:57:39.675606 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podStartSLOduration=9.675592082 podStartE2EDuration="9.675592082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:57:31.756174829 +0000 UTC m=+624.798589457" watchObservedRunningTime="2026-11-04 04:57:39.675592082 +0000 UTC m=+632.718006709" Nov 04 04:57:51.486977 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:57:51.486940 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:58:19.022778 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.022695 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9"] Nov 04 04:58:19.026743 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.026723 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.108324 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.108286 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9"] Nov 04 04:58:19.132875 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.132849 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-3eb31c-openshift-default-dockercfg-bscg9\"" Nov 04 04:58:19.164905 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.164871 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165064 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.164940 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165064 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165011 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165193 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165079 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165193 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165105 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47ns2\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165193 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165168 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165337 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165191 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165337 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165216 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.165337 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.165247 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.266782 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266726 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.266985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266825 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.266985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266855 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.266985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266882 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.266985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266907 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47ns2\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.266985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266966 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267262 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.266994 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267262 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267021 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267262 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267053 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267262 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267177 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267520 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267497 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267651 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267627 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267707 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267684 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.267780 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.267760 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.269512 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.269485 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.269784 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.269766 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.333277 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.333207 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.333414 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.333363 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47ns2\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.339311 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.339287 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:19.342243 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.342218 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt"] Nov 04 04:58:19.345738 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.345720 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.404244 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.399212 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-dab70d-openshift-default-dockercfg-852vc\"" Nov 04 04:58:19.411077 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.411044 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt"] Nov 04 04:58:19.469694 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.469662 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.469867 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.469718 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.469988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.469872 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.469988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.469909 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.469988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.469934 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.469988 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.469982 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.470144 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.470080 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.470144 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.470134 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m899z\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.470225 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.470166 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571000 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.570963 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571014 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571049 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571063 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571078 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571095 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571207 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571258 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m899z\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571297 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571528 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571633 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.571720 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571648 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.572155 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571727 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.572155 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.571984 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.573437 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.573416 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.573701 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.573682 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.628245 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.628170 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.628378 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.628317 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m899z\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z\") pod \"e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.670330 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.670291 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:19.794873 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.794843 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9"] Nov 04 04:58:19.796555 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:58:19.796531 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11afcd86_31bf_42e7_b91b_f9385c1fa27c.slice/crio-e95b15243b0572a94c070075be78f6a0125907370d83a6c775a9d96acd29fb8c WatchSource:0}: Error finding container e95b15243b0572a94c070075be78f6a0125907370d83a6c775a9d96acd29fb8c: Status 404 returned error can't find the container with id e95b15243b0572a94c070075be78f6a0125907370d83a6c775a9d96acd29fb8c Nov 04 04:58:19.798921 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.798880 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:19.799012 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.798968 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:19.799052 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.799011 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:19.897866 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.897763 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" event={"ID":"11afcd86-31bf-42e7-b91b-f9385c1fa27c","Type":"ContainerStarted","Data":"ee9ff255e278408b0548c8d1d999ba27ff644fd3062ba474590f5fe1d0836df6"} Nov 04 04:58:19.897866 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:19.897846 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" event={"ID":"11afcd86-31bf-42e7-b91b-f9385c1fa27c","Type":"ContainerStarted","Data":"e95b15243b0572a94c070075be78f6a0125907370d83a6c775a9d96acd29fb8c"} Nov 04 04:58:20.016485 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.016425 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podStartSLOduration=2.016409883 podStartE2EDuration="2.016409883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:58:20.015075056 +0000 UTC m=+673.057489684" watchObservedRunningTime="2026-11-04 04:58:20.016409883 +0000 UTC m=+673.058824511" Nov 04 04:58:20.050000 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.049974 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt"] Nov 04 04:58:20.052373 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:58:20.052346 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e925ba9_f57c_43d4_854b_9edfadd060e9.slice/crio-780067f28837f329d4af3cf3ae3ee84cd6548e49f78143177b6de080be6771f7 WatchSource:0}: Error finding container 780067f28837f329d4af3cf3ae3ee84cd6548e49f78143177b6de080be6771f7: Status 404 returned error can't find the container with id 780067f28837f329d4af3cf3ae3ee84cd6548e49f78143177b6de080be6771f7 Nov 04 04:58:20.054475 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.054444 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:20.054592 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.054515 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:20.054592 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.054561 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:20.339884 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.339837 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:20.345725 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.345696 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:20.905234 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.905198 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" event={"ID":"2e925ba9-f57c-43d4-854b-9edfadd060e9","Type":"ContainerStarted","Data":"2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16"} Nov 04 04:58:20.905408 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.905260 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" event={"ID":"2e925ba9-f57c-43d4-854b-9edfadd060e9","Type":"ContainerStarted","Data":"780067f28837f329d4af3cf3ae3ee84cd6548e49f78143177b6de080be6771f7"} Nov 04 04:58:20.905532 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.905513 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:20.906353 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:20.906338 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:21.025827 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:21.025760 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podStartSLOduration=2.025746083 podStartE2EDuration="2.025746083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:58:21.02348325 +0000 UTC m=+674.065897913" watchObservedRunningTime="2026-11-04 04:58:21.025746083 +0000 UTC m=+674.068160707" Nov 04 04:58:21.488752 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:58:21.488716 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:58:21.670970 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:21.670938 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:21.676132 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:21.676106 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:21.911724 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:21.911684 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:21.912468 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:21.912450 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:58:50.230259 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.230220 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f"] Nov 04 04:58:50.235544 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.235521 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.289650 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.289622 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f"] Nov 04 04:58:50.337070 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.337029 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-370078-serving-cert\"" Nov 04 04:58:50.337070 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.337042 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5n9fx\"" Nov 04 04:58:50.337070 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.337070 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 04 04:58:50.392783 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.392740 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.392985 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.392829 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.393054 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.393002 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.393173 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.393148 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jhc\" (UniqueName: \"kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.494813 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.494757 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.495018 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.494851 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.495018 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:58:50.494957 5019 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-serving-cert: secret "maas-api-e2e-worker-w2-370078-serving-cert" not found Nov 04 04:58:50.495156 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.494958 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.495227 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:58:50.495169 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls podName:0e4c143d-58c9-4b91-9f83-b7cd55fca53b nodeName:}" failed. No retries permitted until 2026-11-04 04:58:50.99514592 +0000 UTC m=+704.037560540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls") pod "maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" (UID: "0e4c143d-58c9-4b91-9f83-b7cd55fca53b") : secret "maas-api-e2e-worker-w2-370078-serving-cert" not found Nov 04 04:58:50.495300 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.495263 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jhc\" (UniqueName: \"kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.495824 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.495781 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.498561 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.498538 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.556999 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.556970 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jhc\" (UniqueName: \"kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:50.906809 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.906758 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 04:58:50.907042 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:50.906839 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 04:58:51.001019 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.000985 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:51.003650 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.003585 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\") pod \"maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:51.098366 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.098334 5019 generic.go:356] "Generic (PLEG): container finished" podID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerID="ee9ff255e278408b0548c8d1d999ba27ff644fd3062ba474590f5fe1d0836df6" exitCode=0 Nov 04 04:58:51.098543 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.098418 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" event={"ID":"11afcd86-31bf-42e7-b91b-f9385c1fa27c","Type":"ContainerDied","Data":"ee9ff255e278408b0548c8d1d999ba27ff644fd3062ba474590f5fe1d0836df6"} Nov 04 04:58:51.098842 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.098829 5019 scope.go:122] "RemoveContainer" containerID="ee9ff255e278408b0548c8d1d999ba27ff644fd3062ba474590f5fe1d0836df6" Nov 04 04:58:51.100292 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.100257 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:51.100410 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.100331 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:51.100410 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.100365 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:58:51.148717 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.148696 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:51.489478 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:58:51.489399 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:58:51.541721 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.541691 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f"] Nov 04 04:58:51.542406 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:58:51.542384 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4c143d_58c9_4b91_9f83_b7cd55fca53b.slice/crio-d2b2d5f1d5e9e1438d312854489cc1f9f1be4998b97fb13f1b2ff75cf661dc63 WatchSource:0}: Error finding container d2b2d5f1d5e9e1438d312854489cc1f9f1be4998b97fb13f1b2ff75cf661dc63: Status 404 returned error can't find the container with id d2b2d5f1d5e9e1438d312854489cc1f9f1be4998b97fb13f1b2ff75cf661dc63 Nov 04 04:58:51.544306 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:51.544284 5019 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 04 04:58:52.106059 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:52.105975 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" event={"ID":"11afcd86-31bf-42e7-b91b-f9385c1fa27c","Type":"ContainerStarted","Data":"9ca4d2436f62ab717db1200fa49b17dfc24699a558a09bb7dbff627c672a3f88"} Nov 04 04:58:52.107258 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:52.107206 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" event={"ID":"0e4c143d-58c9-4b91-9f83-b7cd55fca53b","Type":"ContainerStarted","Data":"d2b2d5f1d5e9e1438d312854489cc1f9f1be4998b97fb13f1b2ff75cf661dc63"} Nov 04 04:58:52.346820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:52.346210 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:52.346820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:52.346343 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 04:58:52.346820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:52.346386 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 04:58:53.351411 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:53.351222 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 04:58:53.351411 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:53.351281 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 04:58:54.120783 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:54.120684 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" event={"ID":"0e4c143d-58c9-4b91-9f83-b7cd55fca53b","Type":"ContainerStarted","Data":"49d7f1c53bad6bf2c22c60307fc2068458da967b6b084a7d4121fb00289b1bae"} Nov 04 04:58:54.120783 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:54.120774 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:58:54.247819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:54.242561 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" podStartSLOduration=1.980162477 podStartE2EDuration="4.242543302s" totalImagesPullingTime="2.262380825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:58:54.240393293 +0000 UTC m=+707.282807922" watchObservedRunningTime="2026-11-04 04:58:54.242543302 +0000 UTC m=+707.284957931" Nov 04 04:58:54.341270 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:54.341231 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 04:58:54.341542 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:54.341514 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 04:58:55.341819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:55.341212 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 04:58:55.341819 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:55.341276 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 04:58:56.341225 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:56.341185 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 04 04:58:56.341512 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:56.341483 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 04 04:58:57.344337 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:57.344306 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:57.344753 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:57.344672 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:58:57.345574 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:58:57.345555 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 04:59:00.132655 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.132627 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 04:59:00.238836 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.238786 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s"] Nov 04 04:59:00.241327 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.241310 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.273335 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.273301 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s"] Nov 04 04:59:00.294346 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.294318 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-0aae2f-serving-cert\"" Nov 04 04:59:00.319965 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.319930 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.320169 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.319971 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.320169 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.320067 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.320273 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.320216 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx47f\" (UniqueName: \"kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.420832 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.420712 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx47f\" (UniqueName: \"kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.420832 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.420829 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.421092 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.420867 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.421092 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.420905 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.421092 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:59:00.421071 5019 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-serving-cert: secret "maas-api-e2e-worker-w0-0aae2f-serving-cert" not found Nov 04 04:59:00.421234 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:59:00.421144 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls podName:d21b0425-f11f-49b4-9fbd-16f131c603f8 nodeName:}" failed. No retries permitted until 2026-11-04 04:59:00.921124387 +0000 UTC m=+713.963539007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls") pod "maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" (UID: "d21b0425-f11f-49b4-9fbd-16f131c603f8") : secret "maas-api-e2e-worker-w0-0aae2f-serving-cert" not found Nov 04 04:59:00.421658 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.421639 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.423469 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.423451 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.481007 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.480977 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx47f\" (UniqueName: \"kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.924778 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.924743 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:00.927364 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:00.927326 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:01.153456 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:01.153424 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:01.529503 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:01.529474 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s"] Nov 04 04:59:01.534533 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:59:01.534500 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21b0425_f11f_49b4_9fbd_16f131c603f8.slice/crio-1f8f9f026b46c91a6fee0159f69ca7fbb6dc5fcd22dad8cc322fa76329dd7bb3 WatchSource:0}: Error finding container 1f8f9f026b46c91a6fee0159f69ca7fbb6dc5fcd22dad8cc322fa76329dd7bb3: Status 404 returned error can't find the container with id 1f8f9f026b46c91a6fee0159f69ca7fbb6dc5fcd22dad8cc322fa76329dd7bb3 Nov 04 04:59:02.193706 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:02.193671 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" event={"ID":"d21b0425-f11f-49b4-9fbd-16f131c603f8","Type":"ContainerStarted","Data":"1f8f9f026b46c91a6fee0159f69ca7fbb6dc5fcd22dad8cc322fa76329dd7bb3"} Nov 04 04:59:03.201007 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:03.200963 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" event={"ID":"d21b0425-f11f-49b4-9fbd-16f131c603f8","Type":"ContainerStarted","Data":"6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca"} Nov 04 04:59:03.201516 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:03.201214 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:03.318179 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:03.318117 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" podStartSLOduration=2.375198766 podStartE2EDuration="3.318096663s" totalImagesPullingTime="942.897897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:59:03.3161159 +0000 UTC m=+716.358530528" watchObservedRunningTime="2026-11-04 04:59:03.318096663 +0000 UTC m=+716.360511291" Nov 04 04:59:07.903119 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.903083 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm"] Nov 04 04:59:07.907687 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.907662 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:07.981529 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.981500 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm"] Nov 04 04:59:07.992489 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.992459 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:07.992650 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.992507 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pc99\" (UniqueName: \"kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:07.992650 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.992587 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:07.992722 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.992695 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:07.992754 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.992741 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:07.992861 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:07.992845 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.012227 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.012202 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-3eb31c\"/\"openshift-service-ca.crt\"" Nov 04 04:59:08.012436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.012412 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-3eb31c\"/\"simulator-w4-3eb31c-kserve-self-signed-certs\"" Nov 04 04:59:08.012436 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.012432 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-3eb31c\"/\"default-dockercfg-pb6qn\"" Nov 04 04:59:08.012605 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.012493 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-3eb31c\"/\"kube-root-ca.crt\"" Nov 04 04:59:08.094381 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094350 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.094561 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094399 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pc99\" (UniqueName: \"kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.094561 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094453 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.094561 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094516 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.094561 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094556 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.094785 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094590 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.094970 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094946 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.095033 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.094964 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.095073 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.095035 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.096886 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.096861 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.097101 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.097083 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.152780 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.152748 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pc99\" (UniqueName: \"kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99\") pod \"simulator-w4-3eb31c-kserve-664568bbc8-gk9tm\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.236964 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.236861 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:08.617071 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:08.617043 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm"] Nov 04 04:59:08.618987 ip-10-0-135-45 kubenswrapper[5019]: W1104 04:59:08.618961 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod662860ba_2989_452d_a824_06008cd34c4b.slice/crio-b6979b4e7f1725c418af5c44d8bf8f6b1e155d55a426f4a8e4674d2e720aa4e1 WatchSource:0}: Error finding container b6979b4e7f1725c418af5c44d8bf8f6b1e155d55a426f4a8e4674d2e720aa4e1: Status 404 returned error can't find the container with id b6979b4e7f1725c418af5c44d8bf8f6b1e155d55a426f4a8e4674d2e720aa4e1 Nov 04 04:59:09.211328 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:09.211300 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 04:59:09.233337 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:09.233304 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" event={"ID":"662860ba-2989-452d-a824-06008cd34c4b","Type":"ContainerStarted","Data":"b6979b4e7f1725c418af5c44d8bf8f6b1e155d55a426f4a8e4674d2e720aa4e1"} Nov 04 04:59:10.634003 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.633967 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5"] Nov 04 04:59:10.638205 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.638181 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.672375 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.672343 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5"] Nov 04 04:59:10.693272 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.693239 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-dab70d-serving-cert\"" Nov 04 04:59:10.723808 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.723763 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksn86\" (UniqueName: \"kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.723981 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.723958 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.724054 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.724009 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.724093 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.724059 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.825559 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.825473 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.825559 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.825521 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.825820 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:59:10.825605 5019 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-serving-cert: secret "maas-api-e2e-worker-w3-dab70d-serving-cert" not found Nov 04 04:59:10.825820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.825649 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.825820 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:59:10.825661 5019 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls podName:b69168a5-22ba-45d3-9c86-86de637096f4 nodeName:}" failed. No retries permitted until 2026-11-04 04:59:11.325645498 +0000 UTC m=+724.368060117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls") pod "maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" (UID: "b69168a5-22ba-45d3-9c86-86de637096f4") : secret "maas-api-e2e-worker-w3-dab70d-serving-cert" not found Nov 04 04:59:10.825820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.825738 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksn86\" (UniqueName: \"kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.826397 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.826311 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.828064 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.828044 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:10.884011 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:10.883972 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksn86\" (UniqueName: \"kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:11.248749 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:11.248711 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" event={"ID":"662860ba-2989-452d-a824-06008cd34c4b","Type":"ContainerStarted","Data":"44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6"} Nov 04 04:59:11.330866 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:11.330830 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:11.333461 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:11.333430 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\") pod \"maas-api-e2e-worker-w3-dab70d-775546c756-pzts5\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:11.364741 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:11.364689 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" podStartSLOduration=2.460659191 podStartE2EDuration="4.36467462s" totalImagesPullingTime="1.904015429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:59:11.363697744 +0000 UTC m=+724.406112372" watchObservedRunningTime="2026-11-04 04:59:11.36467462 +0000 UTC m=+724.407089247" Nov 04 04:59:11.553449 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:11.553357 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:11.939820 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:11.932902 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5"] Nov 04 04:59:12.237603 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:12.237504 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:12.257070 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:12.257023 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" event={"ID":"b69168a5-22ba-45d3-9c86-86de637096f4","Type":"ContainerStarted","Data":"a8f99dd4117ad73ece37d1d527cc2153e3220e592ce7dde6b4b189cc9689bd08"} Nov 04 04:59:13.264285 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:13.264247 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" event={"ID":"b69168a5-22ba-45d3-9c86-86de637096f4","Type":"ContainerStarted","Data":"bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4"} Nov 04 04:59:13.264762 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:13.264395 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:13.379365 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:13.379314 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" podStartSLOduration=2.554436011 podStartE2EDuration="3.379300249s" totalImagesPullingTime="824.864238ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 04:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 04:59:13.377170125 +0000 UTC m=+726.419584754" watchObservedRunningTime="2026-11-04 04:59:13.379300249 +0000 UTC m=+726.421714876" Nov 04 04:59:18.238140 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:18.238102 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:18.250962 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:18.250937 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:18.303358 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:18.303329 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 04:59:19.276682 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:19.276653 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 04:59:21.488438 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:59:21.488400 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 04:59:31.389506 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:31.389469 5019 generic.go:356] "Generic (PLEG): container finished" podID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerID="2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16" exitCode=0 Nov 04 04:59:31.389975 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:31.389527 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" event={"ID":"2e925ba9-f57c-43d4-854b-9edfadd060e9","Type":"ContainerDied","Data":"2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16"} Nov 04 04:59:31.389975 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:31.389936 5019 scope.go:122] "RemoveContainer" containerID="2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16" Nov 04 04:59:31.391306 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:31.391277 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:59:31.391407 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:31.391347 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:59:31.391407 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:31.391389 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 04:59:32.397389 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:32.397351 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" event={"ID":"2e925ba9-f57c-43d4-854b-9edfadd060e9","Type":"ContainerStarted","Data":"25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3"} Nov 04 04:59:32.671581 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:32.671491 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:59:32.672861 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:32.672840 5019 patch_prober.go:29] interesting pod/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 04:59:32.672930 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:32.672898 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 04:59:33.671633 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:33.671600 5019 patch_prober.go:29] interesting pod/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 04:59:33.672063 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:33.671656 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 04:59:34.671594 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:34.671556 5019 patch_prober.go:29] interesting pod/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 04:59:34.671825 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:34.671615 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 04:59:35.671036 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:35.671002 5019 patch_prober.go:29] interesting pod/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 04:59:35.671223 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:35.671066 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 04:59:36.671625 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:36.671585 5019 patch_prober.go:29] interesting pod/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 04 04:59:36.672157 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:36.671649 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 04 04:59:36.912247 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:36.912206 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:59:37.676381 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:37.676346 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:59:37.677448 ip-10-0-135-45 kubenswrapper[5019]: I1104 04:59:37.677424 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 04:59:51.490374 ip-10-0-135-45 kubenswrapper[5019]: E1104 04:59:51.490279 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:00:00.194946 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.194910 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b"] Nov 04 05:00:00.199124 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.199097 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.208863 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.208838 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9"] Nov 04 05:00:00.212269 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.212250 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.217334 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.217310 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl"] Nov 04 05:00:00.221019 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.221002 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.285078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.285049 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krgvj\"" Nov 04 05:00:00.320111 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.320078 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b"] Nov 04 05:00:00.323611 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.323581 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9"] Nov 04 05:00:00.329286 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.329261 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkn8g\" (UniqueName: \"kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g\") pod \"maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.329417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.329322 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjndx\" (UniqueName: \"kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx\") pod \"maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.329472 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.329435 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.329556 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.329539 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.329613 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.329587 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5h6r\" (UniqueName: \"kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r\") pod \"maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.329658 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.329627 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.374468 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.374430 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl"] Nov 04 05:00:00.431227 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.431186 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.431417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.431234 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.431417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.431258 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5h6r\" (UniqueName: \"kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r\") pod \"maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.431417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.431286 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.431417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.431330 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkn8g\" (UniqueName: \"kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g\") pod \"maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.431417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.431407 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjndx\" (UniqueName: \"kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx\") pod \"maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.432131 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.432101 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.432235 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.432189 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.432276 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.432234 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.489021 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.488943 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5h6r\" (UniqueName: \"kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r\") pod \"maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.489347 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.489322 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkn8g\" (UniqueName: \"kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g\") pod \"maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.489416 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.489324 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjndx\" (UniqueName: \"kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx\") pod \"maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.515848 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.514985 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:00.527664 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.527023 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:00.538027 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.537989 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:00.920526 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.920489 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b"] Nov 04 05:00:00.935285 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:00:00.935253 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb65ec4_dc02_4813_baed_53c54f57d70a.slice/crio-41d64eea536f76dfffbff6a1ee91407a376d6126c41a0bab7c935b95c8c2b9dc WatchSource:0}: Error finding container 41d64eea536f76dfffbff6a1ee91407a376d6126c41a0bab7c935b95c8c2b9dc: Status 404 returned error can't find the container with id 41d64eea536f76dfffbff6a1ee91407a376d6126c41a0bab7c935b95c8c2b9dc Nov 04 05:00:00.975549 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:00:00.975521 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd99805d_39a2_4073_942e_9e0388cd787e.slice/crio-16ad357272ac35f0e99eec49beee3a973a3f09da7f739be62ead04507256d7f7 WatchSource:0}: Error finding container 16ad357272ac35f0e99eec49beee3a973a3f09da7f739be62ead04507256d7f7: Status 404 returned error can't find the container with id 16ad357272ac35f0e99eec49beee3a973a3f09da7f739be62ead04507256d7f7 Nov 04 05:00:00.976568 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.976544 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl"] Nov 04 05:00:00.976938 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:00:00.976918 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87baa5d9_57dc_4f38_b69b_2126c65f1cee.slice/crio-475bef23a3fca1318a8f329cd841cbf55cbe321dbdbb9eabdde08722dc9faade WatchSource:0}: Error finding container 475bef23a3fca1318a8f329cd841cbf55cbe321dbdbb9eabdde08722dc9faade: Status 404 returned error can't find the container with id 475bef23a3fca1318a8f329cd841cbf55cbe321dbdbb9eabdde08722dc9faade Nov 04 05:00:00.979704 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:00.979681 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9"] Nov 04 05:00:01.577790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:01.577749 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerStarted","Data":"41d64eea536f76dfffbff6a1ee91407a376d6126c41a0bab7c935b95c8c2b9dc"} Nov 04 05:00:01.579018 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:01.578993 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerStarted","Data":"16ad357272ac35f0e99eec49beee3a973a3f09da7f739be62ead04507256d7f7"} Nov 04 05:00:01.580213 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:01.580193 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerStarted","Data":"475bef23a3fca1318a8f329cd841cbf55cbe321dbdbb9eabdde08722dc9faade"} Nov 04 05:00:06.620316 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:06.620280 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerStarted","Data":"4d5603b23e22429acd0d2e3e3e320900dbf94efd117c9d21d11a1749228b34bb"} Nov 04 05:00:06.622144 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:06.622111 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerStarted","Data":"f44aadddc47d010cf1869299935db9194d212cf6fa51f55081b8114461ec2b52"} Nov 04 05:00:06.623699 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:06.623677 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerStarted","Data":"60fb5854befaf9f861a400ffab917e1d29d641c11d9b98dd4cccc7e8f4e4ec08"} Nov 04 05:00:06.739114 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:06.739013 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" podStartSLOduration=1.516635932 podStartE2EDuration="6.738999283s" totalImagesPullingTime="5.222363351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:06.736936078 +0000 UTC m=+779.779350706" watchObservedRunningTime="2026-11-04 05:00:06.738999283 +0000 UTC m=+779.781413910" Nov 04 05:00:06.852631 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:06.852571 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" podStartSLOduration=1.677140658 podStartE2EDuration="6.852552089s" totalImagesPullingTime="5.175411431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:06.851330843 +0000 UTC m=+779.893745481" watchObservedRunningTime="2026-11-04 05:00:06.852552089 +0000 UTC m=+779.894966717" Nov 04 05:00:06.966485 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:06.966436 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" podStartSLOduration=2.168554129 podStartE2EDuration="6.966421272s" totalImagesPullingTime="4.797867143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:06.964003623 +0000 UTC m=+780.006418252" watchObservedRunningTime="2026-11-04 05:00:06.966421272 +0000 UTC m=+780.008835897" Nov 04 05:00:07.630042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.630012 5019 generic.go:356] "Generic (PLEG): container finished" podID="bd99805d-39a2-4073-942e-9e0388cd787e" containerID="f44aadddc47d010cf1869299935db9194d212cf6fa51f55081b8114461ec2b52" exitCode=60 Nov 04 05:00:07.630497 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.630105 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerDied","Data":"f44aadddc47d010cf1869299935db9194d212cf6fa51f55081b8114461ec2b52"} Nov 04 05:00:07.630497 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.630321 5019 scope.go:122] "RemoveContainer" containerID="f44aadddc47d010cf1869299935db9194d212cf6fa51f55081b8114461ec2b52" Nov 04 05:00:07.631783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.631766 5019 generic.go:356] "Generic (PLEG): container finished" podID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerID="60fb5854befaf9f861a400ffab917e1d29d641c11d9b98dd4cccc7e8f4e4ec08" exitCode=60 Nov 04 05:00:07.631892 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.631851 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerDied","Data":"60fb5854befaf9f861a400ffab917e1d29d641c11d9b98dd4cccc7e8f4e4ec08"} Nov 04 05:00:07.632046 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.632026 5019 scope.go:122] "RemoveContainer" containerID="60fb5854befaf9f861a400ffab917e1d29d641c11d9b98dd4cccc7e8f4e4ec08" Nov 04 05:00:07.633669 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.633649 5019 generic.go:356] "Generic (PLEG): container finished" podID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerID="4d5603b23e22429acd0d2e3e3e320900dbf94efd117c9d21d11a1749228b34bb" exitCode=60 Nov 04 05:00:07.633739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.633681 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerDied","Data":"4d5603b23e22429acd0d2e3e3e320900dbf94efd117c9d21d11a1749228b34bb"} Nov 04 05:00:07.633971 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:07.633953 5019 scope.go:122] "RemoveContainer" containerID="4d5603b23e22429acd0d2e3e3e320900dbf94efd117c9d21d11a1749228b34bb" Nov 04 05:00:08.643969 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.643919 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerStarted","Data":"57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69"} Nov 04 05:00:08.646193 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.646163 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerStarted","Data":"b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542"} Nov 04 05:00:08.646447 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.646432 5019 scope.go:122] "RemoveContainer" containerID="b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542" Nov 04 05:00:08.646705 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:08.646683 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl_odh-ai-gateway-infra(bd99805d-39a2-4073-942e-9e0388cd787e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" Nov 04 05:00:08.647967 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.647945 5019 generic.go:356] "Generic (PLEG): container finished" podID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerID="8dc61a56b5643bec84abb52e3db9b1fcd3672da26b3d72bf097c1bed20f6f595" exitCode=60 Nov 04 05:00:08.648062 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.648018 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerDied","Data":"8dc61a56b5643bec84abb52e3db9b1fcd3672da26b3d72bf097c1bed20f6f595"} Nov 04 05:00:08.648106 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.648064 5019 scope.go:122] "RemoveContainer" containerID="60fb5854befaf9f861a400ffab917e1d29d641c11d9b98dd4cccc7e8f4e4ec08" Nov 04 05:00:08.648214 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:08.648201 5019 scope.go:122] "RemoveContainer" containerID="8dc61a56b5643bec84abb52e3db9b1fcd3672da26b3d72bf097c1bed20f6f595" Nov 04 05:00:08.648415 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:08.648396 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9_odh-ai-gateway-infra(87baa5d9-57dc-4f38-b69b-2126c65f1cee)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" Nov 04 05:00:09.655900 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.655869 5019 generic.go:356] "Generic (PLEG): container finished" podID="bd99805d-39a2-4073-942e-9e0388cd787e" containerID="b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542" exitCode=60 Nov 04 05:00:09.656391 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.655961 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerDied","Data":"b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542"} Nov 04 05:00:09.656391 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.656019 5019 scope.go:122] "RemoveContainer" containerID="f44aadddc47d010cf1869299935db9194d212cf6fa51f55081b8114461ec2b52" Nov 04 05:00:09.656391 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.656289 5019 scope.go:122] "RemoveContainer" containerID="b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542" Nov 04 05:00:09.656564 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:09.656537 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl_odh-ai-gateway-infra(bd99805d-39a2-4073-942e-9e0388cd787e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" Nov 04 05:00:09.657958 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.657937 5019 scope.go:122] "RemoveContainer" containerID="8dc61a56b5643bec84abb52e3db9b1fcd3672da26b3d72bf097c1bed20f6f595" Nov 04 05:00:09.658173 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:09.658151 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9_odh-ai-gateway-infra(87baa5d9-57dc-4f38-b69b-2126c65f1cee)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" Nov 04 05:00:09.659612 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.659585 5019 generic.go:356] "Generic (PLEG): container finished" podID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerID="57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69" exitCode=60 Nov 04 05:00:09.659698 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.659662 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerDied","Data":"57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69"} Nov 04 05:00:09.659873 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.659861 5019 scope.go:122] "RemoveContainer" containerID="57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69" Nov 04 05:00:09.660063 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:09.660046 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b_odh-ai-gateway-infra(9eb65ec4-dc02-4813-baed-53c54f57d70a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" Nov 04 05:00:09.668130 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:09.668114 5019 scope.go:122] "RemoveContainer" containerID="4d5603b23e22429acd0d2e3e3e320900dbf94efd117c9d21d11a1749228b34bb" Nov 04 05:00:10.667556 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:10.667528 5019 scope.go:122] "RemoveContainer" containerID="b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542" Nov 04 05:00:10.668010 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:10.667779 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl_odh-ai-gateway-infra(bd99805d-39a2-4073-942e-9e0388cd787e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" Nov 04 05:00:10.669031 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:10.669013 5019 scope.go:122] "RemoveContainer" containerID="57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69" Nov 04 05:00:10.669223 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:10.669208 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b_odh-ai-gateway-infra(9eb65ec4-dc02-4813-baed-53c54f57d70a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" Nov 04 05:00:21.119139 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:21.119107 5019 scope.go:122] "RemoveContainer" containerID="8dc61a56b5643bec84abb52e3db9b1fcd3672da26b3d72bf097c1bed20f6f595" Nov 04 05:00:21.119579 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:21.119150 5019 scope.go:122] "RemoveContainer" containerID="b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542" Nov 04 05:00:21.487974 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:21.487930 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:00:21.736152 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:21.736063 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerStarted","Data":"1fdb88ca22912585c13d7545694bf54315c231e3f82d40c53b03b9139d51ad87"} Nov 04 05:00:21.738620 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:21.738591 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerStarted","Data":"d73318f1d7945b27c958c3c5a1421a77b9935dd0f5de16052921cf49c8055fe1"} Nov 04 05:00:22.118351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.118320 5019 scope.go:122] "RemoveContainer" containerID="57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69" Nov 04 05:00:22.745756 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.745725 5019 generic.go:356] "Generic (PLEG): container finished" podID="bd99805d-39a2-4073-942e-9e0388cd787e" containerID="1fdb88ca22912585c13d7545694bf54315c231e3f82d40c53b03b9139d51ad87" exitCode=60 Nov 04 05:00:22.746185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.745811 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerDied","Data":"1fdb88ca22912585c13d7545694bf54315c231e3f82d40c53b03b9139d51ad87"} Nov 04 05:00:22.746185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.745875 5019 scope.go:122] "RemoveContainer" containerID="b5eb009a4c253413d8b3f3e70feb862db64a1e624920e8133cf62ff566a17542" Nov 04 05:00:22.746185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.746174 5019 scope.go:122] "RemoveContainer" containerID="1fdb88ca22912585c13d7545694bf54315c231e3f82d40c53b03b9139d51ad87" Nov 04 05:00:22.746479 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:22.746452 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl_odh-ai-gateway-infra(bd99805d-39a2-4073-942e-9e0388cd787e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" Nov 04 05:00:22.747660 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.747630 5019 generic.go:356] "Generic (PLEG): container finished" podID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerID="d73318f1d7945b27c958c3c5a1421a77b9935dd0f5de16052921cf49c8055fe1" exitCode=60 Nov 04 05:00:22.747762 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.747699 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerDied","Data":"d73318f1d7945b27c958c3c5a1421a77b9935dd0f5de16052921cf49c8055fe1"} Nov 04 05:00:22.748056 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.748041 5019 scope.go:122] "RemoveContainer" containerID="d73318f1d7945b27c958c3c5a1421a77b9935dd0f5de16052921cf49c8055fe1" Nov 04 05:00:22.748266 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:22.748250 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9_odh-ai-gateway-infra(87baa5d9-57dc-4f38-b69b-2126c65f1cee)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" Nov 04 05:00:22.749546 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.749527 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerStarted","Data":"f96e9c4d8cec01fee23042cf0928ecaf57317e8c474c8c829061352c2c994574"} Nov 04 05:00:22.757763 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.757744 5019 scope.go:122] "RemoveContainer" containerID="8dc61a56b5643bec84abb52e3db9b1fcd3672da26b3d72bf097c1bed20f6f595" Nov 04 05:00:22.913764 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.913726 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl"] Nov 04 05:00:22.977550 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:22.977507 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9"] Nov 04 05:00:23.757056 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.757023 5019 generic.go:356] "Generic (PLEG): container finished" podID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerID="f96e9c4d8cec01fee23042cf0928ecaf57317e8c474c8c829061352c2c994574" exitCode=60 Nov 04 05:00:23.757509 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.757095 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerDied","Data":"f96e9c4d8cec01fee23042cf0928ecaf57317e8c474c8c829061352c2c994574"} Nov 04 05:00:23.757509 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.757151 5019 scope.go:122] "RemoveContainer" containerID="57ea7f7dab88f6669a527dfe0f9e2ad8087a9a5523048196833104a9e6a79d69" Nov 04 05:00:23.757509 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.757508 5019 scope.go:122] "RemoveContainer" containerID="f96e9c4d8cec01fee23042cf0928ecaf57317e8c474c8c829061352c2c994574" Nov 04 05:00:23.757785 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:23.757763 5019 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b_odh-ai-gateway-infra(9eb65ec4-dc02-4813-baed-53c54f57d70a)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" Nov 04 05:00:23.936437 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.936415 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:23.938267 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.938252 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:23.994387 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.994354 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b"] Nov 04 05:00:23.997290 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997265 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca\") pod \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " Nov 04 05:00:23.997438 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997319 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx\" (UniqueName: \"kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx\") pod \"bd99805d-39a2-4073-942e-9e0388cd787e\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " Nov 04 05:00:23.997501 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997443 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca\") pod \"bd99805d-39a2-4073-942e-9e0388cd787e\" (UID: \"bd99805d-39a2-4073-942e-9e0388cd787e\") " Nov 04 05:00:23.997501 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997490 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g\" (UniqueName: \"kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g\") pod \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\" (UID: \"87baa5d9-57dc-4f38-b69b-2126c65f1cee\") " Nov 04 05:00:23.997748 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997724 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca" pod "87baa5d9-57dc-4f38-b69b-2126c65f1cee" (UID: "87baa5d9-57dc-4f38-b69b-2126c65f1cee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:23.997848 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997783 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca" pod "bd99805d-39a2-4073-942e-9e0388cd787e" (UID: "bd99805d-39a2-4073-942e-9e0388cd787e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:23.997902 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.997855 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87baa5d9-57dc-4f38-b69b-2126c65f1cee-maas-api-service-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:00:23.999835 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.999788 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g" pod "87baa5d9-57dc-4f38-b69b-2126c65f1cee" (UID: "87baa5d9-57dc-4f38-b69b-2126c65f1cee"). InnerVolumeSpecName "kube-api-access-hkn8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:23.999940 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:23.999839 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx" pod "bd99805d-39a2-4073-942e-9e0388cd787e" (UID: "bd99805d-39a2-4073-942e-9e0388cd787e"). InnerVolumeSpecName "kube-api-access-fjndx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:24.098599 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.098505 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjndx\" (UniqueName: \"kubernetes.io/projected/bd99805d-39a2-4073-942e-9e0388cd787e-kube-api-access-fjndx\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:00:24.098599 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.098535 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd99805d-39a2-4073-942e-9e0388cd787e-maas-api-service-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:00:24.098599 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.098545 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkn8g\" (UniqueName: \"kubernetes.io/projected/87baa5d9-57dc-4f38-b69b-2126c65f1cee-kube-api-access-hkn8g\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:00:24.768026 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.767995 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" Nov 04 05:00:24.768474 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.767997 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl" event={"ID":"bd99805d-39a2-4073-942e-9e0388cd787e","Type":"ContainerDied","Data":"16ad357272ac35f0e99eec49beee3a973a3f09da7f739be62ead04507256d7f7"} Nov 04 05:00:24.768474 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.768150 5019 scope.go:122] "RemoveContainer" containerID="1fdb88ca22912585c13d7545694bf54315c231e3f82d40c53b03b9139d51ad87" Nov 04 05:00:24.769425 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.769342 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" Nov 04 05:00:24.769425 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.769393 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9" event={"ID":"87baa5d9-57dc-4f38-b69b-2126c65f1cee","Type":"ContainerDied","Data":"475bef23a3fca1318a8f329cd841cbf55cbe321dbdbb9eabdde08722dc9faade"} Nov 04 05:00:24.780022 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.779995 5019 scope.go:122] "RemoveContainer" containerID="d73318f1d7945b27c958c3c5a1421a77b9935dd0f5de16052921cf49c8055fe1" Nov 04 05:00:24.914981 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.914959 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:24.934096 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.934058 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9"] Nov 04 05:00:24.940130 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:24.940104 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3eb31c-29896140-grxv9"] Nov 04 05:00:25.008515 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.008486 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca\") pod \"9eb65ec4-dc02-4813-baed-53c54f57d70a\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " Nov 04 05:00:25.008692 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.008552 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r\" (UniqueName: \"kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r\") pod \"9eb65ec4-dc02-4813-baed-53c54f57d70a\" (UID: \"9eb65ec4-dc02-4813-baed-53c54f57d70a\") " Nov 04 05:00:25.008882 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.008859 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca" pod "9eb65ec4-dc02-4813-baed-53c54f57d70a" (UID: "9eb65ec4-dc02-4813-baed-53c54f57d70a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:00:25.008966 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.008954 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9eb65ec4-dc02-4813-baed-53c54f57d70a-maas-api-service-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:00:25.010866 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.010838 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r" pod "9eb65ec4-dc02-4813-baed-53c54f57d70a" (UID: "9eb65ec4-dc02-4813-baed-53c54f57d70a"). InnerVolumeSpecName "kube-api-access-w5h6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:00:25.109574 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.109491 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5h6r\" (UniqueName: \"kubernetes.io/projected/9eb65ec4-dc02-4813-baed-53c54f57d70a-kube-api-access-w5h6r\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:00:25.123445 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.123416 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" path="/var/lib/kubelet/pods/87baa5d9-57dc-4f38-b69b-2126c65f1cee/volumes" Nov 04 05:00:25.174059 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.174026 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl"] Nov 04 05:00:25.177852 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.177824 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-4cce33-29896140-b4dpl"] Nov 04 05:00:25.780107 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.780079 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" Nov 04 05:00:25.780650 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.780079 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b" event={"ID":"9eb65ec4-dc02-4813-baed-53c54f57d70a","Type":"ContainerDied","Data":"41d64eea536f76dfffbff6a1ee91407a376d6126c41a0bab7c935b95c8c2b9dc"} Nov 04 05:00:25.780650 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.780205 5019 scope.go:122] "RemoveContainer" containerID="f96e9c4d8cec01fee23042cf0928ecaf57317e8c474c8c829061352c2c994574" Nov 04 05:00:25.946881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.946849 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b"] Nov 04 05:00:25.997219 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:25.997187 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-0aae2f-29896140-z465b"] Nov 04 05:00:27.125589 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:27.125558 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" path="/var/lib/kubelet/pods/9eb65ec4-dc02-4813-baed-53c54f57d70a/volumes" Nov 04 05:00:27.126046 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:27.125972 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" path="/var/lib/kubelet/pods/bd99805d-39a2-4073-942e-9e0388cd787e/volumes" Nov 04 05:00:37.641715 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.641685 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n"] Nov 04 05:00:37.642141 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642128 5019 cpu_manager.go:414] "containerMap: removing container" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642142 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642157 5019 cpu_manager.go:414] "containerMap: removing container" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642161 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642176 5019 cpu_manager.go:414] "containerMap: removing container" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:37.642183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642180 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642190 5019 cpu_manager.go:414] "containerMap: removing container" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642195 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642205 5019 cpu_manager.go:414] "containerMap: removing container" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642210 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642215 5019 cpu_manager.go:414] "containerMap: removing container" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642219 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642227 5019 cpu_manager.go:414] "containerMap: removing container" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642231 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642309 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642317 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642325 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642330 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642336 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642343 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:37.642930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.642351 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:37.649588 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.649569 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.703045 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.703013 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n"] Nov 04 05:00:37.734309 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.734268 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.734494 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.734322 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.734542 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.734486 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.734542 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.734522 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.734647 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.734539 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.734647 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.734636 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5kw\" (UniqueName: \"kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.749992 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.749961 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-0aae2f\"/\"kube-root-ca.crt\"" Nov 04 05:00:37.750176 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.750005 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-0aae2f\"/\"openshift-service-ca.crt\"" Nov 04 05:00:37.750176 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.750075 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0aae2f\"/\"simulator-w0-0aae2f-kserve-self-signed-certs\"" Nov 04 05:00:37.752134 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.752115 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0aae2f\"/\"default-dockercfg-zwkcg\"" Nov 04 05:00:37.835569 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.835539 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.835753 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.835577 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.835753 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.835595 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.835753 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.835631 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5kw\" (UniqueName: \"kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.835753 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.835662 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.835753 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.835681 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.836048 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.836024 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.836048 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.836038 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.836152 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.836100 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.838333 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.838314 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.838638 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.838615 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.892955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.892880 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5kw\" (UniqueName: \"kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw\") pod \"simulator-w0-0aae2f-kserve-f98dd879b-ghw4n\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:37.962127 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:37.961687 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:38.351774 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:38.351750 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n"] Nov 04 05:00:38.353251 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:00:38.353228 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod681140d5_a7f6_48af_a883_1fa33f3f4379.slice/crio-f5ce6e3c91696352c82de0a091120677bcec9baa3ef25b3087bd6d1c5d6412f7 WatchSource:0}: Error finding container f5ce6e3c91696352c82de0a091120677bcec9baa3ef25b3087bd6d1c5d6412f7: Status 404 returned error can't find the container with id f5ce6e3c91696352c82de0a091120677bcec9baa3ef25b3087bd6d1c5d6412f7 Nov 04 05:00:38.864596 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:38.864559 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" event={"ID":"681140d5-a7f6-48af-a883-1fa33f3f4379","Type":"ContainerStarted","Data":"0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb"} Nov 04 05:00:38.865087 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:38.864608 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" event={"ID":"681140d5-a7f6-48af-a883-1fa33f3f4379","Type":"ContainerStarted","Data":"f5ce6e3c91696352c82de0a091120677bcec9baa3ef25b3087bd6d1c5d6412f7"} Nov 04 05:00:38.962771 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:38.962741 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:38.979942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:38.979887 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" podStartSLOduration=1.9798719409999999 podStartE2EDuration="1.979871941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:38.979015638 +0000 UTC m=+812.021430268" watchObservedRunningTime="2026-11-04 05:00:38.979871941 +0000 UTC m=+812.022286570" Nov 04 05:00:41.395562 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.395524 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz"] Nov 04 05:00:41.396107 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.396089 5019 cpu_manager.go:414] "containerMap: removing container" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:41.396107 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.396107 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="87baa5d9-57dc-4f38-b69b-2126c65f1cee" containerName="cleanup" Nov 04 05:00:41.396232 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.396140 5019 cpu_manager.go:414] "containerMap: removing container" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:41.396232 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.396145 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:41.396232 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.396216 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb65ec4-dc02-4813-baed-53c54f57d70a" containerName="cleanup" Nov 04 05:00:41.396232 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.396225 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd99805d-39a2-4073-942e-9e0388cd787e" containerName="cleanup" Nov 04 05:00:41.399664 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.399640 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.475619 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.475549 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bln\" (UniqueName: \"kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.475619 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.475598 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.475879 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.475697 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.475879 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.475737 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.475879 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.475878 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.476072 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.475925 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.503200 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.503169 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-dab70d\"/\"openshift-service-ca.crt\"" Nov 04 05:00:41.503200 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.503183 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-dab70d\"/\"kube-root-ca.crt\"" Nov 04 05:00:41.503424 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.503243 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-dab70d\"/\"default-dockercfg-g6kzk\"" Nov 04 05:00:41.504157 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.504136 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-dab70d\"/\"simulator-w3-dab70d-kserve-self-signed-certs\"" Nov 04 05:00:41.505962 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.505937 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz"] Nov 04 05:00:41.576966 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.576924 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bln\" (UniqueName: \"kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.576966 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.576963 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577241 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.576996 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577241 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.577018 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577241 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.577054 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577241 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.577074 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577703 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.577678 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577906 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.577692 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.577906 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.577710 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.579479 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.579458 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.579884 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.579867 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.634847 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.634812 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bln\" (UniqueName: \"kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln\") pod \"simulator-w3-dab70d-kserve-79c55b98f8-bxmvz\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:41.711836 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:41.711730 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:42.092842 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:42.092771 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz"] Nov 04 05:00:42.094063 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:00:42.094033 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb73ac04d_1331_4fe1_98b5_784839662231.slice/crio-528247975b36ba88a841f94048c058b1609128d7204f119fbdc227c282a15ba6 WatchSource:0}: Error finding container 528247975b36ba88a841f94048c058b1609128d7204f119fbdc227c282a15ba6: Status 404 returned error can't find the container with id 528247975b36ba88a841f94048c058b1609128d7204f119fbdc227c282a15ba6 Nov 04 05:00:42.889236 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:42.889202 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" event={"ID":"b73ac04d-1331-4fe1-98b5-784839662231","Type":"ContainerStarted","Data":"f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95"} Nov 04 05:00:42.889236 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:42.889241 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" event={"ID":"b73ac04d-1331-4fe1-98b5-784839662231","Type":"ContainerStarted","Data":"528247975b36ba88a841f94048c058b1609128d7204f119fbdc227c282a15ba6"} Nov 04 05:00:43.005049 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:43.005000 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" podStartSLOduration=2.004985268 podStartE2EDuration="2.004985268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:00:43.003052775 +0000 UTC m=+816.045467401" watchObservedRunningTime="2026-11-04 05:00:43.004985268 +0000 UTC m=+816.047399910" Nov 04 05:00:43.711953 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:43.711921 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:47.962639 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:47.962596 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:47.984025 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:47.983986 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:48.938133 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:48.938102 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:00:51.490206 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:00:51.490167 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:00:51.712254 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:51.712219 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:51.724824 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:51.724777 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:00:51.955114 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:00:51.955084 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:01:05.431064 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.431024 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4"] Nov 04 05:01:05.435077 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.435056 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525158 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525121 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525374 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525177 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlzs\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525374 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525273 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525374 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525341 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525376 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525400 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525584 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525503 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525584 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525548 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.525584 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.525567 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.534506 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.534470 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4"] Nov 04 05:01:05.626457 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626412 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlzs\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626457 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626466 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626726 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626641 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626726 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626683 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626726 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626709 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626773 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626816 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626842 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626874 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.626955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.626943 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.627205 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.627072 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.627205 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.627144 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.627308 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.627254 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.627524 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.627503 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.629201 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.629183 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.629263 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.629245 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.684881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.684764 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.685077 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.685056 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlzs\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs\") pod \"e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:05.749937 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:05.749898 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:06.178927 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:06.178896 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4"] Nov 04 05:01:06.180613 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:01:06.180587 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e70886f_792d_42e9_b04b_6392aa85a199.slice/crio-8d9964361121f9a9c5ddb2929f8aa8403c62130838f549e8eb8be239afd2014c WatchSource:0}: Error finding container 8d9964361121f9a9c5ddb2929f8aa8403c62130838f549e8eb8be239afd2014c: Status 404 returned error can't find the container with id 8d9964361121f9a9c5ddb2929f8aa8403c62130838f549e8eb8be239afd2014c Nov 04 05:01:06.182779 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:06.182749 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:01:06.182873 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:06.182837 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:01:06.182873 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:06.182869 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:01:07.056781 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:07.056743 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" event={"ID":"1e70886f-792d-42e9-b04b-6392aa85a199","Type":"ContainerStarted","Data":"be49f0cd727a26fecb8420d18c84e29b423dd3f56508bcfc414d75f3ac9b6c5f"} Nov 04 05:01:07.057166 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:07.056809 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" event={"ID":"1e70886f-792d-42e9-b04b-6392aa85a199","Type":"ContainerStarted","Data":"8d9964361121f9a9c5ddb2929f8aa8403c62130838f549e8eb8be239afd2014c"} Nov 04 05:01:07.257221 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:07.257145 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podStartSLOduration=2.257127786 podStartE2EDuration="2.257127786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:07.252067606 +0000 UTC m=+840.294482234" watchObservedRunningTime="2026-11-04 05:01:07.257127786 +0000 UTC m=+840.299542415" Nov 04 05:01:07.750348 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:07.750314 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:07.751891 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:07.751860 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Nov 04 05:01:07.752019 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:07.751918 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Nov 04 05:01:08.752324 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:08.752283 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Nov 04 05:01:08.752856 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:08.752350 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Nov 04 05:01:09.751239 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:09.751199 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Nov 04 05:01:09.751456 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:09.751285 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Nov 04 05:01:10.751211 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:10.751160 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Nov 04 05:01:10.751635 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:10.751240 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Nov 04 05:01:11.756238 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:11.756198 5019 patch_prober.go:29] interesting pod/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Nov 04 05:01:11.756660 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:11.756259 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Nov 04 05:01:12.775867 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:12.775780 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:12.776725 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:12.776704 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:12.777505 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:12.777484 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:01:20.214290 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.214204 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh"] Nov 04 05:01:20.219853 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.219826 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.273412 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.273373 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-cedfca-openshift-default-dockercfg-fdtt2\"" Nov 04 05:01:20.299936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.299902 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300111 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.299957 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300111 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.299974 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300239 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.300162 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300239 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.300200 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300343 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.300291 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zz8l\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300396 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.300337 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.300402 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.300450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.300440 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.327212 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.327175 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh"] Nov 04 05:01:20.401983 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.401948 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402198 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402002 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402198 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402039 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402198 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402084 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402198 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402137 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402198 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402160 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402492 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402228 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402492 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402253 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402492 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402339 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zz8l\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402492 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402447 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.402685 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.402534 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.403039 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.403005 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.403185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.403063 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.403185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.403106 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.405196 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.405171 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.405294 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.405207 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.460016 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.459985 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.460163 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.460066 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zz8l\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.549037 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.548999 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:20.979209 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.979177 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh"] Nov 04 05:01:20.980884 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:01:20.980856 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod569a4206_5505_4353_8ea7_68a686bd4585.slice/crio-7d06edce39f3eb10246479b9a7f063ed5aa57dfadeba367893da7641aff35765 WatchSource:0}: Error finding container 7d06edce39f3eb10246479b9a7f063ed5aa57dfadeba367893da7641aff35765: Status 404 returned error can't find the container with id 7d06edce39f3eb10246479b9a7f063ed5aa57dfadeba367893da7641aff35765 Nov 04 05:01:20.983407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.983372 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:01:20.983495 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.983444 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:01:20.983495 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:20.983472 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:01:21.159326 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:21.159295 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" event={"ID":"569a4206-5505-4353-8ea7-68a686bd4585","Type":"ContainerStarted","Data":"815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef"} Nov 04 05:01:21.159489 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:21.159344 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" event={"ID":"569a4206-5505-4353-8ea7-68a686bd4585","Type":"ContainerStarted","Data":"7d06edce39f3eb10246479b9a7f063ed5aa57dfadeba367893da7641aff35765"} Nov 04 05:01:21.277882 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:21.277811 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podStartSLOduration=1.2777722200000001 podStartE2EDuration="1.27777222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:01:21.27706838 +0000 UTC m=+854.319483009" watchObservedRunningTime="2026-11-04 05:01:21.27777222 +0000 UTC m=+854.320186850" Nov 04 05:01:21.501900 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:01:21.501860 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:01:21.549670 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:21.549527 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:22.558949 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:22.558908 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 05:01:22.559420 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:22.558970 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 05:01:23.550820 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:23.550225 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 05:01:23.550820 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:23.550304 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 05:01:24.550330 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:24.550273 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 05:01:24.551003 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:24.550956 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 05:01:25.551326 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:25.551285 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 05:01:25.551757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:25.551356 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 05:01:26.551310 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:26.551268 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 04 05:01:26.551524 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:26.551333 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 04 05:01:27.699486 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:27.699445 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:27.700778 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:27.700757 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:27.701477 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:01:27.701454 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:01:51.489694 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:01:51.489654 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:02:07.227707 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:07.227680 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 05:02:07.230471 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:07.230449 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 05:02:07.238141 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:07.238082 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 05:02:07.241032 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:07.241013 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 05:02:21.489960 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:02:21.489914 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:02:29.770299 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.770265 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6"] Nov 04 05:02:29.775039 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.775013 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.829461 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.829432 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-0aae2f-openshift-default-dockercfg-9n62j\"" Nov 04 05:02:29.876052 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876013 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876195 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876063 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876283 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876166 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876404 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876290 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xptxb\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876404 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876368 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876514 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876404 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876572 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876534 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876638 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876625 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.876687 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.876658 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.882198 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.882172 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6"] Nov 04 05:02:29.978209 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978173 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978232 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978253 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978284 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978304 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978333 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978390 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xptxb\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978743 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978430 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978743 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978457 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978867 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978757 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978867 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978789 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.978952 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.978859 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.979082 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.979060 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.979417 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.979388 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.981042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.981016 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:29.981146 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:29.981019 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:30.035633 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.035564 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:30.035852 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.035833 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xptxb\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb\") pod \"e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:30.088682 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.088653 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:30.519150 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.519126 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6"] Nov 04 05:02:30.521149 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:02:30.521120 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d46317_0176_485e_a61d_ff63e1111f0b.slice/crio-3bcfe3cdc26712a68baf1e04232e1285f56e3012dbb456c22a43893e06c0e5ee WatchSource:0}: Error finding container 3bcfe3cdc26712a68baf1e04232e1285f56e3012dbb456c22a43893e06c0e5ee: Status 404 returned error can't find the container with id 3bcfe3cdc26712a68baf1e04232e1285f56e3012dbb456c22a43893e06c0e5ee Nov 04 05:02:30.523549 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.523519 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:02:30.523630 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.523588 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:02:30.523630 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.523614 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:02:30.600992 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.600961 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" event={"ID":"f8d46317-0176-485e-a61d-ff63e1111f0b","Type":"ContainerStarted","Data":"7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4"} Nov 04 05:02:30.601103 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.601016 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" event={"ID":"f8d46317-0176-485e-a61d-ff63e1111f0b","Type":"ContainerStarted","Data":"3bcfe3cdc26712a68baf1e04232e1285f56e3012dbb456c22a43893e06c0e5ee"} Nov 04 05:02:30.722403 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:30.722348 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podStartSLOduration=1.722334711 podStartE2EDuration="1.722334711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:02:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:02:30.719343509 +0000 UTC m=+923.761758137" watchObservedRunningTime="2026-11-04 05:02:30.722334711 +0000 UTC m=+923.764749340" Nov 04 05:02:31.089609 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:31.089573 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:31.091207 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:31.091169 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:31.091326 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:31.091232 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:32.089467 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:32.089431 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:32.089649 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:32.089487 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:33.089181 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:33.089146 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:33.089366 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:33.089224 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:34.089522 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:34.089483 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:34.090047 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:34.089546 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:35.089676 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:35.089643 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:35.090083 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:35.089703 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:36.089626 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:36.089589 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:36.089845 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:36.089648 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:37.089755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:37.089720 5019 patch_prober.go:29] interesting pod/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 04 05:02:37.089961 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:37.089774 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 04 05:02:38.093295 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:38.093265 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:38.093725 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:38.093714 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:38.094524 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:02:38.094504 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:02:51.490735 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:02:51.490633 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:03:20.195916 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.195876 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm"] Nov 04 05:03:20.199549 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.199532 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250463 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250435 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250573 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250471 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250615 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250588 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250651 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250618 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250685 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250663 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250756 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250736 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250822 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250781 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250872 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250856 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.250906 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.250897 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqh7c\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.305418 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.305393 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-370078-openshift-default-dockercfg-r9m9c\"" Nov 04 05:03:20.308255 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.308233 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm"] Nov 04 05:03:20.351725 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351699 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.351875 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351746 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.351875 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351776 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.351875 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351830 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.351875 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351870 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352088 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351901 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqh7c\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352088 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351940 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352088 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.351975 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352088 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.352070 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352310 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.352184 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352310 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.352238 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352423 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.352318 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352482 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.352447 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.352667 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.352609 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.354350 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.354329 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.354585 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.354563 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.408682 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.408651 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.408764 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.408720 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqh7c\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c\") pod \"e2e-worker-w2-370078-openshift-default-584c45775-rvgrm\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.512311 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.512289 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:20.936321 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.936242 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm"] Nov 04 05:03:20.976335 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:03:20.976307 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1eda615_98b0_490f_88e1_f72638931fba.slice/crio-ce615496b6e31ebc6fd44020bc82e75a2a584059cd711e12748b309798a053ea WatchSource:0}: Error finding container ce615496b6e31ebc6fd44020bc82e75a2a584059cd711e12748b309798a053ea: Status 404 returned error can't find the container with id ce615496b6e31ebc6fd44020bc82e75a2a584059cd711e12748b309798a053ea Nov 04 05:03:20.978351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.978321 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:03:20.978432 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.978390 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:03:20.978432 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:20.978420 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:03:21.500246 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:03:21.500213 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:03:21.964744 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:21.964637 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" event={"ID":"e1eda615-98b0-490f-88e1-f72638931fba","Type":"ContainerStarted","Data":"bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea"} Nov 04 05:03:21.964744 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:21.964702 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" event={"ID":"e1eda615-98b0-490f-88e1-f72638931fba","Type":"ContainerStarted","Data":"ce615496b6e31ebc6fd44020bc82e75a2a584059cd711e12748b309798a053ea"} Nov 04 05:03:22.512495 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:22.512462 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:22.514179 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:22.514152 5019 patch_prober.go:29] interesting pod/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 05:03:22.514306 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:22.514204 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 05:03:23.513121 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:23.513078 5019 patch_prober.go:29] interesting pod/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 05:03:23.513581 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:23.513149 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 05:03:24.513538 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:24.513508 5019 patch_prober.go:29] interesting pod/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 05:03:24.513908 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:24.513567 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 05:03:25.512923 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:25.512892 5019 patch_prober.go:29] interesting pod/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 05:03:25.513154 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:25.512945 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 05:03:26.512934 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:26.512904 5019 patch_prober.go:29] interesting pod/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 04 05:03:26.513346 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:26.512964 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 04 05:03:27.563451 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:27.563399 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:27.564155 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:27.564092 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:27.565217 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:27.565194 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:03:27.733296 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:27.733238 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podStartSLOduration=7.733225898 podStartE2EDuration="7.733225898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:03:22.189498553 +0000 UTC m=+975.231913180" watchObservedRunningTime="2026-11-04 05:03:27.733225898 +0000 UTC m=+980.775640847" Nov 04 05:03:28.439648 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.439611 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8034-7d9864"] Nov 04 05:03:28.443523 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.443503 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:03:28.496394 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.496370 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8034-7d9864"] Nov 04 05:03:28.536871 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.536841 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6tzb\" (UniqueName: \"kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb\") pod \"test-curl-8034-7d9864\" (UID: \"f63547d4-ea76-4954-8c41-f606a9072502\") " pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:03:28.543451 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.543426 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vkc75\"" Nov 04 05:03:28.637465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.637438 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6tzb\" (UniqueName: \"kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb\") pod \"test-curl-8034-7d9864\" (UID: \"f63547d4-ea76-4954-8c41-f606a9072502\") " pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:03:28.694965 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.694893 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6tzb\" (UniqueName: \"kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb\") pod \"test-curl-8034-7d9864\" (UID: \"f63547d4-ea76-4954-8c41-f606a9072502\") " pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:03:28.755194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:28.755167 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:03:29.131181 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:29.131154 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8034-7d9864"] Nov 04 05:03:29.132573 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:03:29.132542 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf63547d4_ea76_4954_8c41_f606a9072502.slice/crio-832d6d676475a1d2633d5b695d025380b8dab0ccddf1a63902876dd9885f5df1 WatchSource:0}: Error finding container 832d6d676475a1d2633d5b695d025380b8dab0ccddf1a63902876dd9885f5df1: Status 404 returned error can't find the container with id 832d6d676475a1d2633d5b695d025380b8dab0ccddf1a63902876dd9885f5df1 Nov 04 05:03:30.027109 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:30.027074 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8034-7d9864" event={"ID":"f63547d4-ea76-4954-8c41-f606a9072502","Type":"ContainerStarted","Data":"832d6d676475a1d2633d5b695d025380b8dab0ccddf1a63902876dd9885f5df1"} Nov 04 05:03:32.043572 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:32.043543 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8034-7d9864" event={"ID":"f63547d4-ea76-4954-8c41-f606a9072502","Type":"ContainerStarted","Data":"1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422"} Nov 04 05:03:32.158490 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:32.158442 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-8034-7d9864" podStartSLOduration=1.68619392 podStartE2EDuration="4.158427839s" totalImagesPullingTime="2.472233919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:03:32.155384955 +0000 UTC m=+985.197799582" watchObservedRunningTime="2026-11-04 05:03:32.158427839 +0000 UTC m=+985.200842469" Nov 04 05:03:35.604459 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.604424 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq"] Nov 04 05:03:35.608413 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.608396 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.661019 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.660997 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-4cce33-openshift-default-dockercfg-qrlrc\"" Nov 04 05:03:35.714148 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.714120 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq"] Nov 04 05:03:35.718739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.718706 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.718904 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.718752 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.718904 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.718784 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.718904 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.718827 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7vr\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.719024 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.718976 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.719113 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.719096 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.719184 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.719166 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.719261 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.719248 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.719295 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.719276 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820713 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820682 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820739 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820782 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820823 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820850 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820870 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.820936 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820896 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.821260 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820921 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7vr\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.821260 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.820994 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.821360 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.821257 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.821437 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.821414 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.821474 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.821449 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.821909 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.821880 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.822029 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.821978 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.823261 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.823242 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.823484 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.823465 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.877861 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.877777 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.877960 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.877864 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7vr\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:35.921730 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:35.921702 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:36.353832 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:36.353789 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq"] Nov 04 05:03:36.357070 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:03:36.357045 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32301992_ea6b_4d83_b7a3_78b330a55d0a.slice/crio-8c86170e84ba5fd24e14f5087c83cf3fbc10e1831a4c38590e96cbd13611d530 WatchSource:0}: Error finding container 8c86170e84ba5fd24e14f5087c83cf3fbc10e1831a4c38590e96cbd13611d530: Status 404 returned error can't find the container with id 8c86170e84ba5fd24e14f5087c83cf3fbc10e1831a4c38590e96cbd13611d530 Nov 04 05:03:36.359904 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:36.359870 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:03:36.359998 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:36.359940 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:03:36.359998 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:36.359972 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:03:37.087840 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:37.087783 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" event={"ID":"32301992-ea6b-4d83-b7a3-78b330a55d0a","Type":"ContainerStarted","Data":"edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be"} Nov 04 05:03:37.088280 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:37.087890 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" event={"ID":"32301992-ea6b-4d83-b7a3-78b330a55d0a","Type":"ContainerStarted","Data":"8c86170e84ba5fd24e14f5087c83cf3fbc10e1831a4c38590e96cbd13611d530"} Nov 04 05:03:37.204486 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:37.204433 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podStartSLOduration=2.204419815 podStartE2EDuration="2.204419815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:03:37.204037793 +0000 UTC m=+990.246452421" watchObservedRunningTime="2026-11-04 05:03:37.204419815 +0000 UTC m=+990.246834499" Nov 04 05:03:37.922303 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:37.922263 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:37.923618 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:37.923590 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 04 05:03:37.923747 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:37.923641 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 04 05:03:38.922396 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:38.922360 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 04 05:03:38.922859 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:38.922421 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 04 05:03:39.922817 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:39.922757 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 04 05:03:39.923221 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:39.922823 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 04 05:03:40.922341 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:40.922307 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 04 05:03:40.922513 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:40.922361 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 04 05:03:41.922962 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:41.922926 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 04 05:03:41.923331 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:41.922993 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 04 05:03:42.922878 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:42.922841 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 04 05:03:42.923084 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:42.922920 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 04 05:03:43.588425 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:43.588392 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n"] Nov 04 05:03:43.926982 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:43.926896 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:43.927411 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:43.927195 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:43.928010 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:43.927991 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:03:51.489713 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:03:51.489678 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:03:58.609702 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.609655 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" podUID="681140d5-a7f6-48af-a883-1fa33f3f4379" containerName="main" containerID="cri-o://0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb" gracePeriod=45 Nov 04 05:03:58.920858 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.920832 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:03:58.946289 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946254 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home\") pod \"681140d5-a7f6-48af-a883-1fa33f3f4379\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " Nov 04 05:03:58.946482 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946316 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir\") pod \"681140d5-a7f6-48af-a883-1fa33f3f4379\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " Nov 04 05:03:58.946482 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946372 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw\" (UniqueName: \"kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw\") pod \"681140d5-a7f6-48af-a883-1fa33f3f4379\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " Nov 04 05:03:58.946482 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946421 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache\") pod \"681140d5-a7f6-48af-a883-1fa33f3f4379\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " Nov 04 05:03:58.946706 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946502 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs\" (UniqueName: \"kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs\") pod \"681140d5-a7f6-48af-a883-1fa33f3f4379\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " Nov 04 05:03:58.946706 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946534 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm\") pod \"681140d5-a7f6-48af-a883-1fa33f3f4379\" (UID: \"681140d5-a7f6-48af-a883-1fa33f3f4379\") " Nov 04 05:03:58.946706 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946585 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir" pod "681140d5-a7f6-48af-a883-1fa33f3f4379" (UID: "681140d5-a7f6-48af-a883-1fa33f3f4379"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:58.946706 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946595 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home" pod "681140d5-a7f6-48af-a883-1fa33f3f4379" (UID: "681140d5-a7f6-48af-a883-1fa33f3f4379"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:58.946922 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946858 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache" pod "681140d5-a7f6-48af-a883-1fa33f3f4379" (UID: "681140d5-a7f6-48af-a883-1fa33f3f4379"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:58.946922 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946890 5019 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-home\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:03:58.946922 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.946910 5019 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-tmp-dir\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:03:58.949094 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.949067 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs" pod "681140d5-a7f6-48af-a883-1fa33f3f4379" (UID: "681140d5-a7f6-48af-a883-1fa33f3f4379"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:03:58.949245 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.949170 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw" pod "681140d5-a7f6-48af-a883-1fa33f3f4379" (UID: "681140d5-a7f6-48af-a883-1fa33f3f4379"). InnerVolumeSpecName "kube-api-access-7f5kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:03:58.949316 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:58.949261 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm" pod "681140d5-a7f6-48af-a883-1fa33f3f4379" (UID: "681140d5-a7f6-48af-a883-1fa33f3f4379"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:03:59.049817 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.049769 5019 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/681140d5-a7f6-48af-a883-1fa33f3f4379-tls-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:03:59.049817 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.049819 5019 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-dshm\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:03:59.050074 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.049836 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f5kw\" (UniqueName: \"kubernetes.io/projected/681140d5-a7f6-48af-a883-1fa33f3f4379-kube-api-access-7f5kw\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:03:59.050074 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.049853 5019 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/681140d5-a7f6-48af-a883-1fa33f3f4379-model-cache\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:03:59.232249 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.232215 5019 generic.go:356] "Generic (PLEG): container finished" podID="681140d5-a7f6-48af-a883-1fa33f3f4379" containerID="0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb" exitCode=0 Nov 04 05:03:59.232454 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.232305 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" event={"ID":"681140d5-a7f6-48af-a883-1fa33f3f4379","Type":"ContainerDied","Data":"0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb"} Nov 04 05:03:59.232454 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.232341 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" Nov 04 05:03:59.232454 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.232393 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n" event={"ID":"681140d5-a7f6-48af-a883-1fa33f3f4379","Type":"ContainerDied","Data":"f5ce6e3c91696352c82de0a091120677bcec9baa3ef25b3087bd6d1c5d6412f7"} Nov 04 05:03:59.232454 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.232441 5019 scope.go:122] "RemoveContainer" containerID="0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb" Nov 04 05:03:59.245890 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.245862 5019 scope.go:122] "RemoveContainer" containerID="0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb" Nov 04 05:03:59.246329 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:03:59.246306 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb\": container with ID starting with 0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb not found: ID does not exist" containerID="0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb" Nov 04 05:03:59.246405 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.246345 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb"} err="failed to get container status \"0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb\": rpc error: code = NotFound desc = could not find container \"0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb\": container with ID starting with 0f9e249f2acbaf0ea4b5c85da9987dea7414edeb911275816ab928e9a4dd42bb not found: ID does not exist" Nov 04 05:03:59.398297 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.398206 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n"] Nov 04 05:03:59.401385 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:03:59.401358 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-0aae2f/simulator-w0-0aae2f-kserve-f98dd879b-ghw4n"] Nov 04 05:04:01.125037 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:01.124999 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="681140d5-a7f6-48af-a883-1fa33f3f4379" path="/var/lib/kubelet/pods/681140d5-a7f6-48af-a883-1fa33f3f4379/volumes" Nov 04 05:04:09.995054 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:09.995015 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s"] Nov 04 05:04:09.995665 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:09.995614 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" podUID="d21b0425-f11f-49b4-9fbd-16f131c603f8" containerName="maas-api" containerID="cri-o://6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca" gracePeriod=30 Nov 04 05:04:10.310098 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.310071 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 05:04:10.317713 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.317682 5019 generic.go:356] "Generic (PLEG): container finished" podID="d21b0425-f11f-49b4-9fbd-16f131c603f8" containerID="6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca" exitCode=0 Nov 04 05:04:10.317884 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.317728 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" Nov 04 05:04:10.317884 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.317774 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" event={"ID":"d21b0425-f11f-49b4-9fbd-16f131c603f8","Type":"ContainerDied","Data":"6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca"} Nov 04 05:04:10.317884 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.317845 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s" event={"ID":"d21b0425-f11f-49b4-9fbd-16f131c603f8","Type":"ContainerDied","Data":"1f8f9f026b46c91a6fee0159f69ca7fbb6dc5fcd22dad8cc322fa76329dd7bb3"} Nov 04 05:04:10.317884 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.317874 5019 scope.go:122] "RemoveContainer" containerID="6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca" Nov 04 05:04:10.328002 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.327959 5019 scope.go:122] "RemoveContainer" containerID="6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca" Nov 04 05:04:10.328316 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:10.328290 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca\": container with ID starting with 6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca not found: ID does not exist" containerID="6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca" Nov 04 05:04:10.328418 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.328326 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca"} err="failed to get container status \"6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca\": rpc error: code = NotFound desc = could not find container \"6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca\": container with ID starting with 6a627fb1fe9e20fa4aea1dab46afb65b99e984750bf5fb2148b9d5ea60708eca not found: ID does not exist" Nov 04 05:04:10.383202 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.382130 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\") pod \"d21b0425-f11f-49b4-9fbd-16f131c603f8\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " Nov 04 05:04:10.383202 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.382235 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca\") pod \"d21b0425-f11f-49b4-9fbd-16f131c603f8\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " Nov 04 05:04:10.383202 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.382318 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs\") pod \"d21b0425-f11f-49b4-9fbd-16f131c603f8\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " Nov 04 05:04:10.383202 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.382392 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f\" (UniqueName: \"kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f\") pod \"d21b0425-f11f-49b4-9fbd-16f131c603f8\" (UID: \"d21b0425-f11f-49b4-9fbd-16f131c603f8\") " Nov 04 05:04:10.388818 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.387161 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca" pod "d21b0425-f11f-49b4-9fbd-16f131c603f8" (UID: "d21b0425-f11f-49b4-9fbd-16f131c603f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:04:10.415063 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.414399 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls" pod "d21b0425-f11f-49b4-9fbd-16f131c603f8" (UID: "d21b0425-f11f-49b4-9fbd-16f131c603f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:04:10.417180 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.415304 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f" pod "d21b0425-f11f-49b4-9fbd-16f131c603f8" (UID: "d21b0425-f11f-49b4-9fbd-16f131c603f8"). InnerVolumeSpecName "kube-api-access-dx47f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:10.417180 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.415382 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs" pod "d21b0425-f11f-49b4-9fbd-16f131c603f8" (UID: "d21b0425-f11f-49b4-9fbd-16f131c603f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:04:10.483667 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.483634 5019 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-metrics-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:10.483667 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.483661 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx47f\" (UniqueName: \"kubernetes.io/projected/d21b0425-f11f-49b4-9fbd-16f131c603f8-kube-api-access-dx47f\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:10.483667 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.483670 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21b0425-f11f-49b4-9fbd-16f131c603f8-maas-api-tls\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:10.483923 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.483679 5019 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21b0425-f11f-49b4-9fbd-16f131c603f8-openshift-service-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:10.740309 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.740273 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s"] Nov 04 05:04:10.742896 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:10.742869 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0aae2f-7dfb55b6b-n6b8s"] Nov 04 05:04:11.125101 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:11.125066 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d21b0425-f11f-49b4-9fbd-16f131c603f8" path="/var/lib/kubelet/pods/d21b0425-f11f-49b4-9fbd-16f131c603f8/volumes" Nov 04 05:04:21.489407 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:21.489313 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:04:25.154274 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:25.154238 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6"] Nov 04 05:04:25.154712 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:25.154534 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" containerID="cri-o://7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4" gracePeriod=30 Nov 04 05:04:27.451553 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:27.451512 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz"] Nov 04 05:04:30.408039 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.408007 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:04:30.437179 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437093 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437179 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437130 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437179 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437151 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437206 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437223 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437252 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437329 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437385 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437405 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:30.437465 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437431 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs\") pod \"f8d46317-0176-485e-a61d-ff63e1111f0b\" (UID: \"f8d46317-0176-485e-a61d-ff63e1111f0b\") " Nov 04 05:04:30.437818 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437671 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:30.437818 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437680 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:30.437818 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437773 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:04:30.438115 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.437930 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:30.438115 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.438051 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.438244 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.438219 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.438244 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.438235 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.438364 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.438249 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d46317-0176-485e-a61d-ff63e1111f0b-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.439761 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.439734 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:30.439761 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.439739 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:04:30.439915 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.439825 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:30.439915 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.439840 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb" pod "f8d46317-0176-485e-a61d-ff63e1111f0b" (UID: "f8d46317-0176-485e-a61d-ff63e1111f0b"). InnerVolumeSpecName "kube-api-access-xptxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:30.462366 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.462333 5019 generic.go:356] "Generic (PLEG): container finished" podID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerID="7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4" exitCode=0 Nov 04 05:04:30.462508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.462378 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" Nov 04 05:04:30.462508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.462381 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" event={"ID":"f8d46317-0176-485e-a61d-ff63e1111f0b","Type":"ContainerDied","Data":"7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4"} Nov 04 05:04:30.462508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.462430 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6" event={"ID":"f8d46317-0176-485e-a61d-ff63e1111f0b","Type":"ContainerDied","Data":"3bcfe3cdc26712a68baf1e04232e1285f56e3012dbb456c22a43893e06c0e5ee"} Nov 04 05:04:30.462508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.462454 5019 scope.go:122] "RemoveContainer" containerID="7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4" Nov 04 05:04:30.473152 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.473127 5019 scope.go:122] "RemoveContainer" containerID="7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4" Nov 04 05:04:30.473520 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:30.473498 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4\": container with ID starting with 7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4 not found: ID does not exist" containerID="7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4" Nov 04 05:04:30.473617 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.473535 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4"} err="failed to get container status \"7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4\": rpc error: code = NotFound desc = could not find container \"7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4\": container with ID starting with 7928fd685b43b8eeddc2d41c2c08ff9484762b5fa7b673b67990b2a537a527f4 not found: ID does not exist" Nov 04 05:04:30.539942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.539904 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.539942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.539934 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.539942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.539949 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xptxb\" (UniqueName: \"kubernetes.io/projected/f8d46317-0176-485e-a61d-ff63e1111f0b-kube-api-access-xptxb\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.540178 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.539960 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d46317-0176-485e-a61d-ff63e1111f0b-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.540178 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.539969 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d46317-0176-485e-a61d-ff63e1111f0b-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:30.697651 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.697568 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6"] Nov 04 05:04:30.701934 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:30.701905 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-0aae2f-openshift-default-5f99b6799-r62d6"] Nov 04 05:04:31.125495 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:31.125455 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" path="/var/lib/kubelet/pods/f8d46317-0176-485e-a61d-ff63e1111f0b/volumes" Nov 04 05:04:33.027636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:33.027593 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8034-7d9864"] Nov 04 05:04:33.030218 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:33.027912 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-8034-7d9864" podUID="f63547d4-ea76-4954-8c41-f606a9072502" containerName="test-curl-8034-7d9864" containerID="cri-o://1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422" gracePeriod=2 Nov 04 05:04:33.044954 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:33.044920 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8034-7d9864"] Nov 04 05:04:33.079695 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:33.079658 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-7d9864\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="f63547d4-ea76-4954-8c41-f606a9072502" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:04:35.214783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.214744 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8034-74c00b"] Nov 04 05:04:35.215512 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215492 5019 cpu_manager.go:414] "containerMap: removing container" podUID="681140d5-a7f6-48af-a883-1fa33f3f4379" containerName="main" Nov 04 05:04:35.215585 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215515 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="681140d5-a7f6-48af-a883-1fa33f3f4379" containerName="main" Nov 04 05:04:35.215585 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215530 5019 cpu_manager.go:414] "containerMap: removing container" podUID="d21b0425-f11f-49b4-9fbd-16f131c603f8" containerName="maas-api" Nov 04 05:04:35.215585 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215538 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d21b0425-f11f-49b4-9fbd-16f131c603f8" containerName="maas-api" Nov 04 05:04:35.215585 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215574 5019 cpu_manager.go:414] "containerMap: removing container" podUID="f63547d4-ea76-4954-8c41-f606a9072502" containerName="test-curl-8034-7d9864" Nov 04 05:04:35.215585 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215582 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f63547d4-ea76-4954-8c41-f606a9072502" containerName="test-curl-8034-7d9864" Nov 04 05:04:35.215750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215601 5019 cpu_manager.go:414] "containerMap: removing container" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" Nov 04 05:04:35.215750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215610 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" Nov 04 05:04:35.215750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215728 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="681140d5-a7f6-48af-a883-1fa33f3f4379" containerName="main" Nov 04 05:04:35.215750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215736 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="d21b0425-f11f-49b4-9fbd-16f131c603f8" containerName="maas-api" Nov 04 05:04:35.215750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215748 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="f63547d4-ea76-4954-8c41-f606a9072502" containerName="test-curl-8034-7d9864" Nov 04 05:04:35.215933 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.215758 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8d46317-0176-485e-a61d-ff63e1111f0b" containerName="istio-proxy" Nov 04 05:04:35.219569 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.219549 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:35.262645 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.262621 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:04:35.271475 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.271448 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8034-74c00b"] Nov 04 05:04:35.301656 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.301577 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb\" (UniqueName: \"kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb\") pod \"f63547d4-ea76-4954-8c41-f606a9072502\" (UID: \"f63547d4-ea76-4954-8c41-f606a9072502\") " Nov 04 05:04:35.302037 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.302014 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mlvq\" (UniqueName: \"kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq\") pod \"test-curl-8034-74c00b\" (UID: \"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf\") " pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:35.304159 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.304124 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb" pod "f63547d4-ea76-4954-8c41-f606a9072502" (UID: "f63547d4-ea76-4954-8c41-f606a9072502"). InnerVolumeSpecName "kube-api-access-m6tzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:35.402503 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.402467 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mlvq\" (UniqueName: \"kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq\") pod \"test-curl-8034-74c00b\" (UID: \"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf\") " pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:35.402682 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.402533 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6tzb\" (UniqueName: \"kubernetes.io/projected/f63547d4-ea76-4954-8c41-f606a9072502-kube-api-access-m6tzb\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:35.460636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.460600 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mlvq\" (UniqueName: \"kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq\") pod \"test-curl-8034-74c00b\" (UID: \"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf\") " pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:35.495004 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.494971 5019 generic.go:356] "Generic (PLEG): container finished" podID="f63547d4-ea76-4954-8c41-f606a9072502" containerID="1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422" exitCode=137 Nov 04 05:04:35.495203 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.495030 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:04:35.495203 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.495073 5019 scope.go:122] "RemoveContainer" containerID="1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422" Nov 04 05:04:35.504992 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.504915 5019 scope.go:122] "RemoveContainer" containerID="1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422" Nov 04 05:04:35.505296 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:35.505278 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422\": container with ID starting with 1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422 not found: ID does not exist" containerID="1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422" Nov 04 05:04:35.505368 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.505309 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422"} err="failed to get container status \"1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422\": rpc error: code = NotFound desc = could not find container \"1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422\": container with ID starting with 1fb8a33cac57c730bcf00eae70eab2748d845148e414f325caabaed415498422 not found: ID does not exist" Nov 04 05:04:35.531725 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.531698 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:35.555665 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:35.555580 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-7d9864\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="f63547d4-ea76-4954-8c41-f606a9072502" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:04:35.905769 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:35.905744 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8034-74c00b"] Nov 04 05:04:35.907338 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:04:35.907307 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76fc4dfd_2f51_4bf0_a0bb_cc5a645300bf.slice/crio-a45302c402d659aba1e0b723f8a2c0328466fa38a8f090042d4379591a4a4d49 WatchSource:0}: Error finding container a45302c402d659aba1e0b723f8a2c0328466fa38a8f090042d4379591a4a4d49: Status 404 returned error can't find the container with id a45302c402d659aba1e0b723f8a2c0328466fa38a8f090042d4379591a4a4d49 Nov 04 05:04:36.513003 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:36.512847 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8034-74c00b" event={"ID":"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf","Type":"ContainerStarted","Data":"c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795"} Nov 04 05:04:36.513003 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:36.512902 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8034-74c00b" event={"ID":"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf","Type":"ContainerStarted","Data":"a45302c402d659aba1e0b723f8a2c0328466fa38a8f090042d4379591a4a4d49"} Nov 04 05:04:36.626632 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:36.626580 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-8034-74c00b" podStartSLOduration=1.626566978 podStartE2EDuration="1.626566978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:04:36.625115116 +0000 UTC m=+1049.667529743" watchObservedRunningTime="2026-11-04 05:04:36.626566978 +0000 UTC m=+1049.668981604" Nov 04 05:04:36.676441 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:36.676406 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-7d9864\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="f63547d4-ea76-4954-8c41-f606a9072502" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:04:37.123997 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:37.123968 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f63547d4-ea76-4954-8c41-f606a9072502" path="/var/lib/kubelet/pods/f63547d4-ea76-4954-8c41-f606a9072502/volumes" Nov 04 05:04:37.171834 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:37.171788 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-7d9864\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="f63547d4-ea76-4954-8c41-f606a9072502" pod="opendatahub/test-curl-8034-7d9864" Nov 04 05:04:38.048489 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.048457 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8034-74c00b"] Nov 04 05:04:38.052779 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.052751 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8034-74c00b"] Nov 04 05:04:38.218830 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.218775 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-8034-83b602"] Nov 04 05:04:38.219267 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.219253 5019 cpu_manager.go:414] "containerMap: removing container" podUID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" containerName="test-curl-8034-74c00b" Nov 04 05:04:38.219306 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.219269 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" containerName="test-curl-8034-74c00b" Nov 04 05:04:38.219363 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.219355 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" containerName="test-curl-8034-74c00b" Nov 04 05:04:38.222779 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.222757 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:38.274470 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.274434 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8034-83b602"] Nov 04 05:04:38.335214 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.335120 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxb6g\" (UniqueName: \"kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g\") pod \"test-curl-8034-83b602\" (UID: \"2be07f13-8cd5-471d-89b5-9d7d6446566e\") " pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:38.436046 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.436008 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxb6g\" (UniqueName: \"kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g\") pod \"test-curl-8034-83b602\" (UID: \"2be07f13-8cd5-471d-89b5-9d7d6446566e\") " pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:38.493712 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.493678 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxb6g\" (UniqueName: \"kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g\") pod \"test-curl-8034-83b602\" (UID: \"2be07f13-8cd5-471d-89b5-9d7d6446566e\") " pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:38.525992 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.525935 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-8034-74c00b" podUID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" containerName="test-curl-8034-74c00b" containerID="cri-o://c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795" gracePeriod=2 Nov 04 05:04:38.535443 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.535420 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:38.577523 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:38.577476 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-74c00b\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:38.911937 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:38.911903 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-8034-83b602"] Nov 04 05:04:38.913670 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:04:38.913037 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2be07f13_8cd5_471d_89b5_9d7d6446566e.slice/crio-7a0df947e37651d9ef148e45e96fc0095caa58ef914b371032b674554c0cc64d WatchSource:0}: Error finding container 7a0df947e37651d9ef148e45e96fc0095caa58ef914b371032b674554c0cc64d: Status 404 returned error can't find the container with id 7a0df947e37651d9ef148e45e96fc0095caa58ef914b371032b674554c0cc64d Nov 04 05:04:39.533324 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:39.533290 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8034-83b602" event={"ID":"2be07f13-8cd5-471d-89b5-9d7d6446566e","Type":"ContainerStarted","Data":"752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c"} Nov 04 05:04:39.533324 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:39.533331 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-8034-83b602" event={"ID":"2be07f13-8cd5-471d-89b5-9d7d6446566e","Type":"ContainerStarted","Data":"7a0df947e37651d9ef148e45e96fc0095caa58ef914b371032b674554c0cc64d"} Nov 04 05:04:39.646257 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:39.646203 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-8034-83b602" podStartSLOduration=1.6461883670000002 podStartE2EDuration="1.646188367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:04:39.644817518 +0000 UTC m=+1052.687232136" watchObservedRunningTime="2026-11-04 05:04:39.646188367 +0000 UTC m=+1052.688602993" Nov 04 05:04:40.833841 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:40.833400 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:40.966174 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:40.966142 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq\" (UniqueName: \"kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq\") pod \"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf\" (UID: \"76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf\") " Nov 04 05:04:40.968713 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:40.968680 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq" pod "76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" (UID: "76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf"). InnerVolumeSpecName "kube-api-access-8mlvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:41.067895 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.067810 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mlvq\" (UniqueName: \"kubernetes.io/projected/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf-kube-api-access-8mlvq\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:41.147907 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.145865 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" path="/var/lib/kubelet/pods/76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf/volumes" Nov 04 05:04:41.211185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.211154 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-8034-83b602"] Nov 04 05:04:41.215250 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.215075 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-8034-83b602"] Nov 04 05:04:41.547668 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.547632 5019 generic.go:356] "Generic (PLEG): container finished" podID="76fc4dfd-2f51-4bf0-a0bb-cc5a645300bf" containerID="c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795" exitCode=137 Nov 04 05:04:41.547866 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.547680 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-74c00b" Nov 04 05:04:41.547866 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.547742 5019 scope.go:122] "RemoveContainer" containerID="c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795" Nov 04 05:04:41.547964 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.547908 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-8034-83b602" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" containerName="test-curl-8034-83b602" containerID="cri-o://752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c" gracePeriod=2 Nov 04 05:04:41.558267 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.558248 5019 scope.go:122] "RemoveContainer" containerID="c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795" Nov 04 05:04:41.558597 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:41.558573 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795\": container with ID starting with c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795 not found: ID does not exist" containerID="c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795" Nov 04 05:04:41.558700 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:41.558605 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795"} err="failed to get container status \"c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795\": rpc error: code = NotFound desc = could not find container \"c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795\": container with ID starting with c3d8332d2c13a02177cb602f22b60f3b09e32220ea657edaa10daf718a6aa795 not found: ID does not exist" Nov 04 05:04:41.599420 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:41.599388 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-83b602\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:41.650976 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:41.650939 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-83b602\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:42.473251 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.473201 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" podUID="b73ac04d-1331-4fe1-98b5-784839662231" containerName="main" containerID="cri-o://f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95" gracePeriod=45 Nov 04 05:04:42.749078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.749048 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:04:42.786537 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786505 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln\" (UniqueName: \"kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln\") pod \"b73ac04d-1331-4fe1-98b5-784839662231\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " Nov 04 05:04:42.786728 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786561 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home\") pod \"b73ac04d-1331-4fe1-98b5-784839662231\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " Nov 04 05:04:42.786728 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786585 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir\") pod \"b73ac04d-1331-4fe1-98b5-784839662231\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " Nov 04 05:04:42.786728 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786618 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs\") pod \"b73ac04d-1331-4fe1-98b5-784839662231\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " Nov 04 05:04:42.786728 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786698 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm\") pod \"b73ac04d-1331-4fe1-98b5-784839662231\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " Nov 04 05:04:42.786986 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786862 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir" pod "b73ac04d-1331-4fe1-98b5-784839662231" (UID: "b73ac04d-1331-4fe1-98b5-784839662231"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:42.786986 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786876 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home" pod "b73ac04d-1331-4fe1-98b5-784839662231" (UID: "b73ac04d-1331-4fe1-98b5-784839662231"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:42.786986 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.786877 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache\") pod \"b73ac04d-1331-4fe1-98b5-784839662231\" (UID: \"b73ac04d-1331-4fe1-98b5-784839662231\") " Nov 04 05:04:42.787133 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.787050 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache" pod "b73ac04d-1331-4fe1-98b5-784839662231" (UID: "b73ac04d-1331-4fe1-98b5-784839662231"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:42.787396 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.787280 5019 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-model-cache\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:42.787396 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.787299 5019 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-home\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:42.787396 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.787312 5019 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-tmp-dir\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:42.789078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.789053 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs" pod "b73ac04d-1331-4fe1-98b5-784839662231" (UID: "b73ac04d-1331-4fe1-98b5-784839662231"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:04:42.789177 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.789059 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln" pod "b73ac04d-1331-4fe1-98b5-784839662231" (UID: "b73ac04d-1331-4fe1-98b5-784839662231"). InnerVolumeSpecName "kube-api-access-l9bln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:42.789177 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.789135 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm" pod "b73ac04d-1331-4fe1-98b5-784839662231" (UID: "b73ac04d-1331-4fe1-98b5-784839662231"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:42.888379 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.888340 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9bln\" (UniqueName: \"kubernetes.io/projected/b73ac04d-1331-4fe1-98b5-784839662231-kube-api-access-l9bln\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:42.888379 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.888380 5019 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73ac04d-1331-4fe1-98b5-784839662231-tls-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:42.888619 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:42.888395 5019 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73ac04d-1331-4fe1-98b5-784839662231-dshm\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:42.918886 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:42.918838 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-83b602\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:43.565057 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.565021 5019 generic.go:356] "Generic (PLEG): container finished" podID="b73ac04d-1331-4fe1-98b5-784839662231" containerID="f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95" exitCode=0 Nov 04 05:04:43.565438 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.565159 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" event={"ID":"b73ac04d-1331-4fe1-98b5-784839662231","Type":"ContainerDied","Data":"f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95"} Nov 04 05:04:43.565438 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.565198 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" event={"ID":"b73ac04d-1331-4fe1-98b5-784839662231","Type":"ContainerDied","Data":"528247975b36ba88a841f94048c058b1609128d7204f119fbdc227c282a15ba6"} Nov 04 05:04:43.565438 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.565218 5019 scope.go:122] "RemoveContainer" containerID="f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95" Nov 04 05:04:43.565438 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.565369 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz" Nov 04 05:04:43.626911 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.626888 5019 scope.go:122] "RemoveContainer" containerID="f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95" Nov 04 05:04:43.627307 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:43.627284 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95\": container with ID starting with f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95 not found: ID does not exist" containerID="f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95" Nov 04 05:04:43.627404 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.627319 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95"} err="failed to get container status \"f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95\": rpc error: code = NotFound desc = could not find container \"f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95\": container with ID starting with f46690512fdf4e50ae377eac6243f8fa62c820f6a8350128859793beb047de95 not found: ID does not exist" Nov 04 05:04:43.734688 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.734653 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz"] Nov 04 05:04:43.783403 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.783375 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-dab70d/simulator-w3-dab70d-kserve-79c55b98f8-bxmvz"] Nov 04 05:04:43.802053 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.801987 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:43.899391 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.899360 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g\" (UniqueName: \"kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g\") pod \"2be07f13-8cd5-471d-89b5-9d7d6446566e\" (UID: \"2be07f13-8cd5-471d-89b5-9d7d6446566e\") " Nov 04 05:04:43.901577 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:43.901544 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g" pod "2be07f13-8cd5-471d-89b5-9d7d6446566e" (UID: "2be07f13-8cd5-471d-89b5-9d7d6446566e"). InnerVolumeSpecName "kube-api-access-mxb6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:44.000720 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:44.000689 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxb6g\" (UniqueName: \"kubernetes.io/projected/2be07f13-8cd5-471d-89b5-9d7d6446566e-kube-api-access-mxb6g\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:44.573623 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:44.573590 5019 generic.go:356] "Generic (PLEG): container finished" podID="2be07f13-8cd5-471d-89b5-9d7d6446566e" containerID="752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c" exitCode=137 Nov 04 05:04:44.574129 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:44.573635 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:44.574129 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:44.573667 5019 scope.go:122] "RemoveContainer" containerID="752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c" Nov 04 05:04:44.583354 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:44.583336 5019 scope.go:122] "RemoveContainer" containerID="752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c" Nov 04 05:04:44.583595 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:44.583578 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c\": container with ID starting with 752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c not found: ID does not exist" containerID="752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c" Nov 04 05:04:44.583642 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:44.583602 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c"} err="failed to get container status \"752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c\": rpc error: code = NotFound desc = could not find container \"752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c\": container with ID starting with 752cecb223149276838a3d9393f8764c723bcaa32b496ace76f0deae3015191c not found: ID does not exist" Nov 04 05:04:44.633273 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:44.633236 5019 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-8034-83b602\" is forbidden: User \"system:node:ip-10-0-135-45.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-45.us-west-1.compute.internal' and this object" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" pod="opendatahub/test-curl-8034-83b602" Nov 04 05:04:45.123901 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:45.123866 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" path="/var/lib/kubelet/pods/2be07f13-8cd5-471d-89b5-9d7d6446566e/volumes" Nov 04 05:04:45.124271 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:45.124258 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b73ac04d-1331-4fe1-98b5-784839662231" path="/var/lib/kubelet/pods/b73ac04d-1331-4fe1-98b5-784839662231/volumes" Nov 04 05:04:48.264389 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:48.264355 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9"] Nov 04 05:04:48.264900 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:48.264611 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" containerID="cri-o://274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f" gracePeriod=30 Nov 04 05:04:51.488831 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:51.488766 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:04:53.539695 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.539629 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 05:04:53.606068 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606035 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606258 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606092 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606258 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606131 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606258 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606155 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606258 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606177 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606258 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606249 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606575 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606278 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606575 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606324 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606575 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606366 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token\") pod \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\" (UID: \"bd834832-a97c-4b3c-964e-cf1bfd6dde40\") " Nov 04 05:04:53.606575 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606375 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:53.606575 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606392 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:53.606824 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606586 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:53.606824 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606645 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:53.606824 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606693 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:04:53.606971 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606878 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.606971 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606902 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.606971 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606916 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.606971 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606929 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.606971 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.606941 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.608646 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.608611 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:04:53.608755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.608641 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "kube-api-access-l5fss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:53.608755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.608702 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:04:53.608880 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.608748 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token" pod "bd834832-a97c-4b3c-964e-cf1bfd6dde40" (UID: "bd834832-a97c-4b3c-964e-cf1bfd6dde40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:04:53.632412 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.632385 5019 generic.go:356] "Generic (PLEG): container finished" podID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerID="274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f" exitCode=0 Nov 04 05:04:53.632558 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.632491 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" Nov 04 05:04:53.632558 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.632493 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" event={"ID":"bd834832-a97c-4b3c-964e-cf1bfd6dde40","Type":"ContainerDied","Data":"274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f"} Nov 04 05:04:53.632638 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.632566 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9" event={"ID":"bd834832-a97c-4b3c-964e-cf1bfd6dde40","Type":"ContainerDied","Data":"26921222743afb34fa501961d0047e435de10f45fdd9883c0d27ff1f8513a0e4"} Nov 04 05:04:53.632638 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.632600 5019 scope.go:122] "RemoveContainer" containerID="274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f" Nov 04 05:04:53.643599 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.643583 5019 scope.go:122] "RemoveContainer" containerID="274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f" Nov 04 05:04:53.643957 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:04:53.643938 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f\": container with ID starting with 274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f not found: ID does not exist" containerID="274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f" Nov 04 05:04:53.644012 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.643972 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f"} err="failed to get container status \"274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f\": rpc error: code = NotFound desc = could not find container \"274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f\": container with ID starting with 274a9f864a4a9022cd2fb06ee13c2f7332c56562aed5315b51fbec162ef4378f not found: ID does not exist" Nov 04 05:04:53.708650 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.708612 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5fss\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-kube-api-access-l5fss\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.708650 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.708646 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.709021 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.708664 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.709021 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.708699 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd834832-a97c-4b3c-964e-cf1bfd6dde40-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:04:53.833203 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.833114 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9"] Nov 04 05:04:53.841832 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:53.841787 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-rl9f9"] Nov 04 05:04:54.229754 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:54.229657 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm"] Nov 04 05:04:55.124837 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:04:55.124783 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" path="/var/lib/kubelet/pods/bd834832-a97c-4b3c-964e-cf1bfd6dde40/volumes" Nov 04 05:05:06.423299 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.423249 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg"] Nov 04 05:05:06.423994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.423968 5019 cpu_manager.go:414] "containerMap: removing container" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" Nov 04 05:05:06.423994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.423992 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" Nov 04 05:05:06.424185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424055 5019 cpu_manager.go:414] "containerMap: removing container" podUID="b73ac04d-1331-4fe1-98b5-784839662231" containerName="main" Nov 04 05:05:06.424185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424062 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b73ac04d-1331-4fe1-98b5-784839662231" containerName="main" Nov 04 05:05:06.424185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424083 5019 cpu_manager.go:414] "containerMap: removing container" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" containerName="test-curl-8034-83b602" Nov 04 05:05:06.424185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424090 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" containerName="test-curl-8034-83b602" Nov 04 05:05:06.424185 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424183 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="b73ac04d-1331-4fe1-98b5-784839662231" containerName="main" Nov 04 05:05:06.424341 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424192 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="2be07f13-8cd5-471d-89b5-9d7d6446566e" containerName="test-curl-8034-83b602" Nov 04 05:05:06.424341 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.424198 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd834832-a97c-4b3c-964e-cf1bfd6dde40" containerName="istio-proxy" Nov 04 05:05:06.429170 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.429147 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444423 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444379 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444600 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444433 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444600 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444558 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444743 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444598 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444743 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444641 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444743 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444674 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444918 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444880 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbsh9\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.444974 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.444939 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.445027 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.445012 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.490955 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.490922 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg"] Nov 04 05:05:06.545528 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545496 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545724 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545541 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545724 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545570 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545724 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545660 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbsh9\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545724 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545706 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545763 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545821 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545849 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.545984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.545900 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.546183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.546056 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.546183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.546081 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.546319 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.546297 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.547223 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.547188 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.547478 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.547460 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.548515 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.548483 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.549927 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.549905 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.605509 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.605475 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.605651 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.605606 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbsh9\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:06.742764 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:06.742731 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:07.041775 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.041684 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5"] Nov 04 05:05:07.041979 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.041934 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" podUID="b69168a5-22ba-45d3-9c86-86de637096f4" containerName="maas-api" containerID="cri-o://bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4" gracePeriod=30 Nov 04 05:05:07.205927 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.205777 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg"] Nov 04 05:05:07.212527 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.212490 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:05:07.212629 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.212578 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:05:07.212629 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.212620 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:05:07.306502 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.306479 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 05:05:07.353183 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.353151 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca\") pod \"b69168a5-22ba-45d3-9c86-86de637096f4\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " Nov 04 05:05:07.353291 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.353208 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs\") pod \"b69168a5-22ba-45d3-9c86-86de637096f4\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " Nov 04 05:05:07.353359 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.353298 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\") pod \"b69168a5-22ba-45d3-9c86-86de637096f4\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " Nov 04 05:05:07.353426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.353410 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86\" (UniqueName: \"kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86\") pod \"b69168a5-22ba-45d3-9c86-86de637096f4\" (UID: \"b69168a5-22ba-45d3-9c86-86de637096f4\") " Nov 04 05:05:07.354252 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.354210 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca" pod "b69168a5-22ba-45d3-9c86-86de637096f4" (UID: "b69168a5-22ba-45d3-9c86-86de637096f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:07.356458 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.356428 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls" pod "b69168a5-22ba-45d3-9c86-86de637096f4" (UID: "b69168a5-22ba-45d3-9c86-86de637096f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:07.357122 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.357100 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs" pod "b69168a5-22ba-45d3-9c86-86de637096f4" (UID: "b69168a5-22ba-45d3-9c86-86de637096f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:07.373973 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.373945 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86" pod "b69168a5-22ba-45d3-9c86-86de637096f4" (UID: "b69168a5-22ba-45d3-9c86-86de637096f4"). InnerVolumeSpecName "kube-api-access-ksn86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:07.454903 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.454867 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksn86\" (UniqueName: \"kubernetes.io/projected/b69168a5-22ba-45d3-9c86-86de637096f4-kube-api-access-ksn86\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:07.454903 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.454896 5019 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b69168a5-22ba-45d3-9c86-86de637096f4-openshift-service-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:07.454903 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.454909 5019 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-metrics-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:07.455516 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.454922 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b69168a5-22ba-45d3-9c86-86de637096f4-maas-api-tls\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:07.731222 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.731174 5019 generic.go:356] "Generic (PLEG): container finished" podID="b69168a5-22ba-45d3-9c86-86de637096f4" containerID="bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4" exitCode=0 Nov 04 05:05:07.731416 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.731379 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" event={"ID":"b69168a5-22ba-45d3-9c86-86de637096f4","Type":"ContainerDied","Data":"bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4"} Nov 04 05:05:07.731497 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.731433 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" event={"ID":"b69168a5-22ba-45d3-9c86-86de637096f4","Type":"ContainerDied","Data":"a8f99dd4117ad73ece37d1d527cc2153e3220e592ce7dde6b4b189cc9689bd08"} Nov 04 05:05:07.731497 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.731470 5019 scope.go:122] "RemoveContainer" containerID="bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4" Nov 04 05:05:07.731652 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.731633 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5" Nov 04 05:05:07.735591 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.735564 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" event={"ID":"53fe6acf-fd01-40f1-a21c-dce836971c16","Type":"ContainerStarted","Data":"f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470"} Nov 04 05:05:07.735720 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.735619 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" event={"ID":"53fe6acf-fd01-40f1-a21c-dce836971c16","Type":"ContainerStarted","Data":"4cd68699846683af6695632729fb751e5e7ab71484dee80a7e7a0030d3b0bd3f"} Nov 04 05:05:07.749867 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.749749 5019 scope.go:122] "RemoveContainer" containerID="bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4" Nov 04 05:05:07.749867 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.749768 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:07.753577 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:07.753545 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4\": container with ID starting with bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4 not found: ID does not exist" containerID="bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4" Nov 04 05:05:07.753705 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.753588 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4"} err="failed to get container status \"bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4\": rpc error: code = NotFound desc = could not find container \"bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4\": container with ID starting with bcb838c61ca1c2949eb250037119a9ae372f95533061170ff89d2234217d5ad4 not found: ID does not exist" Nov 04 05:05:07.907477 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.907386 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5"] Nov 04 05:05:07.910684 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:07.910655 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-dab70d-775546c756-pzts5"] Nov 04 05:05:08.060818 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:08.056958 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podStartSLOduration=2.056930983 podStartE2EDuration="2.056930983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:05:08.024206052 +0000 UTC m=+1081.066620683" watchObservedRunningTime="2026-11-04 05:05:08.056930983 +0000 UTC m=+1081.099345613" Nov 04 05:05:08.761858 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:08.761778 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 04 05:05:08.762249 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:08.761867 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 04 05:05:09.124072 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.123991 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b69168a5-22ba-45d3-9c86-86de637096f4" path="/var/lib/kubelet/pods/b69168a5-22ba-45d3-9c86-86de637096f4/volumes" Nov 04 05:05:09.257071 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.257022 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" podUID="662860ba-2989-452d-a824-06008cd34c4b" containerName="main" containerID="cri-o://44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6" gracePeriod=45 Nov 04 05:05:09.292697 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.292651 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" podUID="662860ba-2989-452d-a824-06008cd34c4b" containerName="main" probeResult="failure" output="Get \"https://10.132.0.61:8000/ready\": dial tcp 10.132.0.61:8000: connect: connection refused" Nov 04 05:05:09.521706 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.521679 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 05:05:09.587296 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587260 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99\" (UniqueName: \"kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99\") pod \"662860ba-2989-452d-a824-06008cd34c4b\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " Nov 04 05:05:09.587501 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587385 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir\") pod \"662860ba-2989-452d-a824-06008cd34c4b\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " Nov 04 05:05:09.587501 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587432 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache\") pod \"662860ba-2989-452d-a824-06008cd34c4b\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " Nov 04 05:05:09.587501 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587464 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm\") pod \"662860ba-2989-452d-a824-06008cd34c4b\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " Nov 04 05:05:09.587660 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587499 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home\") pod \"662860ba-2989-452d-a824-06008cd34c4b\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " Nov 04 05:05:09.587660 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587565 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs\" (UniqueName: \"kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs\") pod \"662860ba-2989-452d-a824-06008cd34c4b\" (UID: \"662860ba-2989-452d-a824-06008cd34c4b\") " Nov 04 05:05:09.587660 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587637 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache" pod "662860ba-2989-452d-a824-06008cd34c4b" (UID: "662860ba-2989-452d-a824-06008cd34c4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:09.587843 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587677 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir" pod "662860ba-2989-452d-a824-06008cd34c4b" (UID: "662860ba-2989-452d-a824-06008cd34c4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:09.587843 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587765 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home" pod "662860ba-2989-452d-a824-06008cd34c4b" (UID: "662860ba-2989-452d-a824-06008cd34c4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:09.587956 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587933 5019 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-tmp-dir\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:09.587956 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587948 5019 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-model-cache\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:09.587956 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.587956 5019 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-home\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:09.589887 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.589866 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs" pod "662860ba-2989-452d-a824-06008cd34c4b" (UID: "662860ba-2989-452d-a824-06008cd34c4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:09.590146 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.590130 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99" pod "662860ba-2989-452d-a824-06008cd34c4b" (UID: "662860ba-2989-452d-a824-06008cd34c4b"). InnerVolumeSpecName "kube-api-access-2pc99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:09.590146 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.590129 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm" pod "662860ba-2989-452d-a824-06008cd34c4b" (UID: "662860ba-2989-452d-a824-06008cd34c4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:09.689143 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.689056 5019 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/662860ba-2989-452d-a824-06008cd34c4b-dshm\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:09.689143 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.689099 5019 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662860ba-2989-452d-a824-06008cd34c4b-tls-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:09.689143 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.689117 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pc99\" (UniqueName: \"kubernetes.io/projected/662860ba-2989-452d-a824-06008cd34c4b-kube-api-access-2pc99\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:09.757618 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.757117 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 04 05:05:09.757618 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.757196 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 04 05:05:09.768701 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.768664 5019 generic.go:356] "Generic (PLEG): container finished" podID="662860ba-2989-452d-a824-06008cd34c4b" containerID="44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6" exitCode=0 Nov 04 05:05:09.769217 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.768766 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" Nov 04 05:05:09.769217 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.768821 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" event={"ID":"662860ba-2989-452d-a824-06008cd34c4b","Type":"ContainerDied","Data":"44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6"} Nov 04 05:05:09.769217 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.768872 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm" event={"ID":"662860ba-2989-452d-a824-06008cd34c4b","Type":"ContainerDied","Data":"b6979b4e7f1725c418af5c44d8bf8f6b1e155d55a426f4a8e4674d2e720aa4e1"} Nov 04 05:05:09.769217 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.768895 5019 scope.go:122] "RemoveContainer" containerID="44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6" Nov 04 05:05:09.781886 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.781787 5019 scope.go:122] "RemoveContainer" containerID="44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6" Nov 04 05:05:09.782153 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:09.782132 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6\": container with ID starting with 44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6 not found: ID does not exist" containerID="44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6" Nov 04 05:05:09.782204 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.782164 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6"} err="failed to get container status \"44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6\": rpc error: code = NotFound desc = could not find container \"44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6\": container with ID starting with 44b75c13815ffd3c4b972099963de44dfb93a8d260e0a609fc11a13d45caa4d6 not found: ID does not exist" Nov 04 05:05:09.948877 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.947381 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm"] Nov 04 05:05:09.956902 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:09.956871 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-3eb31c/simulator-w4-3eb31c-kserve-664568bbc8-gk9tm"] Nov 04 05:05:10.743659 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:10.743215 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 04 05:05:10.743659 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:10.743279 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 04 05:05:11.124150 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:11.124072 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="662860ba-2989-452d-a824-06008cd34c4b" path="/var/lib/kubelet/pods/662860ba-2989-452d-a824-06008cd34c4b/volumes" Nov 04 05:05:11.748823 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:11.748229 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 04 05:05:11.748823 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:11.748302 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 04 05:05:12.755821 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:12.746197 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 04 05:05:12.755821 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:12.746260 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 04 05:05:13.743877 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:13.743832 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 04 05:05:13.744089 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:13.743903 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 04 05:05:14.748396 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:14.748359 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:14.748812 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:14.748693 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:14.749535 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:14.749512 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:05:20.309934 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:20.309905 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt"] Nov 04 05:05:20.310352 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:20.310121 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" containerID="cri-o://25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3" gracePeriod=30 Nov 04 05:05:21.488965 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:21.488931 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:05:22.679689 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:22.679647 5019 patch_prober.go:29] interesting pod/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:05:22.680201 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:22.679726 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:05:23.756979 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:23.756948 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f"] Nov 04 05:05:23.757452 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:23.757151 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" podUID="0e4c143d-58c9-4b91-9f83-b7cd55fca53b" containerName="maas-api" containerID="cri-o://49d7f1c53bad6bf2c22c60307fc2068458da967b6b084a7d4121fb00289b1bae" gracePeriod=30 Nov 04 05:05:23.877831 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:23.877766 5019 generic.go:356] "Generic (PLEG): container finished" podID="0e4c143d-58c9-4b91-9f83-b7cd55fca53b" containerID="49d7f1c53bad6bf2c22c60307fc2068458da967b6b084a7d4121fb00289b1bae" exitCode=0 Nov 04 05:05:23.877970 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:23.877844 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" event={"ID":"0e4c143d-58c9-4b91-9f83-b7cd55fca53b","Type":"ContainerDied","Data":"49d7f1c53bad6bf2c22c60307fc2068458da967b6b084a7d4121fb00289b1bae"} Nov 04 05:05:24.048310 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.048280 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 05:05:24.070702 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.070658 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\") pod \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " Nov 04 05:05:24.070886 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.070810 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc\" (UniqueName: \"kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc\") pod \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " Nov 04 05:05:24.070946 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.070929 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca\") pod \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " Nov 04 05:05:24.070990 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.070968 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs\") pod \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\" (UID: \"0e4c143d-58c9-4b91-9f83-b7cd55fca53b\") " Nov 04 05:05:24.071330 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.071302 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca" pod "0e4c143d-58c9-4b91-9f83-b7cd55fca53b" (UID: "0e4c143d-58c9-4b91-9f83-b7cd55fca53b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:24.073495 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.073464 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls" pod "0e4c143d-58c9-4b91-9f83-b7cd55fca53b" (UID: "0e4c143d-58c9-4b91-9f83-b7cd55fca53b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:24.073731 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.073699 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc" pod "0e4c143d-58c9-4b91-9f83-b7cd55fca53b" (UID: "0e4c143d-58c9-4b91-9f83-b7cd55fca53b"). InnerVolumeSpecName "kube-api-access-77jhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:24.073731 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.073714 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs" pod "0e4c143d-58c9-4b91-9f83-b7cd55fca53b" (UID: "0e4c143d-58c9-4b91-9f83-b7cd55fca53b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:24.172541 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.172467 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77jhc\" (UniqueName: \"kubernetes.io/projected/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-kube-api-access-77jhc\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:24.172541 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.172512 5019 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-openshift-service-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:24.172541 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.172531 5019 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-metrics-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:24.172541 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.172545 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e4c143d-58c9-4b91-9f83-b7cd55fca53b-maas-api-tls\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:24.884870 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.884839 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" Nov 04 05:05:24.885363 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.884829 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f" event={"ID":"0e4c143d-58c9-4b91-9f83-b7cd55fca53b","Type":"ContainerDied","Data":"d2b2d5f1d5e9e1438d312854489cc1f9f1be4998b97fb13f1b2ff75cf661dc63"} Nov 04 05:05:24.885363 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:24.884974 5019 scope.go:122] "RemoveContainer" containerID="49d7f1c53bad6bf2c22c60307fc2068458da967b6b084a7d4121fb00289b1bae" Nov 04 05:05:25.050707 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.050668 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f"] Nov 04 05:05:25.052908 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.052871 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-370078-647854c9d4-xqt6f"] Nov 04 05:05:25.123876 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.123846 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e4c143d-58c9-4b91-9f83-b7cd55fca53b" path="/var/lib/kubelet/pods/0e4c143d-58c9-4b91-9f83-b7cd55fca53b/volumes" Nov 04 05:05:25.590503 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.590435 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 05:05:25.687951 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.687910 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688123 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688008 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688123 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688075 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688123 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688118 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688284 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688152 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688284 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688192 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688284 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688259 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688415 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688294 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688415 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688337 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data\") pod \"2e925ba9-f57c-43d4-854b-9edfadd060e9\" (UID: \"2e925ba9-f57c-43d4-854b-9edfadd060e9\") " Nov 04 05:05:25.688951 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688255 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:25.689115 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688350 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:25.689199 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688436 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:25.689264 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688662 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:25.689330 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.688966 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:25.693085 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.692645 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:25.696494 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.696395 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:25.696494 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.696463 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:05:25.696860 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.696835 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z" pod "2e925ba9-f57c-43d4-854b-9edfadd060e9" (UID: "2e925ba9-f57c-43d4-854b-9edfadd060e9"). InnerVolumeSpecName "kube-api-access-m899z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:25.789666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789627 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789670 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e925ba9-f57c-43d4-854b-9edfadd060e9-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789685 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789699 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789712 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789726 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789741 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m899z\" (UniqueName: \"kubernetes.io/projected/2e925ba9-f57c-43d4-854b-9edfadd060e9-kube-api-access-m899z\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789756 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.789930 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.789769 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e925ba9-f57c-43d4-854b-9edfadd060e9-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:25.897881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.897491 5019 generic.go:356] "Generic (PLEG): container finished" podID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerID="25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3" exitCode=0 Nov 04 05:05:25.897881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.897573 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" Nov 04 05:05:25.897881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.897629 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" event={"ID":"2e925ba9-f57c-43d4-854b-9edfadd060e9","Type":"ContainerDied","Data":"25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3"} Nov 04 05:05:25.897881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.897714 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt" event={"ID":"2e925ba9-f57c-43d4-854b-9edfadd060e9","Type":"ContainerDied","Data":"780067f28837f329d4af3cf3ae3ee84cd6548e49f78143177b6de080be6771f7"} Nov 04 05:05:25.897881 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.897745 5019 scope.go:122] "RemoveContainer" containerID="25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3" Nov 04 05:05:25.916588 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.916562 5019 scope.go:122] "RemoveContainer" containerID="2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16" Nov 04 05:05:25.925986 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.925958 5019 scope.go:122] "RemoveContainer" containerID="25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3" Nov 04 05:05:25.926375 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:25.926348 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3\": container with ID starting with 25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3 not found: ID does not exist" containerID="25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3" Nov 04 05:05:25.926456 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.926390 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3"} err="failed to get container status \"25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3\": rpc error: code = NotFound desc = could not find container \"25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3\": container with ID starting with 25470ba99a474a13e5cb19d5dbe620668a01f12994137d5c1ff6a4a62c3358a3 not found: ID does not exist" Nov 04 05:05:25.926456 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.926417 5019 scope.go:122] "RemoveContainer" containerID="2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16" Nov 04 05:05:25.926761 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:25.926742 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16\": container with ID starting with 2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16 not found: ID does not exist" containerID="2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16" Nov 04 05:05:25.927047 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:25.926767 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16"} err="failed to get container status \"2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16\": rpc error: code = NotFound desc = could not find container \"2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16\": container with ID starting with 2418687760f12b355d7dd9c3c6ad073ada93a3f348db9efc147a8774462c3c16 not found: ID does not exist" Nov 04 05:05:26.069063 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:26.069027 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt"] Nov 04 05:05:26.073449 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:26.073415 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-dab70d-openshift-default-6496f5466c-9hqpt"] Nov 04 05:05:27.123700 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:27.123670 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" path="/var/lib/kubelet/pods/2e925ba9-f57c-43d4-854b-9edfadd060e9/volumes" Nov 04 05:05:28.497943 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:28.497908 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm"] Nov 04 05:05:28.498474 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:28.498118 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" containerID="cri-o://bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea" gracePeriod=30 Nov 04 05:05:33.772851 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.772770 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:05:33.870979 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.870943 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871168 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871027 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871168 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871063 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871168 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871109 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871168 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871129 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871401 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871176 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871401 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871231 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871401 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871267 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:33.871401 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871279 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:33.871717 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871430 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871717 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871503 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert\") pod \"e1eda615-98b0-490f-88e1-f72638931fba\" (UID: \"e1eda615-98b0-490f-88e1-f72638931fba\") " Nov 04 05:05:33.871717 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871514 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:33.871977 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871724 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:33.871977 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871939 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.871977 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871960 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.871977 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871975 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.872189 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.871989 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.872189 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.872043 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:33.874681 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.874652 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:05:33.874777 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.874663 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "kube-api-access-bqh7c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:33.874777 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.874699 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:33.876728 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.876703 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy" pod "e1eda615-98b0-490f-88e1-f72638931fba" (UID: "e1eda615-98b0-490f-88e1-f72638931fba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:33.964289 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.964252 5019 generic.go:356] "Generic (PLEG): container finished" podID="e1eda615-98b0-490f-88e1-f72638931fba" containerID="bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea" exitCode=0 Nov 04 05:05:33.964488 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.964298 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" Nov 04 05:05:33.964488 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.964321 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" event={"ID":"e1eda615-98b0-490f-88e1-f72638931fba","Type":"ContainerDied","Data":"bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea"} Nov 04 05:05:33.964488 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.964381 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm" event={"ID":"e1eda615-98b0-490f-88e1-f72638931fba","Type":"ContainerDied","Data":"ce615496b6e31ebc6fd44020bc82e75a2a584059cd711e12748b309798a053ea"} Nov 04 05:05:33.964488 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.964413 5019 scope.go:122] "RemoveContainer" containerID="bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea" Nov 04 05:05:33.972668 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.972644 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.972668 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.972669 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqh7c\" (UniqueName: \"kubernetes.io/projected/e1eda615-98b0-490f-88e1-f72638931fba-kube-api-access-bqh7c\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.972851 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.972682 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eda615-98b0-490f-88e1-f72638931fba-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.972851 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.972694 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eda615-98b0-490f-88e1-f72638931fba-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.972851 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.972704 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eda615-98b0-490f-88e1-f72638931fba-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:33.975515 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.975498 5019 scope.go:122] "RemoveContainer" containerID="bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea" Nov 04 05:05:33.975837 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:33.975779 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea\": container with ID starting with bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea not found: ID does not exist" containerID="bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea" Nov 04 05:05:33.975938 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:33.975845 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea"} err="failed to get container status \"bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea\": rpc error: code = NotFound desc = could not find container \"bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea\": container with ID starting with bd0df573d0f9c1b2b608d212acf1b2a938521b7e9e4240ba78112d9030491bea not found: ID does not exist" Nov 04 05:05:34.131207 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.131107 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm"] Nov 04 05:05:34.135302 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.135270 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-370078-openshift-default-584c45775-rvgrm"] Nov 04 05:05:34.687877 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.687845 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l"] Nov 04 05:05:34.688305 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688290 5019 cpu_manager.go:414] "containerMap: removing container" podUID="662860ba-2989-452d-a824-06008cd34c4b" containerName="main" Nov 04 05:05:34.688351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688306 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="662860ba-2989-452d-a824-06008cd34c4b" containerName="main" Nov 04 05:05:34.688351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688320 5019 cpu_manager.go:414] "containerMap: removing container" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" Nov 04 05:05:34.688351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688326 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" Nov 04 05:05:34.688351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688342 5019 cpu_manager.go:414] "containerMap: removing container" podUID="b69168a5-22ba-45d3-9c86-86de637096f4" containerName="maas-api" Nov 04 05:05:34.688351 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688347 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b69168a5-22ba-45d3-9c86-86de637096f4" containerName="maas-api" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688357 5019 cpu_manager.go:414] "containerMap: removing container" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688362 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688369 5019 cpu_manager.go:414] "containerMap: removing container" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688373 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688386 5019 cpu_manager.go:414] "containerMap: removing container" podUID="0e4c143d-58c9-4b91-9f83-b7cd55fca53b" containerName="maas-api" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688390 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e4c143d-58c9-4b91-9f83-b7cd55fca53b" containerName="maas-api" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688463 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="662860ba-2989-452d-a824-06008cd34c4b" containerName="main" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688471 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="e1eda615-98b0-490f-88e1-f72638931fba" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688479 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="b69168a5-22ba-45d3-9c86-86de637096f4" containerName="maas-api" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688486 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688491 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e925ba9-f57c-43d4-854b-9edfadd060e9" containerName="istio-proxy" Nov 04 05:05:34.688722 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.688498 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e4c143d-58c9-4b91-9f83-b7cd55fca53b" containerName="maas-api" Nov 04 05:05:34.693031 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.693012 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.748086 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.748055 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l"] Nov 04 05:05:34.780700 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.780663 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.781172 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.780720 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.781172 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.780943 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.795317 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.795280 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:05:34.795317 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.795289 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krgvj\"" Nov 04 05:05:34.882169 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.882131 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.882397 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.882229 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.882397 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.882275 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.883007 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.882979 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.884861 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.884840 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:34.939251 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:34.939178 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn\") pod \"maas-api-revoke-sub-e904c17e-msb7l\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:35.006569 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.006529 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:35.125263 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.125231 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e1eda615-98b0-490f-88e1-f72638931fba" path="/var/lib/kubelet/pods/e1eda615-98b0-490f-88e1-f72638931fba/volumes" Nov 04 05:05:35.382827 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.382779 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l"] Nov 04 05:05:35.384442 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:05:35.384419 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852ea3a9_e6d3_49d5_94dd_411b4e2f6557.slice/crio-f338058bf5cc72ad3e3eda5cf80fa7a9ca84be834585785dee0fc653c86a06a4 WatchSource:0}: Error finding container f338058bf5cc72ad3e3eda5cf80fa7a9ca84be834585785dee0fc653c86a06a4: Status 404 returned error can't find the container with id f338058bf5cc72ad3e3eda5cf80fa7a9ca84be834585785dee0fc653c86a06a4 Nov 04 05:05:35.844499 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.844453 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9"] Nov 04 05:05:35.845017 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.844717 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" containerID="cri-o://9ca4d2436f62ab717db1200fa49b17dfc24699a558a09bb7dbff627c672a3f88" gracePeriod=30 Nov 04 05:05:35.857413 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.857375 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4"] Nov 04 05:05:35.857614 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.857578 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" containerID="cri-o://be49f0cd727a26fecb8420d18c84e29b423dd3f56508bcfc414d75f3ac9b6c5f" gracePeriod=30 Nov 04 05:05:35.984750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.984658 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" event={"ID":"852ea3a9-e6d3-49d5-94dd-411b4e2f6557","Type":"ContainerStarted","Data":"b20c431fbe53b9d53fa57b8195f8f693fad738ceaf8dbbd91ea7938cc761c92d"} Nov 04 05:05:35.984750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:35.984739 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" event={"ID":"852ea3a9-e6d3-49d5-94dd-411b4e2f6557","Type":"ContainerStarted","Data":"f338058bf5cc72ad3e3eda5cf80fa7a9ca84be834585785dee0fc653c86a06a4"} Nov 04 05:05:36.214158 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:36.214098 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" podStartSLOduration=2.2140817999999998 podStartE2EDuration="2.2140818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:05:36.21265415 +0000 UTC m=+1109.255068791" watchObservedRunningTime="2026-11-04 05:05:36.2140818 +0000 UTC m=+1109.256496427" Nov 04 05:05:36.993089 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:36.993057 5019 generic.go:356] "Generic (PLEG): container finished" podID="852ea3a9-e6d3-49d5-94dd-411b4e2f6557" containerID="b20c431fbe53b9d53fa57b8195f8f693fad738ceaf8dbbd91ea7938cc761c92d" exitCode=0 Nov 04 05:05:36.993502 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:36.993135 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" event={"ID":"852ea3a9-e6d3-49d5-94dd-411b4e2f6557","Type":"ContainerDied","Data":"b20c431fbe53b9d53fa57b8195f8f693fad738ceaf8dbbd91ea7938cc761c92d"} Nov 04 05:05:38.149818 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.149779 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:38.219161 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.219123 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca\") pod \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " Nov 04 05:05:38.219161 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.219162 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn\") pod \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " Nov 04 05:05:38.219393 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.219242 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca\") pod \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\" (UID: \"852ea3a9-e6d3-49d5-94dd-411b4e2f6557\") " Nov 04 05:05:38.219662 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.219631 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca" pod "852ea3a9-e6d3-49d5-94dd-411b4e2f6557" (UID: "852ea3a9-e6d3-49d5-94dd-411b4e2f6557"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:38.221593 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.221564 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca" pod "852ea3a9-e6d3-49d5-94dd-411b4e2f6557" (UID: "852ea3a9-e6d3-49d5-94dd-411b4e2f6557"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:38.221699 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.221676 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn" pod "852ea3a9-e6d3-49d5-94dd-411b4e2f6557" (UID: "852ea3a9-e6d3-49d5-94dd-411b4e2f6557"). InnerVolumeSpecName "kube-api-access-g6znn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:38.320508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.320422 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-openshift-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:38.320508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.320454 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-maas-api-xks-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:38.320508 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:38.320464 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6znn\" (UniqueName: \"kubernetes.io/projected/852ea3a9-e6d3-49d5-94dd-411b4e2f6557-kube-api-access-g6znn\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:39.008340 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:39.008306 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" event={"ID":"852ea3a9-e6d3-49d5-94dd-411b4e2f6557","Type":"ContainerDied","Data":"f338058bf5cc72ad3e3eda5cf80fa7a9ca84be834585785dee0fc653c86a06a4"} Nov 04 05:05:39.008522 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:39.008353 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f338058bf5cc72ad3e3eda5cf80fa7a9ca84be834585785dee0fc653c86a06a4" Nov 04 05:05:39.008522 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:39.008317 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l" Nov 04 05:05:41.023505 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.023370 5019 generic.go:356] "Generic (PLEG): container finished" podID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerID="9ca4d2436f62ab717db1200fa49b17dfc24699a558a09bb7dbff627c672a3f88" exitCode=0 Nov 04 05:05:41.023505 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.023471 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" event={"ID":"11afcd86-31bf-42e7-b91b-f9385c1fa27c","Type":"ContainerDied","Data":"9ca4d2436f62ab717db1200fa49b17dfc24699a558a09bb7dbff627c672a3f88"} Nov 04 05:05:41.024042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.023555 5019 scope.go:122] "RemoveContainer" containerID="ee9ff255e278408b0548c8d1d999ba27ff644fd3062ba474590f5fe1d0836df6" Nov 04 05:05:41.028210 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.028179 5019 generic.go:356] "Generic (PLEG): container finished" podID="1e70886f-792d-42e9-b04b-6392aa85a199" containerID="be49f0cd727a26fecb8420d18c84e29b423dd3f56508bcfc414d75f3ac9b6c5f" exitCode=0 Nov 04 05:05:41.028330 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.028238 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" event={"ID":"1e70886f-792d-42e9-b04b-6392aa85a199","Type":"ContainerDied","Data":"be49f0cd727a26fecb8420d18c84e29b423dd3f56508bcfc414d75f3ac9b6c5f"} Nov 04 05:05:41.150638 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.150607 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 05:05:41.153880 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.153841 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:05:41.252574 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252534 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.252783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252588 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.252783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252620 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.252783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252680 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.252783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252706 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.252783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252759 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252785 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252846 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252903 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252922 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.252934 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253060 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253104 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253095 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253124 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253160 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket\") pod \"1e70886f-792d-42e9-b04b-6392aa85a199\" (UID: \"1e70886f-792d-42e9-b04b-6392aa85a199\") " Nov 04 05:05:41.253426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253193 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.253426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253238 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.253426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253286 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.253426 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253323 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy\") pod \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\" (UID: \"11afcd86-31bf-42e7-b91b-f9385c1fa27c\") " Nov 04 05:05:41.253745 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253697 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.253987 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253057 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253072 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253213 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253232 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253346 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253428 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253652 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.254078 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.253688 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:41.254485 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.254149 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.256356 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.256327 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "kube-api-access-dzlzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:41.256497 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.256471 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:05:41.256762 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.256740 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.256762 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.256743 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:41.256909 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.256751 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "kube-api-access-47ns2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:41.256947 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.256904 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:05:41.257538 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.257523 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token" pod "1e70886f-792d-42e9-b04b-6392aa85a199" (UID: "1e70886f-792d-42e9-b04b-6392aa85a199"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:41.258055 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.258037 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo" pod "11afcd86-31bf-42e7-b91b-f9385c1fa27c" (UID: "11afcd86-31bf-42e7-b91b-f9385c1fa27c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:05:41.354536 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354498 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354536 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354529 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzlzs\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-kube-api-access-dzlzs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354536 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354539 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354549 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354558 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354566 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47ns2\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-kube-api-access-47ns2\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354574 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354582 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354591 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e70886f-792d-42e9-b04b-6392aa85a199-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354599 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e70886f-792d-42e9-b04b-6392aa85a199-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354606 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e70886f-792d-42e9-b04b-6392aa85a199-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354614 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354622 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e70886f-792d-42e9-b04b-6392aa85a199-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354631 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354639 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354646 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:41.354790 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:41.354654 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11afcd86-31bf-42e7-b91b-f9385c1fa27c-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:42.035674 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.035645 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" Nov 04 05:05:42.035674 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.035655 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9" event={"ID":"11afcd86-31bf-42e7-b91b-f9385c1fa27c","Type":"ContainerDied","Data":"e95b15243b0572a94c070075be78f6a0125907370d83a6c775a9d96acd29fb8c"} Nov 04 05:05:42.036219 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.035712 5019 scope.go:122] "RemoveContainer" containerID="9ca4d2436f62ab717db1200fa49b17dfc24699a558a09bb7dbff627c672a3f88" Nov 04 05:05:42.037390 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.037370 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" Nov 04 05:05:42.037503 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.037403 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4" event={"ID":"1e70886f-792d-42e9-b04b-6392aa85a199","Type":"ContainerDied","Data":"8d9964361121f9a9c5ddb2929f8aa8403c62130838f549e8eb8be239afd2014c"} Nov 04 05:05:42.046623 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.046598 5019 scope.go:122] "RemoveContainer" containerID="be49f0cd727a26fecb8420d18c84e29b423dd3f56508bcfc414d75f3ac9b6c5f" Nov 04 05:05:42.202837 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.202693 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9"] Nov 04 05:05:42.231677 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.231647 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-rfzt9"] Nov 04 05:05:42.315618 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.315584 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4"] Nov 04 05:05:42.318680 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:42.318652 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3eb31c-openshift-default-7f69d85f95-kc7b4"] Nov 04 05:05:43.124557 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:43.124522 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" path="/var/lib/kubelet/pods/11afcd86-31bf-42e7-b91b-f9385c1fa27c/volumes" Nov 04 05:05:43.124992 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:43.124978 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" path="/var/lib/kubelet/pods/1e70886f-792d-42e9-b04b-6392aa85a199/volumes" Nov 04 05:05:49.028856 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.028767 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s"] Nov 04 05:05:49.029267 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029250 5019 cpu_manager.go:414] "containerMap: removing container" podUID="852ea3a9-e6d3-49d5-94dd-411b4e2f6557" containerName="revoke-keys" Nov 04 05:05:49.029313 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029270 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="852ea3a9-e6d3-49d5-94dd-411b4e2f6557" containerName="revoke-keys" Nov 04 05:05:49.029313 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029281 5019 cpu_manager.go:414] "containerMap: removing container" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" Nov 04 05:05:49.029313 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029286 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" Nov 04 05:05:49.029313 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029294 5019 cpu_manager.go:414] "containerMap: removing container" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" Nov 04 05:05:49.029313 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029298 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" Nov 04 05:05:49.029450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029316 5019 cpu_manager.go:414] "containerMap: removing container" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" Nov 04 05:05:49.029450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029321 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" Nov 04 05:05:49.029450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029388 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="852ea3a9-e6d3-49d5-94dd-411b4e2f6557" containerName="revoke-keys" Nov 04 05:05:49.029450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029394 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" Nov 04 05:05:49.029450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029400 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e70886f-792d-42e9-b04b-6392aa85a199" containerName="istio-proxy" Nov 04 05:05:49.029450 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.029407 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="11afcd86-31bf-42e7-b91b-f9385c1fa27c" containerName="istio-proxy" Nov 04 05:05:49.034264 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.034230 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.091080 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.091047 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s"] Nov 04 05:05:49.133275 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.133233 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mskhc\" (UniqueName: \"kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.133462 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.133342 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.133462 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.133394 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.137611 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.137583 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 04 05:05:49.137611 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.137609 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-krgvj\"" Nov 04 05:05:49.233933 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.233889 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.234091 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.233960 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.234091 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.234041 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mskhc\" (UniqueName: \"kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.234602 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.234582 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.236488 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.236471 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.291177 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.291100 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mskhc\" (UniqueName: \"kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc\") pod \"maas-api-revoke-sub-dfd89bae-8rl2s\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.348278 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.348243 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:49.725538 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:49.725513 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s"] Nov 04 05:05:49.727668 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:05:49.727618 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3042350_c276_4781_abe4_67959b637c1e.slice/crio-d14ef4a7d95c6ad27e0bf70cd853eb4cca7689d8fcfc3edddd5468efa3fd3dd9 WatchSource:0}: Error finding container d14ef4a7d95c6ad27e0bf70cd853eb4cca7689d8fcfc3edddd5468efa3fd3dd9: Status 404 returned error can't find the container with id d14ef4a7d95c6ad27e0bf70cd853eb4cca7689d8fcfc3edddd5468efa3fd3dd9 Nov 04 05:05:50.105484 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:50.105436 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" event={"ID":"f3042350-c276-4781-abe4-67959b637c1e","Type":"ContainerStarted","Data":"c758c1a697b473383f545997e595c6b2184b1bf99e37fac4afc42bb33630d369"} Nov 04 05:05:50.105875 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:50.105532 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" event={"ID":"f3042350-c276-4781-abe4-67959b637c1e","Type":"ContainerStarted","Data":"d14ef4a7d95c6ad27e0bf70cd853eb4cca7689d8fcfc3edddd5468efa3fd3dd9"} Nov 04 05:05:50.221772 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:50.221706 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" podStartSLOduration=2.221687885 podStartE2EDuration="2.221687885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:05:50.219905964 +0000 UTC m=+1123.262320591" watchObservedRunningTime="2026-11-04 05:05:50.221687885 +0000 UTC m=+1123.264102514" Nov 04 05:05:51.113158 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:51.113125 5019 generic.go:356] "Generic (PLEG): container finished" podID="f3042350-c276-4781-abe4-67959b637c1e" containerID="c758c1a697b473383f545997e595c6b2184b1bf99e37fac4afc42bb33630d369" exitCode=0 Nov 04 05:05:51.113572 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:51.113223 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" event={"ID":"f3042350-c276-4781-abe4-67959b637c1e","Type":"ContainerDied","Data":"c758c1a697b473383f545997e595c6b2184b1bf99e37fac4afc42bb33630d369"} Nov 04 05:05:51.489728 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:05:51.489642 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:05:52.268944 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.268917 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:52.366023 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.365988 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca\") pod \"f3042350-c276-4781-abe4-67959b637c1e\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " Nov 04 05:05:52.366212 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.366095 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc\" (UniqueName: \"kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc\") pod \"f3042350-c276-4781-abe4-67959b637c1e\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " Nov 04 05:05:52.366212 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.366145 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca\") pod \"f3042350-c276-4781-abe4-67959b637c1e\" (UID: \"f3042350-c276-4781-abe4-67959b637c1e\") " Nov 04 05:05:52.366553 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.366526 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca" pod "f3042350-c276-4781-abe4-67959b637c1e" (UID: "f3042350-c276-4781-abe4-67959b637c1e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:05:52.368542 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.368510 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc" pod "f3042350-c276-4781-abe4-67959b637c1e" (UID: "f3042350-c276-4781-abe4-67959b637c1e"). InnerVolumeSpecName "kube-api-access-mskhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:05:52.368678 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.368616 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca" pod "f3042350-c276-4781-abe4-67959b637c1e" (UID: "f3042350-c276-4781-abe4-67959b637c1e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 04 05:05:52.374990 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.374960 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl"] Nov 04 05:05:52.375557 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.375531 5019 cpu_manager.go:414] "containerMap: removing container" podUID="f3042350-c276-4781-abe4-67959b637c1e" containerName="revoke-keys" Nov 04 05:05:52.375557 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.375554 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f3042350-c276-4781-abe4-67959b637c1e" containerName="revoke-keys" Nov 04 05:05:52.375711 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.375664 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="f3042350-c276-4781-abe4-67959b637c1e" containerName="revoke-keys" Nov 04 05:05:52.378963 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.378941 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.425479 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.425443 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl"] Nov 04 05:05:52.467080 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.467037 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mskhc\" (UniqueName: \"kubernetes.io/projected/f3042350-c276-4781-abe4-67959b637c1e-kube-api-access-mskhc\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:52.467080 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.467072 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f3042350-c276-4781-abe4-67959b637c1e-maas-api-openshift-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:52.467080 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.467088 5019 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f3042350-c276-4781-abe4-67959b637c1e-maas-api-xks-ca\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:05:52.568007 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.567959 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568199 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568024 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568199 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568129 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568199 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568191 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568306 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568269 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568339 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568303 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568339 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568326 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6q2\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568403 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568378 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.568433 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.568415 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669641 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669542 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669641 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669597 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669641 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669627 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669656 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6q2\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669679 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669703 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669732 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669787 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.669994 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.669857 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.670327 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.670159 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.670427 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.670405 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.670473 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.670440 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.670526 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.670505 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.670617 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.670529 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.672234 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.672210 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.672529 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.672509 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.727288 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.727244 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:52.727439 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:52.727305 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6q2\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2\") pod \"e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:53.008188 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.008144 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:53.127283 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.127254 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" Nov 04 05:05:53.127605 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.127574 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s" event={"ID":"f3042350-c276-4781-abe4-67959b637c1e","Type":"ContainerDied","Data":"d14ef4a7d95c6ad27e0bf70cd853eb4cca7689d8fcfc3edddd5468efa3fd3dd9"} Nov 04 05:05:53.127605 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.127634 5019 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d14ef4a7d95c6ad27e0bf70cd853eb4cca7689d8fcfc3edddd5468efa3fd3dd9" Nov 04 05:05:53.440750 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.440719 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl"] Nov 04 05:05:53.443121 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:05:53.443092 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b08362c_d180_415d_bea8_488f017a2fd9.slice/crio-d4f8dae921e8f4572e92bccdc1d1520b113ba58eb985afffa2fc88f3bc1127bc WatchSource:0}: Error finding container d4f8dae921e8f4572e92bccdc1d1520b113ba58eb985afffa2fc88f3bc1127bc: Status 404 returned error can't find the container with id d4f8dae921e8f4572e92bccdc1d1520b113ba58eb985afffa2fc88f3bc1127bc Nov 04 05:05:53.445527 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.445484 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:05:53.445616 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.445584 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:05:53.445655 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:53.445633 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:05:54.158335 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:54.158271 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" event={"ID":"0b08362c-d180-415d-bea8-488f017a2fd9","Type":"ContainerStarted","Data":"2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e"} Nov 04 05:05:54.158540 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:54.158350 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" event={"ID":"0b08362c-d180-415d-bea8-488f017a2fd9","Type":"ContainerStarted","Data":"d4f8dae921e8f4572e92bccdc1d1520b113ba58eb985afffa2fc88f3bc1127bc"} Nov 04 05:05:54.340822 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:54.332329 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podStartSLOduration=2.332306152 podStartE2EDuration="2.332306152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:05:54.325789975 +0000 UTC m=+1127.368204602" watchObservedRunningTime="2026-11-04 05:05:54.332306152 +0000 UTC m=+1127.374720781" Nov 04 05:05:55.008481 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:55.008444 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:05:55.009987 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:55.009959 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 04 05:05:55.010115 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:55.010009 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 04 05:05:56.009512 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:56.009462 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 04 05:05:56.010067 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:56.009541 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 04 05:05:57.009307 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:57.009268 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 04 05:05:57.009521 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:57.009350 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 04 05:05:58.008705 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:58.008663 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 04 05:05:58.009159 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:58.008745 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 04 05:05:59.009283 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:59.009248 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 04 05:05:59.009686 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:05:59.009334 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 04 05:06:00.008962 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:00.008920 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 04 05:06:00.009152 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:00.008987 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 04 05:06:02.050031 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:02.049982 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 04 05:06:02.050575 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:02.050083 5019 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 04 05:06:02.345695 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:02.345608 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:06:02.346065 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:02.346041 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:06:02.346843 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:02.346825 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:06:21.490448 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:21.490409 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:06:22.970061 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:22.970018 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl"] Nov 04 05:06:22.970588 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:22.970348 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" containerID="cri-o://2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e" gracePeriod=30 Nov 04 05:06:22.988862 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:22.988824 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh"] Nov 04 05:06:22.989065 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:22.989029 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" containerID="cri-o://815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef" gracePeriod=30 Nov 04 05:06:27.703106 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:27.703061 5019 patch_prober.go:29] interesting pod/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:06:27.703515 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:27.703141 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:06:28.257764 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.257733 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:06:28.290234 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.290201 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:06:28.299490 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299465 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.299636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299500 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.299636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299526 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.299636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299568 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.299636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299603 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.299636 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299633 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.299941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299679 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.299941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299731 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.299941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299779 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.299941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299848 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.299941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299885 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.299941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299939 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.300240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.299976 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.300240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300019 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.300240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300029 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.300240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300122 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.300240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300189 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.300240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300229 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert\") pod \"0b08362c-d180-415d-bea8-488f017a2fd9\" (UID: \"0b08362c-d180-415d-bea8-488f017a2fd9\") " Nov 04 05:06:28.300514 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300269 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token\") pod \"569a4206-5505-4353-8ea7-68a686bd4585\" (UID: \"569a4206-5505-4353-8ea7-68a686bd4585\") " Nov 04 05:06:28.300514 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300484 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:06:28.300724 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300689 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/569a4206-5505-4353-8ea7-68a686bd4585-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.301410 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300849 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.301525 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300882 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.301757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.300977 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.301757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.301135 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.301757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.301167 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.301757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.301178 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.301757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.301405 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.301757 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.301527 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:06:28.302136 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.301844 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.302200 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.302178 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "kube-api-access-9r6q2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:28.302445 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.302425 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "kube-api-access-5zz8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:28.303358 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.303340 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.303572 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.303545 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:06:28.303670 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.303645 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:06:28.304238 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.304219 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token" pod "0b08362c-d180-415d-bea8-488f017a2fd9" (UID: "0b08362c-d180-415d-bea8-488f017a2fd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:28.304503 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.304484 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:28.304919 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.304899 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token" pod "569a4206-5505-4353-8ea7-68a686bd4585" (UID: "569a4206-5505-4353-8ea7-68a686bd4585"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:28.378583 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.378543 5019 generic.go:356] "Generic (PLEG): container finished" podID="569a4206-5505-4353-8ea7-68a686bd4585" containerID="815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef" exitCode=0 Nov 04 05:06:28.378785 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.378593 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" Nov 04 05:06:28.378785 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.378636 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" event={"ID":"569a4206-5505-4353-8ea7-68a686bd4585","Type":"ContainerDied","Data":"815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef"} Nov 04 05:06:28.378785 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.378704 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh" event={"ID":"569a4206-5505-4353-8ea7-68a686bd4585","Type":"ContainerDied","Data":"7d06edce39f3eb10246479b9a7f063ed5aa57dfadeba367893da7641aff35765"} Nov 04 05:06:28.378785 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.378736 5019 scope.go:122] "RemoveContainer" containerID="815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef" Nov 04 05:06:28.380165 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.380146 5019 generic.go:356] "Generic (PLEG): container finished" podID="0b08362c-d180-415d-bea8-488f017a2fd9" containerID="2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e" exitCode=0 Nov 04 05:06:28.380456 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.380203 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" Nov 04 05:06:28.380456 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.380239 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" event={"ID":"0b08362c-d180-415d-bea8-488f017a2fd9","Type":"ContainerDied","Data":"2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e"} Nov 04 05:06:28.380456 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.380292 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl" event={"ID":"0b08362c-d180-415d-bea8-488f017a2fd9","Type":"ContainerDied","Data":"d4f8dae921e8f4572e92bccdc1d1520b113ba58eb985afffa2fc88f3bc1127bc"} Nov 04 05:06:28.389097 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.389027 5019 scope.go:122] "RemoveContainer" containerID="815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef" Nov 04 05:06:28.389420 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:28.389395 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef\": container with ID starting with 815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef not found: ID does not exist" containerID="815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef" Nov 04 05:06:28.389502 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.389436 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef"} err="failed to get container status \"815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef\": rpc error: code = NotFound desc = could not find container \"815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef\": container with ID starting with 815b16179c61816f0b12f43c0835be4a729da2be083da52f5e42a1601f8ffaef not found: ID does not exist" Nov 04 05:06:28.389502 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.389462 5019 scope.go:122] "RemoveContainer" containerID="2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e" Nov 04 05:06:28.398829 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.398781 5019 scope.go:122] "RemoveContainer" containerID="2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e" Nov 04 05:06:28.399159 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:28.399137 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e\": container with ID starting with 2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e not found: ID does not exist" containerID="2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e" Nov 04 05:06:28.399225 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.399171 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e"} err="failed to get container status \"2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e\": rpc error: code = NotFound desc = could not find container \"2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e\": container with ID starting with 2b011fca7865d8fc196647b81b874ecf99eebeb3afe24f8427d2d83ab2beba8e not found: ID does not exist" Nov 04 05:06:28.401667 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401642 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401668 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401678 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401687 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b08362c-d180-415d-bea8-488f017a2fd9-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401695 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401704 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401712 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zz8l\" (UniqueName: \"kubernetes.io/projected/569a4206-5505-4353-8ea7-68a686bd4585-kube-api-access-5zz8l\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401721 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r6q2\" (UniqueName: \"kubernetes.io/projected/0b08362c-d180-415d-bea8-488f017a2fd9-kube-api-access-9r6q2\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401729 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.401739 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401738 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b08362c-d180-415d-bea8-488f017a2fd9-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.402042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401748 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.402042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401757 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/569a4206-5505-4353-8ea7-68a686bd4585-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.402042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401765 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.402042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401773 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.402042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401781 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/569a4206-5505-4353-8ea7-68a686bd4585-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.402042 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.401789 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b08362c-d180-415d-bea8-488f017a2fd9-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:28.537617 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.537576 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl"] Nov 04 05:06:28.542066 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.542035 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-mfsjl"] Nov 04 05:06:28.715193 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.715165 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh"] Nov 04 05:06:28.723074 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:28.723035 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-cedfca-openshift-default-6b99d7696f-lg5qh"] Nov 04 05:06:29.124677 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:29.124642 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" path="/var/lib/kubelet/pods/0b08362c-d180-415d-bea8-488f017a2fd9/volumes" Nov 04 05:06:29.125115 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:29.125100 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="569a4206-5505-4353-8ea7-68a686bd4585" path="/var/lib/kubelet/pods/569a4206-5505-4353-8ea7-68a686bd4585/volumes" Nov 04 05:06:37.063002 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.062963 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn"] Nov 04 05:06:37.063435 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.063420 5019 cpu_manager.go:414] "containerMap: removing container" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" Nov 04 05:06:37.063435 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.063433 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" Nov 04 05:06:37.063517 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.063449 5019 cpu_manager.go:414] "containerMap: removing container" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" Nov 04 05:06:37.063517 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.063454 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" Nov 04 05:06:37.063580 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.063534 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b08362c-d180-415d-bea8-488f017a2fd9" containerName="istio-proxy" Nov 04 05:06:37.063580 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.063545 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="569a4206-5505-4353-8ea7-68a686bd4585" containerName="istio-proxy" Nov 04 05:06:37.068197 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.068173 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.173860 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.173827 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn"] Nov 04 05:06:37.189492 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189455 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189492 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189493 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189748 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189526 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189748 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189612 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189748 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189640 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnzwv\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189931 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189763 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189931 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189844 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.189931 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189911 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.190109 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.189959 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.290929 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.290896 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.290929 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.290936 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.290964 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.290986 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291008 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnzwv\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291070 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291108 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291194 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291135 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291498 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291204 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291498 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291352 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291498 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291365 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291649 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291587 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291692 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291670 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.291910 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.291884 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.293622 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.293600 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.293716 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.293661 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.350783 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.350707 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.351125 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.351102 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnzwv\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv\") pod \"e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.382996 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.382958 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:37.814223 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.814194 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn"] Nov 04 05:06:37.816609 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:06:37.816566 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9879e6d_af60_475e_8214_7c35a0404c88.slice/crio-b13618b253b4b71cb38e61f1ffcec042f00c47b0517e73aa86500324b4c24e0d WatchSource:0}: Error finding container b13618b253b4b71cb38e61f1ffcec042f00c47b0517e73aa86500324b4c24e0d: Status 404 returned error can't find the container with id b13618b253b4b71cb38e61f1ffcec042f00c47b0517e73aa86500324b4c24e0d Nov 04 05:06:37.818924 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.818895 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:06:37.819004 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.818962 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:06:37.819004 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:37.818990 5019 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 04 05:06:38.445987 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:38.445949 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" event={"ID":"e9879e6d-af60-475e-8214-7c35a0404c88","Type":"ContainerStarted","Data":"30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75"} Nov 04 05:06:38.446431 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:38.446033 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" event={"ID":"e9879e6d-af60-475e-8214-7c35a0404c88","Type":"ContainerStarted","Data":"b13618b253b4b71cb38e61f1ffcec042f00c47b0517e73aa86500324b4c24e0d"} Nov 04 05:06:38.563543 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:38.563480 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" podStartSLOduration=1.56346629 podStartE2EDuration="1.56346629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 05:06:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:06:38.561935584 +0000 UTC m=+1171.604350237" watchObservedRunningTime="2026-11-04 05:06:38.56346629 +0000 UTC m=+1171.605880920" Nov 04 05:06:39.384076 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:39.384041 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:39.390407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:39.390376 5019 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:39.451604 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:39.451570 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:39.452619 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:39.452603 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:42.938374 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:42.938342 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn"] Nov 04 05:06:42.938824 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:42.938500 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" podUID="e9879e6d-af60-475e-8214-7c35a0404c88" containerName="istio-proxy" containerID="cri-o://30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75" gracePeriod=30 Nov 04 05:06:42.966173 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:42.966140 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq"] Nov 04 05:06:42.966363 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:42.966342 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" containerID="cri-o://edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be" gracePeriod=30 Nov 04 05:06:42.972924 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:42.972888 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg"] Nov 04 05:06:42.973267 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:42.973219 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" containerID="cri-o://f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470" gracePeriod=30 Nov 04 05:06:43.930248 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:43.930206 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:06:43.930407 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:43.930291 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:06:44.751652 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:44.751602 5019 patch_prober.go:29] interesting pod/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 04 05:06:44.752080 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:44.751669 5019 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 04 05:06:48.243380 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.243352 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:06:48.271224 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.271201 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:48.275070 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.275047 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:06:48.400145 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400115 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.400308 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400151 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.400308 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400172 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.400308 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400193 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.400500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400344 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.400500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400390 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.400500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400422 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.400500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400452 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.400500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400471 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.400500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400479 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.400784 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400560 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.400784 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400598 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:06:48.400784 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400602 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.400784 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400669 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.400784 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.400710 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.401283 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401254 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.401685 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401571 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:06:48.401685 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401644 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.401896 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401677 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.401896 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401748 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.401896 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401818 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.401896 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401858 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401900 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401937 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.401975 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402042 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402091 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402134 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402169 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402215 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402253 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy\") pod \"32301992-ea6b-4d83-b7a3-78b330a55d0a\" (UID: \"32301992-ea6b-4d83-b7a3-78b330a55d0a\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402299 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402336 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs\") pod \"53fe6acf-fd01-40f1-a21c-dce836971c16\" (UID: \"53fe6acf-fd01-40f1-a21c-dce836971c16\") " Nov 04 05:06:48.402487 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.402371 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data\") pod \"e9879e6d-af60-475e-8214-7c35a0404c88\" (UID: \"e9879e6d-af60-475e-8214-7c35a0404c88\") " Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403079 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53fe6acf-fd01-40f1-a21c-dce836971c16-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403110 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403128 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32301992-ea6b-4d83-b7a3-78b330a55d0a-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403144 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403165 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403180 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403194 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.403423 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.404475 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.404683 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.404973 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.405062 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.405135 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.405448 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:06:48.405755 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.405725 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.406933 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.405859 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.406933 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.406135 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.406933 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.406183 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:06:48.408568 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.408541 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "kube-api-access-wnzwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:48.420274 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.420238 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.420424 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.420295 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:06:48.420424 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.420346 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "kube-api-access-bw7vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:48.420424 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.420363 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:06:48.420560 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.420479 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "kube-api-access-bbsh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:48.420560 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.420513 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token" pod "53fe6acf-fd01-40f1-a21c-dce836971c16" (UID: "53fe6acf-fd01-40f1-a21c-dce836971c16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:48.421827 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.421786 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token" pod "32301992-ea6b-4d83-b7a3-78b330a55d0a" (UID: "32301992-ea6b-4d83-b7a3-78b330a55d0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:48.422097 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.422073 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token" pod "e9879e6d-af60-475e-8214-7c35a0404c88" (UID: "e9879e6d-af60-475e-8214-7c35a0404c88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:06:48.500777 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.500743 5019 generic.go:356] "Generic (PLEG): container finished" podID="e9879e6d-af60-475e-8214-7c35a0404c88" containerID="30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75" exitCode=0 Nov 04 05:06:48.500996 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.500842 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" Nov 04 05:06:48.500996 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.500842 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" event={"ID":"e9879e6d-af60-475e-8214-7c35a0404c88","Type":"ContainerDied","Data":"30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75"} Nov 04 05:06:48.500996 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.500928 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn" event={"ID":"e9879e6d-af60-475e-8214-7c35a0404c88","Type":"ContainerDied","Data":"b13618b253b4b71cb38e61f1ffcec042f00c47b0517e73aa86500324b4c24e0d"} Nov 04 05:06:48.500996 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.500951 5019 scope.go:122] "RemoveContainer" containerID="30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75" Nov 04 05:06:48.502368 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.502340 5019 generic.go:356] "Generic (PLEG): container finished" podID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerID="f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470" exitCode=0 Nov 04 05:06:48.502486 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.502403 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" Nov 04 05:06:48.502486 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.502428 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" event={"ID":"53fe6acf-fd01-40f1-a21c-dce836971c16","Type":"ContainerDied","Data":"f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470"} Nov 04 05:06:48.502486 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.502476 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg" event={"ID":"53fe6acf-fd01-40f1-a21c-dce836971c16","Type":"ContainerDied","Data":"4cd68699846683af6695632729fb751e5e7ab71484dee80a7e7a0030d3b0bd3f"} Nov 04 05:06:48.503680 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503662 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503685 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503700 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503713 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503725 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503737 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnzwv\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-kube-api-access-wnzwv\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503751 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9879e6d-af60-475e-8214-7c35a0404c88-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503764 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.503815 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503776 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503789 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbsh9\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-kube-api-access-bbsh9\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503920 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503934 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503948 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503962 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9879e6d-af60-475e-8214-7c35a0404c88-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503976 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.503990 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53fe6acf-fd01-40f1-a21c-dce836971c16-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504004 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9879e6d-af60-475e-8214-7c35a0404c88-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504018 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw7vr\" (UniqueName: \"kubernetes.io/projected/32301992-ea6b-4d83-b7a3-78b330a55d0a-kube-api-access-bw7vr\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504032 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9879e6d-af60-475e-8214-7c35a0404c88-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504047 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32301992-ea6b-4d83-b7a3-78b330a55d0a-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:06:48.504629 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504298 5019 generic.go:356] "Generic (PLEG): container finished" podID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerID="edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be" exitCode=0 Nov 04 05:06:48.504629 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504340 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" event={"ID":"32301992-ea6b-4d83-b7a3-78b330a55d0a","Type":"ContainerDied","Data":"edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be"} Nov 04 05:06:48.504629 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504367 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" Nov 04 05:06:48.504629 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.504377 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq" event={"ID":"32301992-ea6b-4d83-b7a3-78b330a55d0a","Type":"ContainerDied","Data":"8c86170e84ba5fd24e14f5087c83cf3fbc10e1831a4c38590e96cbd13611d530"} Nov 04 05:06:48.513770 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.513747 5019 scope.go:122] "RemoveContainer" containerID="30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75" Nov 04 05:06:48.514150 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:48.514122 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75\": container with ID starting with 30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75 not found: ID does not exist" containerID="30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75" Nov 04 05:06:48.514240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.514161 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75"} err="failed to get container status \"30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75\": rpc error: code = NotFound desc = could not find container \"30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75\": container with ID starting with 30484d599c4706977a175caec60beaa182f2d9a617cb8aeefa5a9e7b598fea75 not found: ID does not exist" Nov 04 05:06:48.514240 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.514188 5019 scope.go:122] "RemoveContainer" containerID="f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470" Nov 04 05:06:48.524787 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.524762 5019 scope.go:122] "RemoveContainer" containerID="f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470" Nov 04 05:06:48.525097 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:48.525077 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470\": container with ID starting with f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470 not found: ID does not exist" containerID="f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470" Nov 04 05:06:48.525146 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.525106 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470"} err="failed to get container status \"f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470\": rpc error: code = NotFound desc = could not find container \"f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470\": container with ID starting with f68fb35e812a51f48402572f9269487c22a08086772d4c7c8ca38bbfb5ddd470 not found: ID does not exist" Nov 04 05:06:48.525146 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.525126 5019 scope.go:122] "RemoveContainer" containerID="edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be" Nov 04 05:06:48.537093 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.537009 5019 scope.go:122] "RemoveContainer" containerID="edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be" Nov 04 05:06:48.537425 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:48.537396 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be\": container with ID starting with edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be not found: ID does not exist" containerID="edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be" Nov 04 05:06:48.537502 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.537433 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be"} err="failed to get container status \"edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be\": rpc error: code = NotFound desc = could not find container \"edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be\": container with ID starting with edacee0e6701d02d3feee1d5e4d7fb11d7168448130a3302c2b223db8f8066be not found: ID does not exist" Nov 04 05:06:48.758954 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.758865 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq"] Nov 04 05:06:48.765187 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.765156 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-njdgq"] Nov 04 05:06:48.875927 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.875891 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg"] Nov 04 05:06:48.879359 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.879334 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-mpnbg"] Nov 04 05:06:48.988928 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.988894 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn"] Nov 04 05:06:48.992535 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:48.992509 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-4cce33-openshift-default-747768654f-6czgn"] Nov 04 05:06:49.124119 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:49.124040 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" path="/var/lib/kubelet/pods/32301992-ea6b-4d83-b7a3-78b330a55d0a/volumes" Nov 04 05:06:49.124502 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:49.124488 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" path="/var/lib/kubelet/pods/53fe6acf-fd01-40f1-a21c-dce836971c16/volumes" Nov 04 05:06:49.124883 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:06:49.124870 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9879e6d-af60-475e-8214-7c35a0404c88" path="/var/lib/kubelet/pods/e9879e6d-af60-475e-8214-7c35a0404c88/volumes" Nov 04 05:06:51.489605 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:06:51.489571 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:07:07.268154 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:07.268119 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 05:07:07.273382 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:07.273356 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-mqqtb_6bd96fe8-a858-4742-8b93-75b58c9e48a8/console-operator/2.log" Nov 04 05:07:07.277552 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:07.277531 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 05:07:07.282599 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:07.282581 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtqv6_7472ef71-a7e6-495f-8212-189582db5c77/ovn-acl-logging/0.log" Nov 04 05:07:17.904640 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:17.904553 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-rdlg7_b8971f37-5f49-410d-b2c0-27e3f2525cce/manager/0.log" Nov 04 05:07:18.438137 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:18.438110 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-vh4c8_d2027186-5958-40d2-8fd9-3e16393fbd0a/manager/0.log" Nov 04 05:07:18.743421 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:18.743396 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/1.log" Nov 04 05:07:19.722612 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:19.722570 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zvm6d_0345d91b-bdca-44a2-8c02-04f5f59289c6/proxy/0.log" Nov 04 05:07:20.401105 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:20.401071 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/0.log" Nov 04 05:07:21.489472 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:07:21.489434 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:07:43.776767 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:43.776738 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-dfd89bae-8rl2s_f3042350-c276-4781-abe4-67959b637c1e/revoke-keys/0.log" Nov 04 05:07:44.004408 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:44.004379 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e904c17e-msb7l_852ea3a9-e6d3-49d5-94dd-411b4e2f6557/revoke-keys/0.log" Nov 04 05:07:44.700083 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:44.700055 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-jnjqg_9551282a-aa21-4dc4-8cc5-1a968b4176a2/postgres/0.log" Nov 04 05:07:47.214237 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:47.214201 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-h4866_5e564626-363b-4150-bd74-73ec39725fa2/manager/0.log" Nov 04 05:07:47.449934 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:47.449899 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-qprvz_708f70d2-e22e-4fd0-a723-60f10ce100d1/manager/0.log" Nov 04 05:07:48.390714 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:48.390679 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-khhsn_988e7776-5b62-4ae0-963c-1b45489f4c57/manager/0.log" Nov 04 05:07:48.870516 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:48.870484 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-htgr4_33138c5b-ae00-4b20-95e9-43b222ad57b8/manager/0.log" Nov 04 05:07:51.488688 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:07:51.488644 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:07:59.921861 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:07:59.921826 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr_47a6a3e2-7e77-4271-8268-6e923215052b/istio-proxy/0.log" Nov 04 05:08:01.251122 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:01.251085 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-tl7xs_c06e6d66-7580-4d6e-967f-47ee102ba0ad/istio-proxy/1.log" Nov 04 05:08:01.530871 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:01.530763 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8_6159a6e2-03d3-4e4c-89e3-cd90a6538852/istio-proxy/0.log" Nov 04 05:08:02.219228 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:02.219197 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74447c8475-62kjf_4867d39c-aede-492d-bdd5-51b57b9baed4/router/0.log" Nov 04 05:08:02.947166 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:02.947138 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-tl7xs_c06e6d66-7580-4d6e-967f-47ee102ba0ad/istio-proxy/0.log" Nov 04 05:08:16.791410 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:16.791375 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-rdlg7_b8971f37-5f49-410d-b2c0-27e3f2525cce/manager/0.log" Nov 04 05:08:17.373444 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:17.373405 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-vh4c8_d2027186-5958-40d2-8fd9-3e16393fbd0a/manager/0.log" Nov 04 05:08:17.666810 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:17.666708 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/1.log" Nov 04 05:08:18.664568 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:18.664528 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-zvm6d_0345d91b-bdca-44a2-8c02-04f5f59289c6/proxy/0.log" Nov 04 05:08:21.489721 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:08:21.489678 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:08:22.171614 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:22.171582 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-dfd89bae-8rl2s_f3042350-c276-4781-abe4-67959b637c1e/revoke-keys/0.log" Nov 04 05:08:22.441461 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:22.441329 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-e904c17e-msb7l_852ea3a9-e6d3-49d5-94dd-411b4e2f6557/revoke-keys/0.log" Nov 04 05:08:23.199841 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:23.199785 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-jnjqg_9551282a-aa21-4dc4-8cc5-1a968b4176a2/postgres/0.log" Nov 04 05:08:24.884069 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:24.884038 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-h4866_5e564626-363b-4150-bd74-73ec39725fa2/manager/0.log" Nov 04 05:08:25.163628 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:25.163529 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-qprvz_708f70d2-e22e-4fd0-a723-60f10ce100d1/manager/0.log" Nov 04 05:08:25.625782 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:25.625747 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-khhsn_988e7776-5b62-4ae0-963c-1b45489f4c57/manager/0.log" Nov 04 05:08:26.333345 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:26.333304 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-htgr4_33138c5b-ae00-4b20-95e9-43b222ad57b8/manager/0.log" Nov 04 05:08:36.961389 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:36.961353 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr_47a6a3e2-7e77-4271-8268-6e923215052b/istio-proxy/0.log" Nov 04 05:08:38.364682 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:38.364652 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6886b96f9-tl7xs_c06e6d66-7580-4d6e-967f-47ee102ba0ad/istio-proxy/1.log" Nov 04 05:08:38.661219 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:38.661128 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8_6159a6e2-03d3-4e4c-89e3-cd90a6538852/istio-proxy/0.log" Nov 04 05:08:39.389927 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:08:39.389892 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74447c8475-62kjf_4867d39c-aede-492d-bdd5-51b57b9baed4/router/0.log" Nov 04 05:08:51.489547 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:08:51.489467 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:09:21.489451 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:09:21.489409 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:09:48.535633 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:09:48.535589 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/1.log" Nov 04 05:09:49.120301 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:09:49.120261 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/1.log" Nov 04 05:09:51.489755 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:09:51.489718 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:10:21.489289 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:10:21.489206 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:10:39.044070 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:39.044011 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l"] Nov 04 05:10:39.094213 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:39.094170 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-e904c17e-msb7l"] Nov 04 05:10:39.123558 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:39.123529 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="852ea3a9-e6d3-49d5-94dd-411b4e2f6557" path="/var/lib/kubelet/pods/852ea3a9-e6d3-49d5-94dd-411b4e2f6557/volumes" Nov 04 05:10:45.053312 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:45.053279 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/1.log" Nov 04 05:10:45.600244 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:45.600212 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c56fdf97-qvkx4_71dc2299-718d-48c6-9fa4-c65c7e701a86/manager/1.log" Nov 04 05:10:51.489531 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:10:51.489493 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:10:53.044436 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:53.044395 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s"] Nov 04 05:10:53.094500 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:53.094432 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dfd89bae-8rl2s"] Nov 04 05:10:53.123982 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:10:53.123955 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f3042350-c276-4781-abe4-67959b637c1e" path="/var/lib/kubelet/pods/f3042350-c276-4781-abe4-67959b637c1e/volumes" Nov 04 05:11:06.284964 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:06.284925 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs"] Nov 04 05:11:06.285383 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:06.285158 5019 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" containerID="cri-o://29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067" gracePeriod=30 Nov 04 05:11:07.274706 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:07.274672 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sf9x7_5e2ff9d2-73c3-4635-a07a-ca5579d71d65/global-pull-secret-syncer/0.log" Nov 04 05:11:07.859501 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:07.859475 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-5t5wk_8c4f5a06-6cb8-4f9f-922b-d8060cbfffdf/connection-checker/0.log" Nov 04 05:11:08.296126 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:08.296098 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-6jczj_a06238b1-20bb-4835-bdac-4fdd5fa9ce2b/connection-checker/0.log" Nov 04 05:11:08.730472 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:08.730391 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-97npv_3d019953-b35c-4683-bba1-7fa5f86ed823/connection-checker/0.log" Nov 04 05:11:10.237581 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:10.237554 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ksbdr_1dd7863e-8391-4629-9a8d-38324d296e87/konnectivity-agent/0.log" Nov 04 05:11:11.161117 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.161088 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-45.us-west-1.compute.internal_247d5fdffbb0596570a9bedc92fe6730/haproxy/0.log" Nov 04 05:11:11.533698 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.533675 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 05:11:11.637162 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637126 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637353 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637171 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637353 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637237 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637353 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637285 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637353 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637325 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637570 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637360 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637570 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637398 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637570 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637433 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637570 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637449 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:11:11.637570 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637474 5019 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data\") pod \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\" (UID: \"c06e6d66-7580-4d6e-967f-47ee102ba0ad\") " Nov 04 05:11:11.637844 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637616 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:11:11.637927 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637762 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 04 05:11:11.637984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637828 5019 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-credential-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.637984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637961 5019 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-certs\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.637984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637897 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:11:11.637984 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.637915 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:11:11.639721 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.639681 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 04 05:11:11.639853 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.639775 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:11:11.640038 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.640011 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "kube-api-access-27zcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 04 05:11:11.640876 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.640859 5019 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy" pod "c06e6d66-7580-4d6e-967f-47ee102ba0ad" (UID: "c06e6d66-7580-4d6e-967f-47ee102ba0ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739367 5019 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istiod-ca-cert\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739405 5019 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-token\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739416 5019 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27zcw\" (UniqueName: \"kubernetes.io/projected/c06e6d66-7580-4d6e-967f-47ee102ba0ad-kube-api-access-27zcw\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739426 5019 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-podinfo\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739435 5019 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-workload-socket\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739444 5019 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-data\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.739460 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.739456 5019 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c06e6d66-7580-4d6e-967f-47ee102ba0ad-istio-envoy\") on node \"ip-10-0-135-45.us-west-1.compute.internal\" DevicePath \"\"" Nov 04 05:11:11.948727 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.948694 5019 generic.go:356] "Generic (PLEG): container finished" podID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerID="29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067" exitCode=0 Nov 04 05:11:11.948952 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.948754 5019 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" Nov 04 05:11:11.948952 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.948782 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" event={"ID":"c06e6d66-7580-4d6e-967f-47ee102ba0ad","Type":"ContainerDied","Data":"29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067"} Nov 04 05:11:11.948952 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.948894 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs" event={"ID":"c06e6d66-7580-4d6e-967f-47ee102ba0ad","Type":"ContainerDied","Data":"0bbcef64b9bb7c87988d666a450d90dc7ecbfdaeb8c37ea2e845055b739ec3c9"} Nov 04 05:11:11.948952 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.948923 5019 scope.go:122] "RemoveContainer" containerID="29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067" Nov 04 05:11:11.958621 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.958602 5019 scope.go:122] "RemoveContainer" containerID="c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7" Nov 04 05:11:11.967383 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.967367 5019 scope.go:122] "RemoveContainer" containerID="29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067" Nov 04 05:11:11.967660 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:11:11.967640 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067\": container with ID starting with 29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067 not found: ID does not exist" containerID="29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067" Nov 04 05:11:11.967696 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.967670 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067"} err="failed to get container status \"29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067\": rpc error: code = NotFound desc = could not find container \"29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067\": container with ID starting with 29b208ebd8c51c2623264fad5c7cd0485321e4cad9dbf62b73196c61f8a9c067 not found: ID does not exist" Nov 04 05:11:11.967696 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.967687 5019 scope.go:122] "RemoveContainer" containerID="c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7" Nov 04 05:11:11.967962 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:11:11.967948 5019 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7\": container with ID starting with c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7 not found: ID does not exist" containerID="c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7" Nov 04 05:11:11.968012 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:11.967967 5019 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7"} err="failed to get container status \"c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7\": rpc error: code = NotFound desc = could not find container \"c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7\": container with ID starting with c538f78733912aaa22efd5dc609de38f2e2a354d6c3a21737cf1c9daa43a79e7 not found: ID does not exist" Nov 04 05:11:12.114839 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:12.114784 5019 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs"] Nov 04 05:11:12.118976 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:12.118953 5019 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6886b96f9-tl7xs"] Nov 04 05:11:13.123570 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:13.123530 5019 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" path="/var/lib/kubelet/pods/c06e6d66-7580-4d6e-967f-47ee102ba0ad/volumes" Nov 04 05:11:15.149029 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:15.148994 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-h4866_5e564626-363b-4150-bd74-73ec39725fa2/manager/0.log" Nov 04 05:11:15.569446 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:15.569413 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-qprvz_708f70d2-e22e-4fd0-a723-60f10ce100d1/manager/0.log" Nov 04 05:11:16.244204 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244171 5019 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv"] Nov 04 05:11:16.244606 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244593 5019 cpu_manager.go:414] "containerMap: removing container" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244607 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244618 5019 cpu_manager.go:414] "containerMap: removing container" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244623 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244632 5019 cpu_manager.go:414] "containerMap: removing container" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244636 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244649 5019 cpu_manager.go:414] "containerMap: removing container" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244655 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244665 5019 cpu_manager.go:414] "containerMap: removing container" podUID="e9879e6d-af60-475e-8214-7c35a0404c88" containerName="istio-proxy" Nov 04 05:11:16.244666 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244669 5019 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9879e6d-af60-475e-8214-7c35a0404c88" containerName="istio-proxy" Nov 04 05:11:16.244942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244725 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" Nov 04 05:11:16.244942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244731 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9879e6d-af60-475e-8214-7c35a0404c88" containerName="istio-proxy" Nov 04 05:11:16.244942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244742 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="53fe6acf-fd01-40f1-a21c-dce836971c16" containerName="istio-proxy" Nov 04 05:11:16.244942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244748 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="32301992-ea6b-4d83-b7a3-78b330a55d0a" containerName="istio-proxy" Nov 04 05:11:16.244942 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.244755 5019 memory_manager.go:365] "RemoveStaleState removing state" podUID="c06e6d66-7580-4d6e-967f-47ee102ba0ad" containerName="istio-proxy" Nov 04 05:11:16.249328 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.249311 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.337561 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.337395 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv"] Nov 04 05:11:16.383132 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.383092 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-sys\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.383132 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.383137 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-lib-modules\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.383338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.383207 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms72b\" (UniqueName: \"kubernetes.io/projected/b37c771c-f67e-4194-8402-dc7ad424bb18-kube-api-access-ms72b\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.383338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.383298 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-proc\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.383338 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.383327 5019 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-podres\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.410868 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.410839 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zx9qc\"/\"openshift-service-ca.crt\"" Nov 04 05:11:16.410868 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.410861 5019 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zx9qc\"/\"kube-root-ca.crt\"" Nov 04 05:11:16.410868 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.410873 5019 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zx9qc\"/\"default-dockercfg-qh69v\"" Nov 04 05:11:16.484563 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484527 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-sys\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484738 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484569 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-lib-modules\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484738 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484657 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-sys\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484738 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484661 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-lib-modules\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484738 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484690 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms72b\" (UniqueName: \"kubernetes.io/projected/b37c771c-f67e-4194-8402-dc7ad424bb18-kube-api-access-ms72b\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484907 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484770 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-proc\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484907 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484827 5019 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-podres\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.484907 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484875 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-proc\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.485000 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.484905 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b37c771c-f67e-4194-8402-dc7ad424bb18-podres\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.542644 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.542572 5019 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms72b\" (UniqueName: \"kubernetes.io/projected/b37c771c-f67e-4194-8402-dc7ad424bb18-kube-api-access-ms72b\") pod \"perf-node-gather-daemonset-pddqv\" (UID: \"b37c771c-f67e-4194-8402-dc7ad424bb18\") " pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.561442 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.561420 5019 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:16.890769 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.890688 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-khhsn_988e7776-5b62-4ae0-963c-1b45489f4c57/manager/0.log" Nov 04 05:11:16.934495 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.934470 5019 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv"] Nov 04 05:11:16.937421 ip-10-0-135-45 kubenswrapper[5019]: W1104 05:11:16.937385 5019 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb37c771c_f67e_4194_8402_dc7ad424bb18.slice/crio-00f574dab4b9bc911d593e706dba53e1443f91a645be92fe05cd4dd43fe7b6be WatchSource:0}: Error finding container 00f574dab4b9bc911d593e706dba53e1443f91a645be92fe05cd4dd43fe7b6be: Status 404 returned error can't find the container with id 00f574dab4b9bc911d593e706dba53e1443f91a645be92fe05cd4dd43fe7b6be Nov 04 05:11:16.977406 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:16.977376 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" event={"ID":"b37c771c-f67e-4194-8402-dc7ad424bb18","Type":"ContainerStarted","Data":"00f574dab4b9bc911d593e706dba53e1443f91a645be92fe05cd4dd43fe7b6be"} Nov 04 05:11:17.650941 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:17.650886 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-htgr4_33138c5b-ae00-4b20-95e9-43b222ad57b8/manager/0.log" Nov 04 05:11:17.985560 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:17.985463 5019 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" event={"ID":"b37c771c-f67e-4194-8402-dc7ad424bb18","Type":"ContainerStarted","Data":"eeb19e893e64dda55269784b1e78fa0de3cb5bfe04bb9ecc51522d1b91ca4243"} Nov 04 05:11:17.985717 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:17.985565 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:18.103631 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:18.103569 5019 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" podStartSLOduration=2.103555627 podStartE2EDuration="2.103555627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 05:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 05:11:18.101342197 +0000 UTC m=+1451.143756824" watchObservedRunningTime="2026-11-04 05:11:18.103555627 +0000 UTC m=+1451.145970256" Nov 04 05:11:21.489302 ip-10-0-135-45 kubenswrapper[5019]: E1104 05:11:21.489259 5019 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sqh8z" containerName="extractor" Nov 04 05:11:23.199308 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:23.199270 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-sfzpb_d9d32ce2-2b5d-4f8b-904e-486f556d9e8e/cluster-monitoring-operator/0.log" Nov 04 05:11:24.002548 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:24.002521 5019 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zx9qc/perf-node-gather-daemonset-pddqv" Nov 04 05:11:25.861616 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:25.861589 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hvpst_af134e2c-d766-4786-8c2d-c0b9d3e17039/node-exporter/0.log" Nov 04 05:11:26.277411 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:26.277382 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hvpst_af134e2c-d766-4786-8c2d-c0b9d3e17039/kube-rbac-proxy/0.log" Nov 04 05:11:26.694427 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:26.694343 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hvpst_af134e2c-d766-4786-8c2d-c0b9d3e17039/init-textfile/0.log" Nov 04 05:11:38.658704 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:38.658670 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7845f94dd5gvmbr_47a6a3e2-7e77-4271-8268-6e923215052b/istio-proxy/0.log" Nov 04 05:11:40.498418 ip-10-0-135-45 kubenswrapper[5019]: I1104 05:11:40.498383 5019 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-55f56bc75f-qlxv8_6159a6e2-03d3-4e4c-89e3-cd90a6538852/istio-proxy/0.log"