Oct 29 23:10:39.194614 ip-10-0-137-132 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Oct 29 23:10:39.194626 ip-10-0-137-132 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Oct 29 23:10:39.194633 ip-10-0-137-132 systemd[1]: kubelet.service: Failed with result 'resources'. Oct 29 23:10:39.194871 ip-10-0-137-132 systemd[1]: Failed to start Kubernetes Kubelet. Oct 29 23:10:49.443649 ip-10-0-137-132 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Oct 29 23:10:49.443665 ip-10-0-137-132 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 36fa91d4887a4e4083e0f2692d89c13d -- Oct 29 23:12:46.623846 ip-10-0-137-132 systemd[1]: Starting Kubernetes Kubelet... Oct 29 23:12:47.052976 ip-10-0-137-132 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:47.052976 ip-10-0-137-132 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 29 23:12:47.052976 ip-10-0-137-132 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:47.052976 ip-10-0-137-132 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:47.056345 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056259 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.056345 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056347 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056351 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056354 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056357 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056360 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056363 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056367 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056369 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056372 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056375 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056377 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056380 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056382 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056385 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056387 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056391 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056393 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056396 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056398 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.056415 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056401 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056407 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056410 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056412 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056415 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056418 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056420 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056424 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056427 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056430 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056432 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056435 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056437 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056440 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056442 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056445 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056447 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056450 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056452 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056455 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.056871 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056457 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056459 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056462 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056464 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056467 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056469 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056471 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056474 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056476 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056479 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056481 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056483 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056486 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056488 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056492 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056495 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056497 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056500 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056502 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056505 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.057335 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056508 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056510 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056513 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056515 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056518 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056520 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056522 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056525 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056527 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056530 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056532 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056535 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056538 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056540 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056543 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056547 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056564 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056567 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056570 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056573 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.057812 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056576 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056578 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056581 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056584 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056587 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056590 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056595 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056599 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056602 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056606 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056608 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056611 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056613 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056616 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056619 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056622 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056624 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056627 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.058310 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056630 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056632 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056635 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056638 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056640 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056642 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056645 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.056649 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057457 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057464 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057467 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057470 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057473 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057475 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057479 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057482 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057484 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057487 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057489 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057492 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.058794 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057495 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057498 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057502 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057504 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057507 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057510 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057512 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057515 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057517 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057520 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057523 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057525 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057528 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057530 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057533 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057535 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057538 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057540 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057543 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.059306 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057546 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057548 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057566 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057569 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057571 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057574 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057578 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057583 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057587 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057590 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057592 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057596 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057600 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057603 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057606 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057608 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057612 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057614 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.059770 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057617 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057619 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057622 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057624 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057627 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057629 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057632 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057635 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057637 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057640 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057643 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057646 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057649 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057651 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057654 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057657 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057660 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057662 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057665 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057668 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.060224 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057670 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057673 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057675 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057678 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057680 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057683 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057686 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057688 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057691 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057693 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057696 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057699 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057701 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057704 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057706 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057708 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057711 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057713 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057716 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057719 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.060715 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057721 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057724 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057726 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057730 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057732 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057735 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057738 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057741 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057743 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057746 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057748 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057751 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057753 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057756 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057758 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057761 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.057763 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058268 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058274 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058278 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.061296 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058281 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058284 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058286 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058290 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058292 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058295 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058298 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058300 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058303 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058306 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058308 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058311 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058314 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058317 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058319 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058322 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058325 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058328 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058331 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058333 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.061777 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058336 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058339 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058341 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058344 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058346 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058349 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058352 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058354 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058357 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058360 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058363 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058365 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058368 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058370 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058373 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058375 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058379 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058381 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058384 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058386 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.062257 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058389 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058391 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058394 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058396 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058399 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058401 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058404 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058409 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058412 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058415 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058417 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058420 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058423 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058425 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058428 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058430 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058432 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058435 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058439 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.062751 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058442 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058445 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058448 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058451 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058453 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058456 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058458 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058461 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058463 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058466 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058469 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058472 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058474 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058477 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058479 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058482 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058484 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058487 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058489 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.063194 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058492 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058495 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058498 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058500 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058503 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058505 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058508 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058510 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058512 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058515 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058517 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058520 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058522 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058524 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058527 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058529 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058532 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058534 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058536 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.063649 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058539 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058541 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058544 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058546 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058564 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.058569 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058669 2576 flags.go:64] FLAG: --address="0.0.0.0" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058676 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058683 2576 flags.go:64] FLAG: --anonymous-auth="true" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058689 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058693 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058696 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058701 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058706 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058709 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058713 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058716 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058719 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058722 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058726 2576 flags.go:64] FLAG: --cgroup-root="" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058728 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058731 2576 flags.go:64] FLAG: --client-ca-file="" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058734 2576 flags.go:64] FLAG: --cloud-provider="external" Oct 29 23:12:47.064081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058737 2576 flags.go:64] FLAG: --cluster-dns="[]" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058742 2576 flags.go:64] FLAG: --cluster-domain="" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058745 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058748 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058751 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058755 2576 flags.go:64] FLAG: --container-log-max-files="5" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058759 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058762 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058765 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058768 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058771 2576 flags.go:64] FLAG: --contention-profiling="false" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058774 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058777 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058780 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058783 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058788 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058791 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058794 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058797 2576 flags.go:64] FLAG: --enable-load-reader="false" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058800 2576 flags.go:64] FLAG: --enable-server="true" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058803 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058808 2576 flags.go:64] FLAG: --event-burst="100" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058812 2576 flags.go:64] FLAG: --event-qps="50" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058814 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 29 23:12:47.064624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058818 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058821 2576 flags.go:64] FLAG: --eviction-hard="" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058825 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058829 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058832 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058835 2576 flags.go:64] FLAG: --eviction-soft="" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058838 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058841 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058844 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058847 2576 flags.go:64] FLAG: --experimental-mounter-path="" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058850 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058853 2576 flags.go:64] FLAG: --fail-swap-on="true" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058856 2576 flags.go:64] FLAG: --feature-gates="" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058861 2576 flags.go:64] FLAG: --file-check-frequency="20s" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058864 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058867 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058871 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058874 2576 flags.go:64] FLAG: --healthz-port="10248" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058877 2576 flags.go:64] FLAG: --help="false" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058880 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058883 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058886 2576 flags.go:64] FLAG: --http-check-frequency="20s" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058889 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058892 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 29 23:12:47.065283 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058896 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058902 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058905 2576 flags.go:64] FLAG: --image-service-endpoint="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058908 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058911 2576 flags.go:64] FLAG: --kube-api-burst="100" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058914 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058917 2576 flags.go:64] FLAG: --kube-api-qps="50" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058920 2576 flags.go:64] FLAG: --kube-reserved="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058922 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058926 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058929 2576 flags.go:64] FLAG: --kubelet-cgroups="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058932 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058935 2576 flags.go:64] FLAG: --lock-file="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058939 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058942 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058946 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058951 2576 flags.go:64] FLAG: --log-json-split-stream="false" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058954 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058957 2576 flags.go:64] FLAG: --log-text-split-stream="false" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058960 2576 flags.go:64] FLAG: --logging-format="text" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058963 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058967 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058970 2576 flags.go:64] FLAG: --manifest-url="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058972 2576 flags.go:64] FLAG: --manifest-url-header="" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058977 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 29 23:12:47.065920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058980 2576 flags.go:64] FLAG: --max-open-files="1000000" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058984 2576 flags.go:64] FLAG: --max-pods="110" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058987 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058990 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058993 2576 flags.go:64] FLAG: --memory-manager-policy="None" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058996 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.058999 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059002 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059007 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059015 2576 flags.go:64] FLAG: --node-status-max-images="50" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059018 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059021 2576 flags.go:64] FLAG: --oom-score-adj="-999" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059025 2576 flags.go:64] FLAG: --pod-cidr="" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059027 2576 flags.go:64] FLAG: --pod-manifest-path="" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059030 2576 flags.go:64] FLAG: --pod-max-pids="-1" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059033 2576 flags.go:64] FLAG: --pods-per-core="0" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059036 2576 flags.go:64] FLAG: --port="10250" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059040 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059043 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e831c866f403e3a3" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059046 2576 flags.go:64] FLAG: --qos-reserved="" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059053 2576 flags.go:64] FLAG: --read-only-port="10255" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059056 2576 flags.go:64] FLAG: --register-node="true" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059059 2576 flags.go:64] FLAG: --register-with-taints="" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059063 2576 flags.go:64] FLAG: --registry-burst="10" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059066 2576 flags.go:64] FLAG: --registry-qps="5" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059069 2576 flags.go:64] FLAG: --reserved-cpus="" Oct 29 23:12:47.066509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059072 2576 flags.go:64] FLAG: --reserved-memory="" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059076 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059079 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059082 2576 flags.go:64] FLAG: --rotate-certificates="false" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059085 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059088 2576 flags.go:64] FLAG: --runonce="false" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059090 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059094 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059096 2576 flags.go:64] FLAG: --seccomp-default="false" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059099 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059102 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059106 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059109 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059112 2576 flags.go:64] FLAG: --storage-driver-password="root" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059116 2576 flags.go:64] FLAG: --storage-driver-secure="false" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059120 2576 flags.go:64] FLAG: --storage-driver-table="stats" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059123 2576 flags.go:64] FLAG: --storage-driver-user="root" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059126 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059129 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059132 2576 flags.go:64] FLAG: --system-cgroups="" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059135 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059140 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059143 2576 flags.go:64] FLAG: --tls-cert-file="" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059145 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059150 2576 flags.go:64] FLAG: --tls-min-version="" Oct 29 23:12:47.067367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059153 2576 flags.go:64] FLAG: --tls-private-key-file="" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059158 2576 flags.go:64] FLAG: --topology-manager-policy="none" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059161 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059164 2576 flags.go:64] FLAG: --topology-manager-scope="container" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059167 2576 flags.go:64] FLAG: --v="2" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059171 2576 flags.go:64] FLAG: --version="false" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059175 2576 flags.go:64] FLAG: --vmodule="" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059179 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059182 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059318 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059323 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059325 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059328 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059332 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059336 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059339 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059342 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059345 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059347 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059350 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059352 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.068270 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059356 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059358 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059361 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059364 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059367 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059369 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059372 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059374 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059377 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059379 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059381 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059384 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059387 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059390 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059392 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059395 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059397 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059400 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059402 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059405 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.068796 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059407 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059410 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059412 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059415 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059417 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059419 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059422 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059424 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059426 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059429 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059432 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059435 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059438 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059441 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059444 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059446 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059449 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059451 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059454 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.069279 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059456 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059459 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059461 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059463 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059466 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059470 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059472 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059475 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059478 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059481 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059483 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059486 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059490 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059493 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059496 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059499 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059501 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059504 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059507 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.069781 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059509 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059511 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059514 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059516 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059519 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059521 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059524 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059526 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059529 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059531 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059534 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059537 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059539 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059542 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059544 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059546 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059563 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059566 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059570 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059573 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.070241 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059575 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059578 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059581 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059583 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059585 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059588 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059590 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059593 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059595 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059598 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059601 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059603 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059606 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059608 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059611 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059613 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.070725 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.059639 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059681 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059686 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059689 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059692 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059694 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059697 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059700 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059702 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059705 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059708 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059711 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059713 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059716 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059720 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059723 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059725 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059728 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059730 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.071113 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059733 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059735 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059737 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059740 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059744 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059747 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059749 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059752 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059755 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059757 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059762 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059765 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059768 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059771 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059774 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059777 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059780 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059783 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059785 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.071599 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059788 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059790 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059793 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059796 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059799 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059801 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059803 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059806 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059809 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059812 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059814 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059817 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059819 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059822 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059824 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059827 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059829 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059833 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059835 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059838 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.072056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059840 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059843 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059847 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059852 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059856 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059860 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059863 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059867 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059871 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059874 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059877 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059880 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059882 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059885 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059887 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059891 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059894 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059896 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059900 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059903 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.072542 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059907 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059910 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059912 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059915 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059917 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059920 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059922 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059925 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059927 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059932 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059935 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059937 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059940 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059942 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059945 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059947 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059950 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059952 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059955 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059957 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.073037 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059960 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059962 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059965 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059967 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059970 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059972 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059975 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059977 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.059980 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.067497 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.067591 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.067622 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.067629 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068041 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068070 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068075 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068079 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068083 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068087 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.073520 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068092 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068096 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068101 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068105 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068109 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068113 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068118 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068134 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068138 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068143 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068147 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068152 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068156 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068160 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068164 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068168 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068173 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068177 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068181 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068186 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.073996 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068266 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068422 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068431 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068436 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068440 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068447 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068451 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068454 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068457 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068460 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068462 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068465 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068468 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068470 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068473 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068475 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068478 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068483 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068486 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.074467 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068491 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068496 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068499 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068502 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068505 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068507 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068510 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068513 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068515 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068519 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068522 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068525 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068528 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068531 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068533 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068536 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068539 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068542 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068544 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.075047 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068547 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068564 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068568 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068571 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068575 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068578 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068580 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068583 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068586 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068588 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068590 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068593 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068596 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068598 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068601 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068603 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068606 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068608 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068611 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068613 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.075504 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068616 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068618 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068621 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068624 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068627 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068630 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068632 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068635 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068638 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068640 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068643 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068646 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068648 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068651 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068656 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068658 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068661 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068663 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068666 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.075979 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068670 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068673 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068676 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.068712 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068903 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068909 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068912 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068915 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068917 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068921 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068924 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068927 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068929 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068932 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068935 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068937 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.076425 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068940 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068942 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068945 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068948 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068950 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068953 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068955 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068958 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068961 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068964 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068966 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068969 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068971 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068974 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068977 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068979 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068981 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068984 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068986 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.076860 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068989 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068992 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068994 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068997 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.068999 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069002 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069004 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069008 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069010 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069013 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069015 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069018 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069025 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069028 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069030 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069033 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069036 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069040 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069043 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.077342 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069046 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069049 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069052 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069056 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069059 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069062 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069065 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069068 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069071 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069073 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069075 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069079 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069081 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069084 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069086 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069089 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069091 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069094 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069097 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.077842 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069099 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069102 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069105 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069107 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069110 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069113 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069116 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069118 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069121 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069123 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069126 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069129 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069131 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069134 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069136 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069139 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069141 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069143 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069146 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069148 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.078400 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069151 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069154 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069156 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069159 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069161 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069163 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069166 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069168 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069171 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069173 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069175 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069178 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069180 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069183 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069186 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069189 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.078966 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069192 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.069216 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069249 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069253 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069256 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069259 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069261 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069264 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069267 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069269 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069272 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069274 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069277 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069279 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069282 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069285 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:47.079350 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069288 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069290 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069293 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069295 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069298 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069300 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069303 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069306 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069308 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069310 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069313 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069315 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069318 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069321 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069323 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069326 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069331 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069334 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069336 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069339 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:47.079738 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069341 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069343 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069346 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069348 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069351 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069353 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069356 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069358 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069360 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069363 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069366 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069368 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069370 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069373 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069375 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069378 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069380 2576 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069382 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069385 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069387 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:47.080223 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069390 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069392 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069394 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069397 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069399 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069402 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069405 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069407 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069411 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069415 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069417 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069420 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069422 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069425 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069427 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069429 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069432 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069435 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069437 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069440 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:47.081235 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069442 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069445 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069447 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069449 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069452 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069454 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069456 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069459 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069461 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069464 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069466 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069468 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069471 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069473 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069476 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069478 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069481 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069483 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069486 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:47.081713 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069489 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069492 2576 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069495 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069499 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069503 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069505 2576 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069508 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069510 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069514 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069518 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069521 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069524 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:47.069526 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.069599 2576 server.go:957] "Client rotation is on, will bootstrap in background" Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.073299 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.074253 2576 server.go:1014] "Starting client certificate rotation" Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.074349 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:12:47.082176 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.074375 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:12:47.082735 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.076569 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:12:47.082735 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.082055 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:12:47.091428 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.091411 2576 log.go:25] "Validated CRI v1 runtime API" Oct 29 23:12:47.095056 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.095039 2576 log.go:25] "Validated CRI v1 image API" Oct 29 23:12:47.095950 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.095922 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 29 23:12:47.099657 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.099637 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bebaffc7-5713-4b1d-a5a6-cd7c74a3f56c:/dev/nvme0n1p3 d0289357-131c-4e73-b19b-783510a53e8b:/dev/nvme0n1p4] Oct 29 23:12:47.099716 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.099657 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 29 23:12:47.104085 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.103964 2576 manager.go:217] Machine: {Timestamp:2026-10-29 23:12:47.103433874 +0000 UTC m=+0.358501238 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100045 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21079c7601fc049f45b5b0ea7b2eb0 SystemUUID:ec21079c-7601-fc04-9f45-b5b0ea7b2eb0 BootID:36fa91d4-887a-4e40-83e0-f2692d89c13d Filesystems:[{Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f8:fe:b9:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f8:fe:b9:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:39:b4:07:9c:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 29 23:12:47.104085 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.104079 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 29 23:12:47.104215 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.104199 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 29 23:12:47.108534 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.108502 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 29 23:12:47.108717 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.108535 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 29 23:12:47.108803 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.108721 2576 topology_manager.go:143] "Creating topology manager with none policy" Oct 29 23:12:47.108803 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.108735 2576 container_manager_linux.go:311] "Creating device plugin manager" Oct 29 23:12:47.108803 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.108795 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:12:47.109790 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.109778 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:12:47.110757 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.110744 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 29 23:12:47.114847 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.114832 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 29 23:12:47.114994 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.114983 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 29 23:12:47.115780 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.115768 2576 kubelet.go:493] "Attempting to sync node with API server" Oct 29 23:12:47.115835 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.115788 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 29 23:12:47.115835 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.115802 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 29 23:12:47.115916 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.115865 2576 kubelet.go:405] "Adding apiserver pod source" Oct 29 23:12:47.117197 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.116505 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 29 23:12:47.117197 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.117122 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:12:47.120200 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.120183 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 29 23:12:47.125170 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.125157 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:12:47.125937 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.125925 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 29 23:12:47.125984 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.125956 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 29 23:12:47.127021 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127009 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 29 23:12:47.127055 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127026 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 29 23:12:47.127055 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127032 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 29 23:12:47.127055 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127038 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 29 23:12:47.127055 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127044 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 29 23:12:47.127055 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127050 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 29 23:12:47.127684 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127675 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 29 23:12:47.127684 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127684 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 29 23:12:47.127738 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127692 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 29 23:12:47.127738 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127698 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 29 23:12:47.127738 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127708 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 29 23:12:47.127738 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.127716 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 29 23:12:47.129317 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.129307 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 29 23:12:47.129317 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.129317 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 29 23:12:47.133335 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.133321 2576 server.go:1263] "Started kubelet" Oct 29 23:12:47.133464 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.133409 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 29 23:12:47.133533 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.133450 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 29 23:12:47.133533 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.133529 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 29 23:12:47.134075 ip-10-0-137-132 systemd[1]: Started Kubernetes Kubelet. Oct 29 23:12:47.134985 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.134939 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 29 23:12:47.135909 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.135892 2576 server.go:317] "Adding debug handlers to kubelet server" Oct 29 23:12:47.140185 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.140150 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 29 23:12:47.140505 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.140489 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 29 23:12:47.140505 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.140491 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 29 23:12:47.140683 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.140639 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.141350 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.141332 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 29 23:12:47.141350 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.141332 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 29 23:12:47.141456 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.141362 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 29 23:12:47.141456 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.141442 2576 reconstruct.go:97] "Volume reconstruction finished" Oct 29 23:12:47.141456 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.141447 2576 reconciler.go:29] "Reconciler: start to sync state" Oct 29 23:12:47.142198 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142144 2576 factory.go:55] Registering systemd factory Oct 29 23:12:47.142198 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142161 2576 factory.go:223] Registration of the systemd container factory successfully Oct 29 23:12:47.142441 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142423 2576 factory.go:153] Registering CRI-O factory Oct 29 23:12:47.142441 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142443 2576 factory.go:223] Registration of the crio container factory successfully Oct 29 23:12:47.142593 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142507 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 29 23:12:47.142593 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142530 2576 factory.go:103] Registering Raw factory Oct 29 23:12:47.142593 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.142547 2576 manager.go:1199] Started watching for new ooms in manager Oct 29 23:12:47.143794 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.143767 2576 manager.go:319] Starting recovery of all containers Oct 29 23:12:47.155467 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.155449 2576 manager.go:324] Recovery completed Oct 29 23:12:47.159991 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.159979 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.161812 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.161781 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.161893 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.161830 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.161893 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.161845 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.162469 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.162454 2576 cpu_manager.go:226] "Starting" policy="none" Oct 29 23:12:47.162469 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.162466 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 29 23:12:47.162621 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.162494 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.162621 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.162522 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 29 23:12:47.163251 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.163234 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.163317 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.163263 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.163317 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.163273 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.164734 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.164721 2576 policy_none.go:50] "Start" Oct 29 23:12:47.164815 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.164738 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 29 23:12:47.164815 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.164754 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 29 23:12:47.166774 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.166740 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-132.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 29 23:12:47.166774 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.166737 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 29 23:12:47.166906 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.166821 2576 policy_none.go:44] "Start" Oct 29 23:12:47.167781 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.166736 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-132.ec2.internal.18e32301c5286d11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-132.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-132.ec2.internal,},FirstTimestamp:2026-10-29 23:12:47.133289745 +0000 UTC m=+0.388357111,LastTimestamp:2026-10-29 23:12:47.133289745 +0000 UTC m=+0.388357111,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-132.ec2.internal,}" Oct 29 23:12:47.172212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.172193 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 29 23:12:47.180649 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.180616 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 29 23:12:47.180649 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.180618 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 29 23:12:47.180649 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.180618 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 29 23:12:47.198337 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.198187 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7n2cp" Oct 29 23:12:47.206615 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.206522 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-132.ec2.internal.18e32301c6dba448 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-132.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-132.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-132.ec2.internal,},FirstTimestamp:2026-10-29 23:12:47.16181204 +0000 UTC m=+0.416879414,LastTimestamp:2026-10-29 23:12:47.16181204 +0000 UTC m=+0.416879414,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-132.ec2.internal,}" Oct 29 23:12:47.209580 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.209548 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7n2cp" Oct 29 23:12:47.214171 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.214143 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 29 23:12:47.216509 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.216496 2576 manager.go:341] "Starting Device Plugin manager" Oct 29 23:12:47.216600 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.216523 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 29 23:12:47.216600 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.216532 2576 server.go:87] "Starting device plugin registration server" Oct 29 23:12:47.216851 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.216838 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 29 23:12:47.216893 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.216855 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 29 23:12:47.216944 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.216926 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 29 23:12:47.217038 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.217022 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 29 23:12:47.217038 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.217035 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 29 23:12:47.217511 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.217490 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 29 23:12:47.217608 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.217542 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.222919 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.222846 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-132.ec2.internal.18e32301c6dc054b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-132.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-132.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-132.ec2.internal,},FirstTimestamp:2026-10-29 23:12:47.161836875 +0000 UTC m=+0.416904241,LastTimestamp:2026-10-29 23:12:47.161836875 +0000 UTC m=+0.416904241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-132.ec2.internal,}" Oct 29 23:12:47.284256 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.284227 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 29 23:12:47.285718 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.285582 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 29 23:12:47.285718 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.285603 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 29 23:12:47.285718 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.285624 2576 kubelet.go:2521] "Starting kubelet main sync loop" Oct 29 23:12:47.285718 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.285657 2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 29 23:12:47.303525 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.303463 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:47.317538 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.317524 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.319845 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.319826 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.319949 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.319861 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.319949 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.319873 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.319949 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.319896 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.339987 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.339965 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.339987 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.339989 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-132.ec2.internal\": node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.385826 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.385793 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal"] Oct 29 23:12:47.386260 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.386249 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.387225 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.387208 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.387314 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.387240 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.387314 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.387250 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.389069 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389051 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.389069 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.389062 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.389217 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.389217 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389213 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.389843 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389826 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.389921 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389861 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.389921 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389871 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.389921 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389834 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.389921 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389910 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.390104 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.389926 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.391677 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.391660 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.391776 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.391693 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:47.392443 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.392428 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:47.392606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.392454 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:47.392606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.392465 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:47.417042 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.417024 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-132.ec2.internal\" not found" node="ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.419994 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.419977 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-132.ec2.internal\" not found" node="ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.442988 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.442963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2db034d2cac0da0a261053f0bada2678-config\") pod \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" (UID: \"2db034d2cac0da0a261053f0bada2678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.443079 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.442991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.443079 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.443008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.489896 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.489869 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.543218 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.543189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2db034d2cac0da0a261053f0bada2678-config\") pod \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" (UID: \"2db034d2cac0da0a261053f0bada2678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.543292 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.543223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2db034d2cac0da0a261053f0bada2678-config\") pod \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" (UID: \"2db034d2cac0da0a261053f0bada2678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.543292 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.543270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.543373 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.543293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.543373 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.543346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.543450 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.543373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.590600 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.590530 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.690923 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.690896 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.720090 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.720063 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.723124 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:47.723105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:12:47.791065 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.791009 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.891669 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.891595 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:47.992061 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:47.992025 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.074624 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.074586 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 29 23:12:48.075104 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.074721 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 29 23:12:48.092883 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:48.092860 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.193898 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:48.193870 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.214607 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.214256 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:47 +0000 UTC" deadline="2028-05-17 03:45:54.522263241 +0000 UTC" Oct 29 23:12:48.214607 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.214604 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13564h33m6.307664521s" Oct 29 23:12:48.265548 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:48.265516 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01348cd00e880c068c6ab3ecc9c090d7.slice/crio-2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092 WatchSource:0}: Error finding container 2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092: Status 404 returned error can't find the container with id 2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092 Oct 29 23:12:48.272891 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.272868 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:12:48.275187 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:48.275166 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db034d2cac0da0a261053f0bada2678.slice/crio-57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7 WatchSource:0}: Error finding container 57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7: Status 404 returned error can't find the container with id 57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7 Oct 29 23:12:48.289590 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.289526 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" event={"ID":"2db034d2cac0da0a261053f0bada2678","Type":"ContainerStarted","Data":"57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7"} Oct 29 23:12:48.290496 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.290476 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" event={"ID":"01348cd00e880c068c6ab3ecc9c090d7","Type":"ContainerStarted","Data":"2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092"} Oct 29 23:12:48.294635 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:48.294620 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.345425 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.345397 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:48.346674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.346653 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:48.346764 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.346689 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:48.346764 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.346701 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:48.395082 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:48.395052 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.420492 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.420409 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:48.495846 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:48.495812 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.571096 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.571071 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:48.596309 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:48.596279 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:12:48.629748 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.629715 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:48.641025 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.640996 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:12:48.660687 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.660654 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:12:48.661861 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.661840 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:12:48.682669 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:48.682574 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:12:49.039847 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.039812 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:49.117946 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.117914 2576 apiserver.go:52] "Watching apiserver" Oct 29 23:12:49.142074 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.142045 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 29 23:12:49.146954 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.146915 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 29 23:12:49.147318 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.147295 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-4qvsk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal","openshift-multus/multus-additional-cni-plugins-bl5l6","openshift-multus/multus-pn77x","kube-system/global-pull-secret-syncer-6s4mw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9","openshift-multus/network-metrics-daemon-p7x9w","openshift-network-operator/iptables-alerter-p2xcq","openshift-ovn-kubernetes/ovnkube-node-djn9s","kube-system/konnectivity-agent-c47rv","kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4kl8q","openshift-dns/node-resolver-nnc2g","openshift-network-diagnostics/network-check-target-7n6qd"] Oct 29 23:12:49.150576 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.150254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.150576 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.150347 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:12:49.152807 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.152778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.156215 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.155214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.158112 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.157815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.160254 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.160235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.160364 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.160295 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:12:49.162737 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.162717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.165928 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.165896 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.168134 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.168047 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.168134 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.168113 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27bdq\"" Oct 29 23:12:49.168268 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.168167 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.170027 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.169457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.173189 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.172943 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 29 23:12:49.173189 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.172998 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 29 23:12:49.173189 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173019 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 29 23:12:49.173189 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173094 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 29 23:12:49.173189 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173122 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.173189 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173098 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.173573 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173215 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c96z8\"" Oct 29 23:12:49.173573 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173284 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lj8k\"" Oct 29 23:12:49.174108 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.173979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:49.174108 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.174067 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:12:49.176813 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.176791 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.177089 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.177069 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nnrj\"" Oct 29 23:12:49.177349 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.177328 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 29 23:12:49.177504 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.177484 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.177655 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.177634 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.180288 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.180262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.180448 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.180431 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcbr2\"" Oct 29 23:12:49.180561 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.180543 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 29 23:12:49.180654 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.180634 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 29 23:12:49.180792 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.180771 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 29 23:12:49.181068 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.181051 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 29 23:12:49.181160 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.181081 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.181260 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.181063 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.182843 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.182825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.185146 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.185127 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.195993 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.195967 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 29 23:12:49.196111 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.196042 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2btk5" Oct 29 23:12:49.242906 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.242880 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.253795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-system-cni-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.253844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-k8s-cni-cncf-io\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.253934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-netns\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-hostroot\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e743b094-7e5d-496c-a8fd-5f2b801b4cee-host\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-sys-fs\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-dbus\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-cnibin\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254312 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9snd\" (UniqueName: \"kubernetes.io/projected/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kube-api-access-z9snd\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-tuned\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92eceb2e-00de-4593-84de-6e5878c81f4e-hosts-file\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-system-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-multus-certs\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.254681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-systemd-units\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-multus\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-log-socket\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-script-lib\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be5750a5-cb62-4414-a5b7-273edc9e9c1e-iptables-alerter-script\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjv2\" (UniqueName: \"kubernetes.io/projected/4cabad06-e774-45b2-ae79-fbe2a70e413f-kube-api-access-jtjv2\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-bin\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254810 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e743b094-7e5d-496c-a8fd-5f2b801b4cee-serviceca\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-conf\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-run\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp9c8\" (UniqueName: \"kubernetes.io/projected/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-kube-api-access-tp9c8\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.254989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-etc-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-ovn\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.255503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzgd7\" (UniqueName: \"kubernetes.io/projected/4c91594d-41ac-4d03-a9cc-910cdc87c30f-kube-api-access-bzgd7\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-etc-kubernetes\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-var-lib-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8zk\" (UniqueName: \"kubernetes.io/projected/be5750a5-cb62-4414-a5b7-273edc9e9c1e-kube-api-access-js8zk\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afd5d371-4d02-428a-878a-f2b78f7f8e6c-agent-certs\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-host\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-daemon-config\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-netns\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be5750a5-cb62-4414-a5b7-273edc9e9c1e-host-slash\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cnibin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqnc\" (UniqueName: \"kubernetes.io/projected/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-kube-api-access-dzqnc\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysconfig\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-kubernetes\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256196 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-lib-modules\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-var-lib-kubelet\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.255976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92eceb2e-00de-4593-84de-6e5878c81f4e-tmp-dir\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-socket-dir-parent\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-systemd\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-bin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-kubelet\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256223 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-kubelet-config\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-kubelet\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-systemd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-registration-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afd5d371-4d02-428a-878a-f2b78f7f8e6c-konnectivity-ca\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-config\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.256956 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-env-overrides\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg2wm\" (UniqueName: \"kubernetes.io/projected/e743b094-7e5d-496c-a8fd-5f2b801b4cee-kube-api-access-cg2wm\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-device-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-modprobe-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-node-log\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-netd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm5wf\" (UniqueName: \"kubernetes.io/projected/164322e0-a486-4897-9da0-a8bb7a6244fb-kube-api-access-nm5wf\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-sys\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz8xl\" (UniqueName: \"kubernetes.io/projected/92eceb2e-00de-4593-84de-6e5878c81f4e-kube-api-access-jz8xl\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-conf-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-socket-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-slash\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164322e0-a486-4897-9da0-a8bb7a6244fb-ovn-node-metrics-cert\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:49.257606 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-tmp\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.258271 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.256893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cni-binary-copy\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.276769 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.276734 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 29 23:12:49.276960 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.276901 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.276960 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.276913 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.277050 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.276978 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t5hzf\"" Oct 29 23:12:49.277050 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.277026 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 29 23:12:49.277119 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.277077 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.277119 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.277097 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 29 23:12:49.277119 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.277108 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:12:49.277232 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.277161 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 29 23:12:49.284672 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.283840 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4s2ql\"" Oct 29 23:12:49.284672 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.283941 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmxkp\"" Oct 29 23:12:49.284672 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.283851 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 29 23:12:49.284672 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.284355 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kxr2\"" Oct 29 23:12:49.357989 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.357951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-device-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.357989 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.357992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-modprobe-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-node-log\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-netd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5wf\" (UniqueName: \"kubernetes.io/projected/164322e0-a486-4897-9da0-a8bb7a6244fb-kube-api-access-nm5wf\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-sys\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8xl\" (UniqueName: \"kubernetes.io/projected/92eceb2e-00de-4593-84de-6e5878c81f4e-kube-api-access-jz8xl\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-conf-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-socket-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-slash\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164322e0-a486-4897-9da0-a8bb7a6244fb-ovn-node-metrics-cert\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-tmp\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.358212 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cni-binary-copy\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-system-cni-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-k8s-cni-cncf-io\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-netns\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-hostroot\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e743b094-7e5d-496c-a8fd-5f2b801b4cee-host\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-sys-fs\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-dbus\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-cnibin\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9snd\" (UniqueName: \"kubernetes.io/projected/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kube-api-access-z9snd\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-tuned\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92eceb2e-00de-4593-84de-6e5878c81f4e-hosts-file\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-system-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-multus-certs\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-systemd-units\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.358751 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358488 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-multus\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-log-socket\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358539 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-script-lib\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be5750a5-cb62-4414-a5b7-273edc9e9c1e-iptables-alerter-script\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjv2\" (UniqueName: \"kubernetes.io/projected/4cabad06-e774-45b2-ae79-fbe2a70e413f-kube-api-access-jtjv2\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-bin\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e743b094-7e5d-496c-a8fd-5f2b801b4cee-serviceca\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92eceb2e-00de-4593-84de-6e5878c81f4e-hosts-file\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-log-socket\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-netns\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-conf-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-cnibin\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-device-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-system-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-modprobe-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.359574 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-conf\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-dbus\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-multus-certs\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-systemd-units\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-node-log\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-socket-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-bin\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358904 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-multus\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-conf\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-slash\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-run\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-run\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.358990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9c8\" (UniqueName: \"kubernetes.io/projected/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-kube-api-access-tp9c8\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-hostroot\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-etc-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-etc-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e743b094-7e5d-496c-a8fd-5f2b801b4cee-host\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.360344 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-ovn\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-ovn\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359156 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-sys\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzgd7\" (UniqueName: \"kubernetes.io/projected/4c91594d-41ac-4d03-a9cc-910cdc87c30f-kube-api-access-bzgd7\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359220 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-etc-kubernetes\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-var-lib-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8zk\" (UniqueName: \"kubernetes.io/projected/be5750a5-cb62-4414-a5b7-273edc9e9c1e-kube-api-access-js8zk\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afd5d371-4d02-428a-878a-f2b78f7f8e6c-agent-certs\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-host\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e743b094-7e5d-496c-a8fd-5f2b801b4cee-serviceca\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-daemon-config\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-script-lib\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.361227 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-netns\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-etc-kubernetes\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-var-lib-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-host\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.359880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.359262 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.359959 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:12:49.859936982 +0000 UTC m=+3.115004361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-sys-fs\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360196 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-netd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360330 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.360403 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-k8s-cni-cncf-io\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-netns\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-system-cni-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.361948 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be5750a5-cb62-4414-a5b7-273edc9e9c1e-host-slash\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.360530 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:49.860512645 +0000 UTC m=+3.115580018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cnibin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cnibin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be5750a5-cb62-4414-a5b7-273edc9e9c1e-host-slash\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360710 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqnc\" (UniqueName: \"kubernetes.io/projected/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-kube-api-access-dzqnc\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360741 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be5750a5-cb62-4414-a5b7-273edc9e9c1e-iptables-alerter-script\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysconfig\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360819 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-kubernetes\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-lib-modules\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-var-lib-kubelet\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360883 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-kubernetes\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360940 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-var-lib-kubelet\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92eceb2e-00de-4593-84de-6e5878c81f4e-tmp-dir\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysconfig\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.362674 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-lib-modules\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.360996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-socket-dir-parent\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-socket-dir-parent\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92eceb2e-00de-4593-84de-6e5878c81f4e-tmp-dir\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-systemd\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-bin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-kubelet\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-kubelet-config\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-kubelet\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-kubelet\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361417 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-bin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-systemd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361422 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-systemd\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.363348 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-kubelet-config\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361465 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-kubelet\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361480 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-registration-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-systemd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-registration-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afd5d371-4d02-428a-878a-f2b78f7f8e6c-konnectivity-ca\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-config\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-env-overrides\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg2wm\" (UniqueName: \"kubernetes.io/projected/e743b094-7e5d-496c-a8fd-5f2b801b4cee-kube-api-access-cg2wm\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.361746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.362902 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afd5d371-4d02-428a-878a-f2b78f7f8e6c-konnectivity-ca\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.362915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-env-overrides\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.362954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-config\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.363369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cni-binary-copy\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.364039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.363649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-daemon-config\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.364936 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.364906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-tmp\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.365046 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.364964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-tuned\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.365111 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.365091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164322e0-a486-4897-9da0-a8bb7a6244fb-ovn-node-metrics-cert\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.367438 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.367415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afd5d371-4d02-428a-878a-f2b78f7f8e6c-agent-certs\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.379213 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.379182 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:49.379213 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.379215 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:49.379432 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.379231 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:49.379432 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.379298 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:12:49.879276736 +0000 UTC m=+3.134344105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:49.382503 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.382473 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8xl\" (UniqueName: \"kubernetes.io/projected/92eceb2e-00de-4593-84de-6e5878c81f4e-kube-api-access-jz8xl\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.383096 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.383068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9snd\" (UniqueName: \"kubernetes.io/projected/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kube-api-access-z9snd\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.384086 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.384032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqnc\" (UniqueName: \"kubernetes.io/projected/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-kube-api-access-dzqnc\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.384086 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.384052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9c8\" (UniqueName: \"kubernetes.io/projected/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-kube-api-access-tp9c8\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.384086 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.384052 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8zk\" (UniqueName: \"kubernetes.io/projected/be5750a5-cb62-4414-a5b7-273edc9e9c1e-kube-api-access-js8zk\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.384367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.384331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjv2\" (UniqueName: \"kubernetes.io/projected/4cabad06-e774-45b2-ae79-fbe2a70e413f-kube-api-access-jtjv2\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.384367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.384356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5wf\" (UniqueName: \"kubernetes.io/projected/164322e0-a486-4897-9da0-a8bb7a6244fb-kube-api-access-nm5wf\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.386243 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.386223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzgd7\" (UniqueName: \"kubernetes.io/projected/4c91594d-41ac-4d03-a9cc-910cdc87c30f-kube-api-access-bzgd7\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.386338 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.386309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg2wm\" (UniqueName: \"kubernetes.io/projected/e743b094-7e5d-496c-a8fd-5f2b801b4cee-kube-api-access-cg2wm\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.467979 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.467894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:12:49.481491 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.481446 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92eceb2e_00de_4593_84de_6e5878c81f4e.slice/crio-251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715 WatchSource:0}: Error finding container 251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715: Status 404 returned error can't find the container with id 251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715 Oct 29 23:12:49.492582 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.492527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pn77x" Oct 29 23:12:49.499047 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.498858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:12:49.503263 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.503237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:12:49.503841 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.503799 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9adb857_fd51_4830_b99c_2a0d1a1ffeea.slice/crio-d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee WatchSource:0}: Error finding container d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee: Status 404 returned error can't find the container with id d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee Oct 29 23:12:49.510904 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.510872 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cabad06_e774_45b2_ae79_fbe2a70e413f.slice/crio-9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69 WatchSource:0}: Error finding container 9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69: Status 404 returned error can't find the container with id 9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69 Oct 29 23:12:49.514262 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.514183 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:12:49.514660 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.514604 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b17fd4e_b2fa_46a8_af6b_a59f4fafda17.slice/crio-4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff WatchSource:0}: Error finding container 4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff: Status 404 returned error can't find the container with id 4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff Oct 29 23:12:49.523683 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.523654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:49.525738 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.525716 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:12:49.525928 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.525895 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode743b094_7e5d_496c_a8fd_5f2b801b4cee.slice/crio-28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18 WatchSource:0}: Error finding container 28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18: Status 404 returned error can't find the container with id 28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18 Oct 29 23:12:49.528108 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.528037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:12:49.534652 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.534354 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:12:49.542006 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.541974 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd5d371_4d02_428a_878a_f2b78f7f8e6c.slice/crio-e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb WatchSource:0}: Error finding container e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb: Status 404 returned error can't find the container with id e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb Oct 29 23:12:49.543230 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.543203 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164322e0_a486_4897_9da0_a8bb7a6244fb.slice/crio-fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2 WatchSource:0}: Error finding container fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2: Status 404 returned error can't find the container with id fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2 Oct 29 23:12:49.557171 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:12:49.557135 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5750a5_cb62_4414_a5b7_273edc9e9c1e.slice/crio-c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6 WatchSource:0}: Error finding container c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6: Status 404 returned error can't find the container with id c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6 Oct 29 23:12:49.865482 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.865206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:49.865681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.865535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:49.865681 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.865383 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:49.865681 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.865663 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:12:50.865638523 +0000 UTC m=+4.120705878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:49.865835 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.865710 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:49.865835 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.865798 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:50.865782341 +0000 UTC m=+4.120849700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:49.968016 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:49.967977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:49.968212 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.968136 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:49.968212 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.968158 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:49.968212 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.968170 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:49.968368 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:49.968233 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:12:50.968212845 +0000 UTC m=+4.223280201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:50.199474 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.199313 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:49 +0000 UTC" deadline="2028-06-20 02:12:26.293754095 +0000 UTC" Oct 29 23:12:50.199474 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.199380 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14378h59m36.094378293s" Oct 29 23:12:50.303342 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.302963 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" event={"ID":"2db034d2cac0da0a261053f0bada2678","Type":"ContainerStarted","Data":"53aed25590b8b0c4d9fe0353ce18311e99ac236f0ef72558634b250808decaa1"} Oct 29 23:12:50.316541 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.316502 2576 generic.go:356] "Generic (PLEG): container finished" podID="01348cd00e880c068c6ab3ecc9c090d7" containerID="f1d9de301787f80f7ac8292504ff109aa3bb56f1ac3718fee9114e170225225a" exitCode=0 Oct 29 23:12:50.316743 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.316610 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" event={"ID":"01348cd00e880c068c6ab3ecc9c090d7","Type":"ContainerDied","Data":"f1d9de301787f80f7ac8292504ff109aa3bb56f1ac3718fee9114e170225225a"} Oct 29 23:12:50.321790 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.321761 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" event={"ID":"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2","Type":"ContainerStarted","Data":"3f4ce8ac8bdc1d2b8f6210cc909d0f2bac351d54e8bbda8b2adf94e99bc36fe3"} Oct 29 23:12:50.324336 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.324076 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" event={"ID":"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17","Type":"ContainerStarted","Data":"4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff"} Oct 29 23:12:50.337210 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.337115 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerStarted","Data":"9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69"} Oct 29 23:12:50.357051 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.356978 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pn77x" event={"ID":"e9adb857-fd51-4830-b99c-2a0d1a1ffeea","Type":"ContainerStarted","Data":"d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee"} Oct 29 23:12:50.379949 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.379900 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nnc2g" event={"ID":"92eceb2e-00de-4593-84de-6e5878c81f4e","Type":"ContainerStarted","Data":"251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715"} Oct 29 23:12:50.386484 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.386421 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" podStartSLOduration=2.386405873 podStartE2EDuration="2.386405873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:50.343390746 +0000 UTC m=+3.598458116" watchObservedRunningTime="2026-10-29 23:12:50.386405873 +0000 UTC m=+3.641473252" Oct 29 23:12:50.411897 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.411855 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p2xcq" event={"ID":"be5750a5-cb62-4414-a5b7-273edc9e9c1e","Type":"ContainerStarted","Data":"c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6"} Oct 29 23:12:50.439336 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.439285 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2"} Oct 29 23:12:50.452192 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.452102 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c47rv" event={"ID":"afd5d371-4d02-428a-878a-f2b78f7f8e6c","Type":"ContainerStarted","Data":"e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb"} Oct 29 23:12:50.466656 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.466530 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4qvsk" event={"ID":"e743b094-7e5d-496c-a8fd-5f2b801b4cee","Type":"ContainerStarted","Data":"28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18"} Oct 29 23:12:50.874733 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.874651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:50.874887 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.874742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:50.874947 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.874893 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:50.874996 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.874966 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:12:52.874937274 +0000 UTC m=+6.130004648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:50.875598 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.875579 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:50.875700 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.875652 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:52.875618533 +0000 UTC m=+6.130685887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:50.975875 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:50.975832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:50.979977 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.979939 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:50.979977 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.979979 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:50.980186 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.980003 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:50.980186 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:50.980083 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:12:52.980052472 +0000 UTC m=+6.235119852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:51.200558 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.200491 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:49 +0000 UTC" deadline="2028-04-01 10:47:59.478626449 +0000 UTC" Oct 29 23:12:51.201058 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.200571 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12467h35m8.278074612s" Oct 29 23:12:51.291864 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.291828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:51.292043 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:51.291975 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:12:51.292450 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.292424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:51.292568 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:51.292530 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:12:51.292647 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.292612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:51.292744 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:51.292722 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:12:51.474593 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.474504 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" event={"ID":"01348cd00e880c068c6ab3ecc9c090d7","Type":"ContainerStarted","Data":"23f460ca643819b02fe75ccb3f57cc6233309129fbdc957277acdca2519b4dbe"} Oct 29 23:12:51.514758 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:51.514510 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" podStartSLOduration=3.51448888 podStartE2EDuration="3.51448888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:51.513624959 +0000 UTC m=+4.768692341" watchObservedRunningTime="2026-10-29 23:12:51.51448888 +0000 UTC m=+4.769556259" Oct 29 23:12:52.516529 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:52.516494 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="9ba53189ef40d8d367e2f53900ac8ca5327a4d8667b6405b0f3e79a4d3b42fcc" exitCode=0 Oct 29 23:12:52.516978 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:52.516680 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerDied","Data":"9ba53189ef40d8d367e2f53900ac8ca5327a4d8667b6405b0f3e79a4d3b42fcc"} Oct 29 23:12:52.893869 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:52.893798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:52.893869 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:52.893858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:52.894110 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.893964 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:52.894110 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.894010 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:56.893996627 +0000 UTC m=+10.149063993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:52.894372 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.894356 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:52.894434 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.894401 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:12:56.894389752 +0000 UTC m=+10.149457117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:52.995640 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:52.995138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:52.995640 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.995269 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:52.995640 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.995288 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:52.995640 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.995298 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:52.995640 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:52.995338 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:12:56.995326833 +0000 UTC m=+10.250394185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:53.290324 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:53.289132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:53.290324 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:53.289266 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:12:53.290324 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:53.289662 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:53.290324 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:53.289759 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:12:53.290324 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:53.289810 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:53.290324 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:53.289897 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:12:54.534134 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:54.533940 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c47rv" event={"ID":"afd5d371-4d02-428a-878a-f2b78f7f8e6c","Type":"ContainerStarted","Data":"0086d1eb9275b0e6f8c05428ff4f3549ad1a0f9aa65fb3963c6b97d71cc61de1"} Oct 29 23:12:55.288238 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.288207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:55.288416 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:55.288320 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:12:55.288734 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.288708 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:55.288858 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:55.288810 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:12:55.288927 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.288877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:55.288980 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:55.288948 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:12:55.540297 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.539509 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4qvsk" event={"ID":"e743b094-7e5d-496c-a8fd-5f2b801b4cee","Type":"ContainerStarted","Data":"8b932964435323733fc1e5c28c817d91333de3938866349ace7c2ddf77dd9adb"} Oct 29 23:12:55.544384 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.544206 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" event={"ID":"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17","Type":"ContainerStarted","Data":"ae1c3c233ce1d161eef01a21a1d07f3609b1458061dd3f7d34991059f8e4293e"} Oct 29 23:12:55.575617 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.575541 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c47rv" podStartSLOduration=4.49906988 podStartE2EDuration="8.575523837s" totalImagesPullingTime="4.076453957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:54.573002616 +0000 UTC m=+7.828069990" watchObservedRunningTime="2026-10-29 23:12:55.575523837 +0000 UTC m=+8.830591211" Oct 29 23:12:55.754669 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.754602 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:55.755532 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.755297 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:55.792506 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:55.791368 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4qvsk" podStartSLOduration=3.454516791 podStartE2EDuration="8.791345649s" totalImagesPullingTime="5.336828858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:55.57632845 +0000 UTC m=+8.831395828" watchObservedRunningTime="2026-10-29 23:12:55.791345649 +0000 UTC m=+9.046413026" Oct 29 23:12:56.867952 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:56.867929 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 29 23:12:56.934750 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:56.933946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:56.934750 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:56.934006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:56.934750 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:56.934135 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:56.934750 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:56.934201 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.93418116 +0000 UTC m=+18.189248516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:56.934750 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:56.934618 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:56.934750 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:56.934670 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.934655021 +0000 UTC m=+18.189722390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:57.034720 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.034691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:57.034854 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.034840 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:57.034916 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.034863 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:57.034916 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.034875 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:57.035017 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.034937 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:13:05.034920064 +0000 UTC m=+18.289987422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:57.221886 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.221754 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:12:56.867951265Z","UUID":"868c2743-b22d-4ee9-b85c-2a6af2fb3bf6","Handler":null,"Name":"","Endpoint":""} Oct 29 23:12:57.223854 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.223824 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 29 23:12:57.223854 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.223860 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 29 23:12:57.287600 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.287571 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:57.287730 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.287689 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:12:57.287825 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.287800 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:57.287951 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.287926 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:12:57.288008 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.287952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:57.288087 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:57.288059 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:12:57.552246 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.551980 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nnc2g" event={"ID":"92eceb2e-00de-4593-84de-6e5878c81f4e","Type":"ContainerStarted","Data":"7c7ea847f059c18e1f84c388df3a1bdb07d6be48f18c003f44205d30e635751a"} Oct 29 23:12:57.556971 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.556935 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" event={"ID":"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17","Type":"ContainerStarted","Data":"d849ff5e22ab40af79f81911f16cbdaf60f8535a61e42739842b68b967ae0ffc"} Oct 29 23:12:57.560069 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.560024 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerStarted","Data":"5d4f49d138312ccb2c49487f351d99ba69f8cb1e4d58441c508648e4765e1cca"} Oct 29 23:12:57.563127 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.563105 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:12:57.563578 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.563537 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pn77x" event={"ID":"e9adb857-fd51-4830-b99c-2a0d1a1ffeea","Type":"ContainerStarted","Data":"5b395b17b0578bfd7f6f4ea49ad0c1a68ebdf1d675663ddb38c20038f0994356"} Oct 29 23:12:57.633038 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.632978 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-nnc2g" podStartSLOduration=2.842482935 podStartE2EDuration="10.632957671s" totalImagesPullingTime="7.790474736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:57.591370091 +0000 UTC m=+10.846437467" watchObservedRunningTime="2026-10-29 23:12:57.632957671 +0000 UTC m=+10.888025046" Oct 29 23:12:57.672949 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:57.672897 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-pn77x" podStartSLOduration=3.187738367 podStartE2EDuration="10.672879904s" totalImagesPullingTime="7.485141537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:57.672242384 +0000 UTC m=+10.927309762" watchObservedRunningTime="2026-10-29 23:12:57.672879904 +0000 UTC m=+10.927947277" Oct 29 23:12:58.568789 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.568713 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" event={"ID":"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17","Type":"ContainerStarted","Data":"08e5be9fb91e454b73056760dc206da27e86f710919dffcc075b28f51030c7c1"} Oct 29 23:12:58.572059 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.571631 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="5d4f49d138312ccb2c49487f351d99ba69f8cb1e4d58441c508648e4765e1cca" exitCode=0 Oct 29 23:12:58.572059 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.571670 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerDied","Data":"5d4f49d138312ccb2c49487f351d99ba69f8cb1e4d58441c508648e4765e1cca"} Oct 29 23:12:58.603039 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.603008 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:58.603194 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.603184 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:12:58.603596 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.603570 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:12:58.608452 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:58.608397 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" podStartSLOduration=3.574100535 podStartE2EDuration="11.608380142s" totalImagesPullingTime="8.034279607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:58.607460715 +0000 UTC m=+11.862528091" watchObservedRunningTime="2026-10-29 23:12:58.608380142 +0000 UTC m=+11.863447519" Oct 29 23:12:59.289280 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:59.287702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:12:59.289280 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:59.287833 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:12:59.289280 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:59.287890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:12:59.289280 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:59.287956 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:12:59.289280 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:59.289135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:12:59.289280 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:12:59.289224 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:12:59.576953 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:59.576925 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="6ecf7ec02e8a8bbf4f067cae080fb1fa7f580ede1af462a04726f3e732a29481" exitCode=0 Oct 29 23:12:59.577491 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:59.577010 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerDied","Data":"6ecf7ec02e8a8bbf4f067cae080fb1fa7f580ede1af462a04726f3e732a29481"} Oct 29 23:12:59.578679 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:12:59.578651 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p2xcq" event={"ID":"be5750a5-cb62-4414-a5b7-273edc9e9c1e","Type":"ContainerStarted","Data":"fb13563c70167d5b9a718fb9158624de16c6bcebe69c8f5e8e00f2f99142d0f9"} Oct 29 23:13:00.582490 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:00.582397 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" event={"ID":"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2","Type":"ContainerStarted","Data":"32df4b150d3daf93043d7954bd99d07bc321d3f35ad3c777ccb703fdba602df4"} Oct 29 23:13:00.585031 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:00.585008 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="a45bf9a8d912948f2c0db390f7f39be3125ccb03a34d3c8f4ac1acb1778018c0" exitCode=0 Oct 29 23:13:00.585144 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:00.585080 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerDied","Data":"a45bf9a8d912948f2c0db390f7f39be3125ccb03a34d3c8f4ac1acb1778018c0"} Oct 29 23:13:00.623115 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:00.623057 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p2xcq" podStartSLOduration=5.5324221730000005 podStartE2EDuration="13.62303841s" totalImagesPullingTime="8.090616237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:59.665331388 +0000 UTC m=+12.920398762" watchObservedRunningTime="2026-10-29 23:13:00.62303841 +0000 UTC m=+13.878105785" Oct 29 23:13:00.663070 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:00.663010 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" podStartSLOduration=3.655982104 podStartE2EDuration="13.662990692s" totalImagesPullingTime="10.007008588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:00.622539743 +0000 UTC m=+13.877607116" watchObservedRunningTime="2026-10-29 23:13:00.662990692 +0000 UTC m=+13.918058067" Oct 29 23:13:01.288009 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:01.287979 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:01.288173 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:01.288095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:01.288432 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:01.288406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:01.288570 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:01.288497 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:01.288638 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:01.288569 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:01.288688 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:01.288644 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:02.592942 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:02.592731 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerStarted","Data":"a3fbc8edba22d23e141c10e002d00976848812bb4cd175a2ae7adabb0c88598a"} Oct 29 23:13:03.286830 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:03.286793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:03.286987 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:03.286809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:03.286987 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:03.286933 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:03.287092 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:03.286989 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:03.287092 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:03.287014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:03.287174 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:03.287127 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:03.597343 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:03.597262 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="a3fbc8edba22d23e141c10e002d00976848812bb4cd175a2ae7adabb0c88598a" exitCode=0 Oct 29 23:13:03.597343 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:03.597312 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerDied","Data":"a3fbc8edba22d23e141c10e002d00976848812bb4cd175a2ae7adabb0c88598a"} Oct 29 23:13:04.603081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.602869 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"6da5d9ba47a9c3d65dc369b8d32f09791c535a3c0ac2fc219bac525f3b76db1f"} Oct 29 23:13:04.603502 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.603143 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"6f73032592de41cda998836370730e67684febe2276d0b8510e2e63f48282772"} Oct 29 23:13:04.603502 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.603188 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"84142b62ffc0367bf73c99d5e99e0117e17e5ddc976bf2fdbd665dc4109f2634"} Oct 29 23:13:04.603502 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.603221 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"1adb5b6af0bafa21b08ba895d0151186208e43a63591e2de61fd269ed4485610"} Oct 29 23:13:04.603502 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.603252 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"9e72901ca8fa1bdb8b4d217d070af14122297e986fc813ab5ce0b2a3fe515e78"} Oct 29 23:13:04.603502 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.603279 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"412abd11a8340c652886f372a9cdba0f14a1ae9681f0f19d711f00f251e20482"} Oct 29 23:13:04.605766 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.605737 2576 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="9f00b39290d181a478aa73b47eed0659201540cacc6558f3c324fc4a04dc7011" exitCode=0 Oct 29 23:13:04.605866 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.605771 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerDied","Data":"9f00b39290d181a478aa73b47eed0659201540cacc6558f3c324fc4a04dc7011"} Oct 29 23:13:04.992588 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.992478 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:04.992588 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:04.992544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:04.992761 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:04.992656 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:04.992761 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:04.992658 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:04.992761 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:04.992710 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:20.99269701 +0000 UTC m=+34.247764363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:04.992761 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:04.992724 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:20.992717845 +0000 UTC m=+34.247785197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:05.093246 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:05.093210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:05.093403 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.093356 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:13:05.093403 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.093377 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:13:05.093403 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.093388 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:05.093532 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.093436 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:13:21.093424256 +0000 UTC m=+34.348491608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:05.286878 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:05.286789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:05.286878 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:05.286812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:05.287083 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:05.286784 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:05.287083 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.286901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:05.287083 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.286971 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:05.287083 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:05.287061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:05.611660 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:05.611580 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" event={"ID":"4cabad06-e774-45b2-ae79-fbe2a70e413f","Type":"ContainerStarted","Data":"da15e0c5f99468060496cca8afecd9d13c1bdd3e62aeacf021754b3c9008aeec"} Oct 29 23:13:05.671608 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:05.671540 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bl5l6" podStartSLOduration=8.359395328 podStartE2EDuration="18.671527088s" totalImagesPullingTime="10.31213176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:05.671034444 +0000 UTC m=+18.926101818" watchObservedRunningTime="2026-10-29 23:13:05.671527088 +0000 UTC m=+18.926594462" Oct 29 23:13:06.617095 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:06.617063 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"2ea9da6965220a132a618fc33ea526ccd667ba7daf5371834bd49b56f4ccd2b0"} Oct 29 23:13:06.680568 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:06.680530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnc2g_92eceb2e-00de-4593-84de-6e5878c81f4e/dns-node-resolver/0.log" Oct 29 23:13:07.234204 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:07.234173 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4qvsk_e743b094-7e5d-496c-a8fd-5f2b801b4cee/node-ca/0.log" Oct 29 23:13:07.286989 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:07.286957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:07.287179 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:07.287078 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:07.287179 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:07.287105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:07.287294 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:07.287075 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:07.287294 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:07.287246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:07.287378 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:07.287334 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:08.624532 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:08.624448 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" event={"ID":"164322e0-a486-4897-9da0-a8bb7a6244fb","Type":"ContainerStarted","Data":"6404d925a1b8344e2e05509dbc862eeeaeb225997f64e9e0215588670f1a50d8"} Oct 29 23:13:08.625298 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:08.624694 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:08.640923 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:08.640902 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:08.709181 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:08.709125 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" podStartSLOduration=7.587851447 podStartE2EDuration="21.709108497s" totalImagesPullingTime="14.12125705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:08.709094343 +0000 UTC m=+21.964161732" watchObservedRunningTime="2026-10-29 23:13:08.709108497 +0000 UTC m=+21.964175873" Oct 29 23:13:08.978712 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:08.978621 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c47rv_afd5d371-4d02-428a-878a-f2b78f7f8e6c/konnectivity-agent/0.log" limit=1024 Oct 29 23:13:09.236235 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.236150 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c47rv_afd5d371-4d02-428a-878a-f2b78f7f8e6c/konnectivity-agent/0.log" limit=1024 Oct 29 23:13:09.286402 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.286365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:09.286402 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.286396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:09.286613 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.286370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:09.286613 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:09.286495 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:09.286613 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:09.286542 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:09.286757 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:09.286632 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:09.627117 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.627041 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:09.627535 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.627515 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:09.643133 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.643110 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:09.737002 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:09.736966 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c47rv_afd5d371-4d02-428a-878a-f2b78f7f8e6c/konnectivity-agent/0.log" limit=1024 Oct 29 23:13:10.629680 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:10.629655 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:11.289797 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:11.289607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:11.289961 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:11.289672 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:11.289961 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:11.289869 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:11.289961 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:11.289679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:11.289961 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:11.289941 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:11.290112 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:11.289996 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:11.632027 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:11.631954 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:13.288799 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:13.288774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:13.289217 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:13.288864 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:13.289217 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:13.288937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:13.289217 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:13.289009 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:13.289217 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:13.289016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:13.289217 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:13.289093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:15.286874 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.286836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:15.286874 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.286836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:15.287423 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:15.287013 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:15.287423 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.287034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:15.287423 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:15.287124 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:15.287423 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:15.287200 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:15.389429 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.389393 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:15.389635 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.389617 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:15.400332 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.400297 2576 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" podUID="164322e0-a486-4897-9da0-a8bb7a6244fb" containerName="ovnkube-controller" probeResult="failure" output="" Oct 29 23:13:15.409389 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:15.409356 2576 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" podUID="164322e0-a486-4897-9da0-a8bb7a6244fb" containerName="ovnkube-controller" probeResult="failure" output="" Oct 29 23:13:17.287538 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:17.287503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:17.287983 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:17.287640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:17.287983 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:17.287643 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:17.287983 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:17.287812 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:17.287983 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:17.287854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:17.287983 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:17.287956 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:19.286514 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:19.286476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:19.287058 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:19.286485 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:19.287058 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:19.286612 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:19.287058 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:19.286489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:19.287058 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:19.286662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:19.287058 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:19.286726 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:21.009547 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:21.009514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:21.010070 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:21.009575 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:21.010070 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.009671 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:21.010070 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.009671 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:21.010070 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.009733 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs podName:4c91594d-41ac-4d03-a9cc-910cdc87c30f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:53.009717459 +0000 UTC m=+66.264784829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs") pod "network-metrics-daemon-p7x9w" (UID: "4c91594d-41ac-4d03-a9cc-910cdc87c30f") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:21.010070 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.009747 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret podName:ecb4e993-6e54-4680-8e52-4988c38199f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:53.009741793 +0000 UTC m=+66.264809146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret") pod "global-pull-secret-syncer-6s4mw" (UID: "ecb4e993-6e54-4680-8e52-4988c38199f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:21.110484 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:21.110453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:21.110664 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.110621 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:13:21.110664 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.110637 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:13:21.110664 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.110647 2576 projected.go:196] Error preparing data for projected volume kube-api-access-frlwb for pod openshift-network-diagnostics/network-check-target-7n6qd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:21.110783 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.110703 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb podName:d6660100-f2b0-46e1-bbd0-6566db43d9aa nodeName:}" failed. No retries permitted until 2026-10-29 23:13:53.110689682 +0000 UTC m=+66.365757034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-frlwb" (UniqueName: "kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb") pod "network-check-target-7n6qd" (UID: "d6660100-f2b0-46e1-bbd0-6566db43d9aa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:21.286034 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:21.285943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:21.286034 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:21.285970 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:21.286243 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:21.286049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:21.286243 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.286065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:21.286243 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.286146 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:21.286243 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:21.286207 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:23.286709 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:23.286675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:23.286709 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:23.286700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:23.287200 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:23.286781 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:23.287200 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:23.286851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:23.287200 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:23.286947 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:23.287200 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:23.287010 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:25.286702 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:25.286670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:25.287184 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:25.286670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:25.287184 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:25.286780 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:25.287184 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:25.286872 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:25.287184 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:25.286670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:25.287184 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:25.286969 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:27.287181 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.287146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:27.287612 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.287277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:27.287612 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:27.287357 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:27.287612 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.287574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:27.287712 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:27.287646 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:27.287908 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:27.287881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:27.437177 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.437146 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6s4mw"] Oct 29 23:13:27.440530 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.440500 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7n6qd"] Oct 29 23:13:27.441044 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.441027 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p7x9w"] Oct 29 23:13:27.676103 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.676077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:27.676248 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.676079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:27.676248 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:27.676188 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:27.676248 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:27.676079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:27.676342 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:27.676248 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:27.676342 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:27.676304 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:29.286968 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:29.286782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:29.287423 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:29.286782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:29.287423 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:29.287075 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:29.287423 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:29.286802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:29.287423 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:29.287151 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:29.287423 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:29.287201 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:31.286173 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.286131 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:31.286173 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.286162 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:31.286728 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.286252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:31.286728 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:31.286265 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p7x9w" podUID="4c91594d-41ac-4d03-a9cc-910cdc87c30f" Oct 29 23:13:31.286728 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:31.286369 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7n6qd" podUID="d6660100-f2b0-46e1-bbd0-6566db43d9aa" Oct 29 23:13:31.286728 ip-10-0-137-132 kubenswrapper[2576]: E1029 23:13:31.286465 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6s4mw" podUID="ecb4e993-6e54-4680-8e52-4988c38199f0" Oct 29 23:13:31.554979 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.554902 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeReady" Oct 29 23:13:31.555184 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.555067 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 29 23:13:31.616804 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.616772 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b8w9r"] Oct 29 23:13:31.619192 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.619171 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rj4cr"] Oct 29 23:13:31.619318 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.619304 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.620790 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.620772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.634146 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634115 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crphw\"" Oct 29 23:13:31.634146 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634140 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 29 23:13:31.634325 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634193 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 29 23:13:31.634325 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634200 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 29 23:13:31.634325 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634306 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 29 23:13:31.634325 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634306 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 29 23:13:31.634568 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634541 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 29 23:13:31.634793 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.634782 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h6cnq\"" Oct 29 23:13:31.646741 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.646720 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b8w9r"] Oct 29 23:13:31.647347 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.647329 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rj4cr"] Oct 29 23:13:31.716417 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.716387 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2dpmf"] Oct 29 23:13:31.718625 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.718606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.734136 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.734115 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 29 23:13:31.734958 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.734944 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-984bt\"" Oct 29 23:13:31.735019 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.734954 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 29 23:13:31.735157 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.735138 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 29 23:13:31.745688 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.745667 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2dpmf"] Oct 29 23:13:31.783659 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.783659 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.783891 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmn4k\" (UniqueName: \"kubernetes.io/projected/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-api-access-fmn4k\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.783891 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xc8\" (UniqueName: \"kubernetes.io/projected/9c2205ed-fff4-48e9-9461-c085df16e0ba-kube-api-access-m6xc8\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.783891 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-crio-socket\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.783891 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c2205ed-fff4-48e9-9461-c085df16e0ba-cert\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.784026 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.783905 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-data-volume\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.884997 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.884925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-data-volume\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.884997 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.884965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24ca50cb-c977-4fbd-848f-c4ff5f7be381-config-volume\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.885138 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ca50cb-c977-4fbd-848f-c4ff5f7be381-tmp-dir\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.885138 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.885138 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.885138 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmn4k\" (UniqueName: \"kubernetes.io/projected/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-api-access-fmn4k\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.885138 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xc8\" (UniqueName: \"kubernetes.io/projected/9c2205ed-fff4-48e9-9461-c085df16e0ba-kube-api-access-m6xc8\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.885362 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885171 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ca50cb-c977-4fbd-848f-c4ff5f7be381-metrics-tls\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.885362 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-crio-socket\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.885362 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c2205ed-fff4-48e9-9461-c085df16e0ba-cert\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.885362 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885302 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-data-volume\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.885529 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sdz7\" (UniqueName: \"kubernetes.io/projected/24ca50cb-c977-4fbd-848f-c4ff5f7be381-kube-api-access-7sdz7\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.885529 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-crio-socket\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.885815 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.885781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.889181 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.889163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.889181 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.889174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c2205ed-fff4-48e9-9461-c085df16e0ba-cert\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.905921 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.905888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmn4k\" (UniqueName: \"kubernetes.io/projected/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-api-access-fmn4k\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.907342 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.907319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xc8\" (UniqueName: \"kubernetes.io/projected/9c2205ed-fff4-48e9-9461-c085df16e0ba-kube-api-access-m6xc8\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.935370 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.935338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:31.936404 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.936385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:31.987589 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.986443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ca50cb-c977-4fbd-848f-c4ff5f7be381-metrics-tls\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.987589 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.986530 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdz7\" (UniqueName: \"kubernetes.io/projected/24ca50cb-c977-4fbd-848f-c4ff5f7be381-kube-api-access-7sdz7\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.987589 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.986658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24ca50cb-c977-4fbd-848f-c4ff5f7be381-config-volume\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.987589 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.986723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ca50cb-c977-4fbd-848f-c4ff5f7be381-tmp-dir\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.987589 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.987213 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ca50cb-c977-4fbd-848f-c4ff5f7be381-tmp-dir\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.988100 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.987994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24ca50cb-c977-4fbd-848f-c4ff5f7be381-config-volume\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:31.990017 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:31.989992 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ca50cb-c977-4fbd-848f-c4ff5f7be381-metrics-tls\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:32.012938 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.012781 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdz7\" (UniqueName: \"kubernetes.io/projected/24ca50cb-c977-4fbd-848f-c4ff5f7be381-kube-api-access-7sdz7\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:32.029067 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.029008 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:32.259944 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.259915 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rj4cr"] Oct 29 23:13:32.262108 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.262088 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b8w9r"] Oct 29 23:13:32.264971 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:32.264946 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2205ed_fff4_48e9_9461_c085df16e0ba.slice/crio-9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac WatchSource:0}: Error finding container 9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac: Status 404 returned error can't find the container with id 9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac Oct 29 23:13:32.268002 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:32.267978 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b62b29d_bf73_44c3_9d91_7c7d3de6ab39.slice/crio-7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7 WatchSource:0}: Error finding container 7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7: Status 404 returned error can't find the container with id 7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7 Oct 29 23:13:32.326474 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.326311 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2dpmf"] Oct 29 23:13:32.329543 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:32.329514 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ca50cb_c977_4fbd_848f_c4ff5f7be381.slice/crio-ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1 WatchSource:0}: Error finding container ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1: Status 404 returned error can't find the container with id ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1 Oct 29 23:13:32.631915 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.631830 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnc2g_92eceb2e-00de-4593-84de-6e5878c81f4e/dns-node-resolver/0.log" Oct 29 23:13:32.691270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.691198 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rj4cr" event={"ID":"9c2205ed-fff4-48e9-9461-c085df16e0ba","Type":"ContainerStarted","Data":"9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac"} Oct 29 23:13:32.693054 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.692673 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2dpmf" event={"ID":"24ca50cb-c977-4fbd-848f-c4ff5f7be381","Type":"ContainerStarted","Data":"ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1"} Oct 29 23:13:32.694700 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.694671 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b8w9r" event={"ID":"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39","Type":"ContainerStarted","Data":"b1ab65bf350f6c3f0b9969fbbcd6bbea37b4a61aa3d1876d80a343cbb3f4c07a"} Oct 29 23:13:32.694839 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:32.694727 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b8w9r" event={"ID":"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39","Type":"ContainerStarted","Data":"7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7"} Oct 29 23:13:33.288072 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.288043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:33.288490 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.288468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:33.288907 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.288892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:33.305983 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.305943 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:33.315594 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.315152 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:33.315594 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.315198 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\"" Oct 29 23:13:33.315594 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.315275 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:33.316756 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.316711 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\"" Oct 29 23:13:33.316756 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.316746 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:33.317012 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.316995 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\"" Oct 29 23:13:33.427849 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.427818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4qvsk_e743b094-7e5d-496c-a8fd-5f2b801b4cee/node-ca/0.log" Oct 29 23:13:33.700599 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:33.700541 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b8w9r" event={"ID":"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39","Type":"ContainerStarted","Data":"cf90ed533e9a5c9c31e9e01d2f6a2f1b6a207919b5066f4584ff7dd5150e844e"} Oct 29 23:13:34.505616 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.505581 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7"] Oct 29 23:13:34.508504 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.508424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.522817 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.521710 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4567x"] Oct 29 23:13:34.524121 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.524103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.536496 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.536477 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7"] Oct 29 23:13:34.547764 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.547731 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 29 23:13:34.548634 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.548506 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 29 23:13:34.548634 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.548520 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 29 23:13:34.549057 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.549039 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 29 23:13:34.559246 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.559208 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 29 23:13:34.559246 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.559208 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xpn55\"" Oct 29 23:13:34.560123 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.560047 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 29 23:13:34.560123 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.560080 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6s7px\"" Oct 29 23:13:34.560123 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.560084 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 29 23:13:34.560123 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.560107 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 29 23:13:34.560320 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.560166 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 29 23:13:34.608001 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.607858 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.608001 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.607906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dab03a0-efe3-4b27-b982-66628c8dc8a1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.608001 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.607959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.608248 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.608077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2dt8\" (UniqueName: \"kubernetes.io/projected/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-api-access-r2dt8\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.608248 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.608115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.608248 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.608142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.706763 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.706734 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2dpmf" event={"ID":"24ca50cb-c977-4fbd-848f-c4ff5f7be381","Type":"ContainerStarted","Data":"7a5c12bd7187937a72f36f1c56e3e8794a7d7759eb81d00ff111a34e78a96c2a"} Oct 29 23:13:34.706880 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.706813 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2dpmf" event={"ID":"24ca50cb-c977-4fbd-848f-c4ff5f7be381","Type":"ContainerStarted","Data":"07332bf1f6e4e6f1a8b1205ad1cb061d9bea9881b2101cc8bb17340879583bfa"} Oct 29 23:13:34.706880 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.706867 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:34.709302 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709279 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.709422 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.709422 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-wtmp\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709422 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709404 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-sys\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709569 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-tls\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709569 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709450 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709569 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.709569 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dab03a0-efe3-4b27-b982-66628c8dc8a1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.709569 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-root\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709818 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc7zk\" (UniqueName: \"kubernetes.io/projected/fa38333f-05b6-4cac-bddf-9bc834ef25f8-kube-api-access-rc7zk\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709818 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.709818 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-metrics-client-ca\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709818 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dt8\" (UniqueName: \"kubernetes.io/projected/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-api-access-r2dt8\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.709818 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-textfile\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.709818 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.709751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.710523 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.710491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.710774 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.710755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dab03a0-efe3-4b27-b982-66628c8dc8a1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.711065 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.711042 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.713446 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.713418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.713536 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.713486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.729270 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.729244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dt8\" (UniqueName: \"kubernetes.io/projected/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-api-access-r2dt8\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.749368 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.749326 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-2dpmf" podStartSLOduration=1.9643891089999999 podStartE2EDuration="3.749312445s" totalImagesPullingTime="1.784923336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:34.748930772 +0000 UTC m=+48.003998160" watchObservedRunningTime="2026-10-29 23:13:34.749312445 +0000 UTC m=+48.004379821" Oct 29 23:13:34.810174 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-textfile\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810174 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-wtmp\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-sys\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-tls\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810267 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-root\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc7zk\" (UniqueName: \"kubernetes.io/projected/fa38333f-05b6-4cac-bddf-9bc834ef25f8-kube-api-access-rc7zk\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810400 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-metrics-client-ca\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810772 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-textfile\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810772 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-sys\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810772 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-wtmp\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810772 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810719 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.810772 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.810746 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-root\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.811057 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.811025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-metrics-client-ca\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.813089 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.813065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-tls\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.813187 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.813133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.824122 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.824100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:34.829882 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.829857 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc7zk\" (UniqueName: \"kubernetes.io/projected/fa38333f-05b6-4cac-bddf-9bc834ef25f8-kube-api-access-rc7zk\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.838886 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:34.838676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:34.848810 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:34.848783 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa38333f_05b6_4cac_bddf_9bc834ef25f8.slice/crio-27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9 WatchSource:0}: Error finding container 27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9: Status 404 returned error can't find the container with id 27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9 Oct 29 23:13:35.136970 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.136938 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7"] Oct 29 23:13:35.151606 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:35.151576 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dab03a0_efe3_4b27_b982_66628c8dc8a1.slice/crio-ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb WatchSource:0}: Error finding container ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb: Status 404 returned error can't find the container with id ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb Oct 29 23:13:35.712636 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.712600 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4567x" event={"ID":"fa38333f-05b6-4cac-bddf-9bc834ef25f8","Type":"ContainerStarted","Data":"350840afc49eacc60d136c60a77c8ed68494349d3769de0a62a0d73a646fa748"} Oct 29 23:13:35.713081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.712670 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4567x" event={"ID":"fa38333f-05b6-4cac-bddf-9bc834ef25f8","Type":"ContainerStarted","Data":"27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9"} Oct 29 23:13:35.715587 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.715528 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b8w9r" event={"ID":"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39","Type":"ContainerStarted","Data":"e52bfcc90623094ba0bfd222dbf26eefb77487bd029aa2d17b9f93d601199dfc"} Oct 29 23:13:35.717479 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.717314 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rj4cr" event={"ID":"9c2205ed-fff4-48e9-9461-c085df16e0ba","Type":"ContainerStarted","Data":"7e159e8d5e2ba9e1a3c15cb6e66711eb5f6150476836f685de812ce599b770d6"} Oct 29 23:13:35.719090 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.719065 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" event={"ID":"6dab03a0-efe3-4b27-b982-66628c8dc8a1","Type":"ContainerStarted","Data":"ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb"} Oct 29 23:13:35.796962 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.796910 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b8w9r" podStartSLOduration=2.533674354 podStartE2EDuration="4.796895696s" totalImagesPullingTime="2.263221342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:35.796331958 +0000 UTC m=+49.051399331" watchObservedRunningTime="2026-10-29 23:13:35.796895696 +0000 UTC m=+49.051963066" Oct 29 23:13:35.843336 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:35.843289 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rj4cr" podStartSLOduration=2.08699736 podStartE2EDuration="4.843275092s" totalImagesPullingTime="2.756277732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:35.842902197 +0000 UTC m=+49.097969574" watchObservedRunningTime="2026-10-29 23:13:35.843275092 +0000 UTC m=+49.098342465" Oct 29 23:13:36.627274 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.627176 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-555fbcb47b-99nwc"] Oct 29 23:13:36.629987 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.629962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.645195 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.645174 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 29 23:13:36.645297 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.645247 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 29 23:13:36.645370 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.645356 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 29 23:13:36.645590 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.645573 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eivphfkuffkj0\"" Oct 29 23:13:36.645676 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.645663 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 29 23:13:36.656819 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.656738 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 29 23:13:36.658367 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.658347 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-555fbcb47b-99nwc"] Oct 29 23:13:36.724182 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724151 2576 generic.go:356] "Generic (PLEG): container finished" podID="fa38333f-05b6-4cac-bddf-9bc834ef25f8" containerID="350840afc49eacc60d136c60a77c8ed68494349d3769de0a62a0d73a646fa748" exitCode=0 Oct 29 23:13:36.724667 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724228 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4567x" event={"ID":"fa38333f-05b6-4cac-bddf-9bc834ef25f8","Type":"ContainerDied","Data":"350840afc49eacc60d136c60a77c8ed68494349d3769de0a62a0d73a646fa748"} Oct 29 23:13:36.724667 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.724667 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-tmp\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.724667 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4c4\" (UniqueName: \"kubernetes.io/projected/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-kube-api-access-wn4c4\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.724872 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724730 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-metrics-client-ca\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.724872 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.724872 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724793 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.724872 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.725047 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.724985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.725047 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.725026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-grpc-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.727279 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.727252 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" event={"ID":"6dab03a0-efe3-4b27-b982-66628c8dc8a1","Type":"ContainerStarted","Data":"f4c58ae740c7a49a3d6b433c9418ea7954febeea46e5f39683925a0480d0a697"} Oct 29 23:13:36.727393 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.727310 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" event={"ID":"6dab03a0-efe3-4b27-b982-66628c8dc8a1","Type":"ContainerStarted","Data":"a9bc14e7b99230dadddf5c4cc6876cc327bec8320446d1523d531b0b0d94b221"} Oct 29 23:13:36.727393 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.727340 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" event={"ID":"6dab03a0-efe3-4b27-b982-66628c8dc8a1","Type":"ContainerStarted","Data":"a98c6834654bca9d6cae4849efd84de4dca72dea74f500255d8c3c1db364bbb0"} Oct 29 23:13:36.744655 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.744632 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ddvzx\"" Oct 29 23:13:36.804920 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.804874 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" podStartSLOduration=1.657079272 podStartE2EDuration="2.804859266s" totalImagesPullingTime="1.147779994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:36.803533146 +0000 UTC m=+50.058600521" watchObservedRunningTime="2026-10-29 23:13:36.804859266 +0000 UTC m=+50.059926637" Oct 29 23:13:36.826369 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826339 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.826723 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-tmp\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.826804 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4c4\" (UniqueName: \"kubernetes.io/projected/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-kube-api-access-wn4c4\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.826804 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-metrics-client-ca\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.826912 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.826961 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.826961 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.827061 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.826995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.827118 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.827074 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-tmp\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.827118 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.827082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-grpc-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.827392 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.827372 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-metrics-client-ca\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.829324 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.829301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.830081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.830059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.830463 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.830444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.830731 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.830716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-grpc-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.831403 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.831377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.831500 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.831377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.845851 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.845830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4c4\" (UniqueName: \"kubernetes.io/projected/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-kube-api-access-wn4c4\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:36.946825 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:36.946792 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:37.293057 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:37.293033 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-555fbcb47b-99nwc"] Oct 29 23:13:37.293909 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:37.293885 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8f8b34_c3bc_4ae2_bb2e_ef04cec310a0.slice/crio-0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd WatchSource:0}: Error finding container 0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd: Status 404 returned error can't find the container with id 0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd Oct 29 23:13:37.733570 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:37.733509 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4567x" event={"ID":"fa38333f-05b6-4cac-bddf-9bc834ef25f8","Type":"ContainerStarted","Data":"765f8ee19f361245acdd8e0ff9917f3fd3bd7314a8fd9a906826031e01429359"} Oct 29 23:13:37.734089 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:37.733612 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4567x" event={"ID":"fa38333f-05b6-4cac-bddf-9bc834ef25f8","Type":"ContainerStarted","Data":"ed5ccfcd98a9d6ae01c18f10eb456042e9c8924094da48b25dadc87efcc955f3"} Oct 29 23:13:37.734958 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:37.734916 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd"} Oct 29 23:13:37.778377 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:37.778319 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4567x" podStartSLOduration=2.935299073 podStartE2EDuration="3.778302978s" totalImagesPullingTime="752.988167ms" totalInitContainerRuntime="90.015738ms" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:37.777133244 +0000 UTC m=+51.032200617" watchObservedRunningTime="2026-10-29 23:13:37.778302978 +0000 UTC m=+51.033370351" Oct 29 23:13:39.199091 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.199060 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt"] Oct 29 23:13:39.201494 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.201475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.222465 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.222440 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt"] Oct 29 23:13:39.250510 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.250435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a0d7f-8036-42ad-bacd-bdeb7da391ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.250510 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.250486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlxql\" (UniqueName: \"kubernetes.io/projected/959a0d7f-8036-42ad-bacd-bdeb7da391ec-kube-api-access-tlxql\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.261081 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.261064 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 29 23:13:39.261155 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.261102 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z8rhq\"" Oct 29 23:13:39.350901 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.350866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a0d7f-8036-42ad-bacd-bdeb7da391ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.351055 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.350920 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxql\" (UniqueName: \"kubernetes.io/projected/959a0d7f-8036-42ad-bacd-bdeb7da391ec-kube-api-access-tlxql\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.353427 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.353403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a0d7f-8036-42ad-bacd-bdeb7da391ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.370468 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.370436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxql\" (UniqueName: \"kubernetes.io/projected/959a0d7f-8036-42ad-bacd-bdeb7da391ec-kube-api-access-tlxql\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.513077 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.512993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:39.744874 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.744834 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"4f1e241ed521caabc376f8223c8e79dcb5b083cca70d7042d2797a1a221955a7"} Oct 29 23:13:39.745024 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.744927 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"4041e9b4da1eba5eb7032412b90cbda9a1fa95940355111e4a6fc22ebe4ac3ce"} Oct 29 23:13:39.745024 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.744959 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"d3b1042375ce2762935aa980d60609f77bbb0d50b81452ac29884e51cefa8a19"} Oct 29 23:13:39.817712 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:39.817688 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt"] Oct 29 23:13:39.820837 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:39.820809 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959a0d7f_8036_42ad_bacd_bdeb7da391ec.slice/crio-0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6 WatchSource:0}: Error finding container 0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6: Status 404 returned error can't find the container with id 0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6 Oct 29 23:13:40.749758 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:40.749716 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" event={"ID":"959a0d7f-8036-42ad-bacd-bdeb7da391ec","Type":"ContainerStarted","Data":"0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6"} Oct 29 23:13:40.753178 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:40.753152 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"7979b2ea5e7ed7d0d8278e8b4996edb63c5d0fbb630cd59bfeb0e9042939c550"} Oct 29 23:13:40.753303 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:40.753218 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"7831c3a3ab6bc11bc484677d2338a25c44bc7b206e73f2ca38ed04e8e7ff3127"} Oct 29 23:13:40.753303 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:40.753263 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" event={"ID":"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0","Type":"ContainerStarted","Data":"0f0a050935ecc28c2a46c5db281547d59888d3445bab62fcff8636dbef2e76ef"} Oct 29 23:13:40.753408 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:40.753345 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:40.832824 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:40.832768 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" podStartSLOduration=2.523222562 podStartE2EDuration="4.832750489s" totalImagesPullingTime="2.309527927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:40.820530324 +0000 UTC m=+54.075597698" watchObservedRunningTime="2026-10-29 23:13:40.832750489 +0000 UTC m=+54.087817862" Oct 29 23:13:41.759235 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:41.759192 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" event={"ID":"959a0d7f-8036-42ad-bacd-bdeb7da391ec","Type":"ContainerStarted","Data":"d07585a0d0e29bff4c3e8274622eba124ebf90786890d474f217ebcf2300c656"} Oct 29 23:13:41.759788 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:41.759503 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:41.764677 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:41.764657 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:41.798632 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:41.798576 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" podStartSLOduration=1.645901674 podStartE2EDuration="2.798540588s" totalImagesPullingTime="1.152638914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:41.797525945 +0000 UTC m=+55.052593318" watchObservedRunningTime="2026-10-29 23:13:41.798540588 +0000 UTC m=+55.053607976" Oct 29 23:13:44.396084 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.396050 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8454765d-bk5jk"] Oct 29 23:13:44.398652 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.398632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.413901 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.413880 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 29 23:13:44.414012 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.413986 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 29 23:13:44.414064 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.414014 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 29 23:13:44.424309 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.424284 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 29 23:13:44.424431 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.424319 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 29 23:13:44.448374 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.448346 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 29 23:13:44.449641 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.449622 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8454765d-bk5jk"] Oct 29 23:13:44.473616 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.473596 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 29 23:13:44.473752 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.473643 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zvskk\"" Oct 29 23:13:44.473752 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.473711 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 29 23:13:44.495191 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495339 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495339 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495466 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495466 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495466 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495583 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.495583 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.495536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596350 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596350 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596532 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596532 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596628 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596681 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596739 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596739 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.596832 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.596773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.597300 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.597276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.597300 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.597290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.597440 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.597352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.597964 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.597939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.599168 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.599144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.599267 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.599252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.615919 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.615894 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.708991 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.708920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:44.721873 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:44.721852 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:45.003437 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:45.003364 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8454765d-bk5jk"] Oct 29 23:13:45.006778 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:45.006752 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b15df4_920b_471e_8070_c8916918c55e.slice/crio-15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214 WatchSource:0}: Error finding container 15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214: Status 404 returned error can't find the container with id 15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214 Oct 29 23:13:45.412495 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:45.412465 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:45.775722 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:45.775634 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8454765d-bk5jk" event={"ID":"61b15df4-920b-471e-8070-c8916918c55e","Type":"ContainerStarted","Data":"15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214"} Oct 29 23:13:46.766753 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:46.766726 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:47.788152 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:47.788069 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8454765d-bk5jk" event={"ID":"61b15df4-920b-471e-8070-c8916918c55e","Type":"ContainerStarted","Data":"0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5"} Oct 29 23:13:47.828776 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:47.828716 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-b8454765d-bk5jk" podStartSLOduration=1.3204804509999999 podStartE2EDuration="3.828702145s" totalImagesPullingTime="2.508221694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:47.828049186 +0000 UTC m=+61.083116576" watchObservedRunningTime="2026-10-29 23:13:47.828702145 +0000 UTC m=+61.083769520" Oct 29 23:13:53.077218 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.077173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:53.077218 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.077227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:53.102349 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.102318 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:53.102349 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.102330 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:53.110001 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.109971 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:53.110117 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.110076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:53.126000 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.125976 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\"" Oct 29 23:13:53.134015 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.133990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:53.178387 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.178349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:53.192938 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.192908 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:53.212121 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.212098 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:53.222480 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.222460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:53.420229 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.420196 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\"" Oct 29 23:13:53.422635 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.422604 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6s4mw"] Oct 29 23:13:53.426056 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:53.426028 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb4e993_6e54_4680_8e52_4988c38199f0.slice/crio-2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b WatchSource:0}: Error finding container 2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b: Status 404 returned error can't find the container with id 2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b Oct 29 23:13:53.426833 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.426815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:53.434638 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.434619 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\"" Oct 29 23:13:53.441716 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.441692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:53.733860 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.733768 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p7x9w"] Oct 29 23:13:53.737870 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:53.737839 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c91594d_41ac_4d03_a9cc_910cdc87c30f.slice/crio-5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54 WatchSource:0}: Error finding container 5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54: Status 404 returned error can't find the container with id 5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54 Oct 29 23:13:53.744714 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.744692 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7n6qd"] Oct 29 23:13:53.749253 ip-10-0-137-132 kubenswrapper[2576]: W1029 23:13:53.749227 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6660100_f2b0_46e1_bbd0_6566db43d9aa.slice/crio-3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06 WatchSource:0}: Error finding container 3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06: Status 404 returned error can't find the container with id 3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06 Oct 29 23:13:53.808588 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.808533 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7n6qd" event={"ID":"d6660100-f2b0-46e1-bbd0-6566db43d9aa","Type":"ContainerStarted","Data":"3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06"} Oct 29 23:13:53.809739 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.809704 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7x9w" event={"ID":"4c91594d-41ac-4d03-a9cc-910cdc87c30f","Type":"ContainerStarted","Data":"5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54"} Oct 29 23:13:53.810689 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:53.810667 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6s4mw" event={"ID":"ecb4e993-6e54-4680-8e52-4988c38199f0","Type":"ContainerStarted","Data":"2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b"} Oct 29 23:13:54.709519 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:54.709477 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:54.709989 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:54.709615 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:54.715895 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:54.715867 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:54.820456 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:54.820427 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:55.821675 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:55.821635 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7x9w" event={"ID":"4c91594d-41ac-4d03-a9cc-910cdc87c30f","Type":"ContainerStarted","Data":"a888b84d3ed028c7df6287fbd10b70da529919b7df629200092cd7469bf42e09"} Oct 29 23:13:55.822062 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:55.821690 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p7x9w" event={"ID":"4c91594d-41ac-4d03-a9cc-910cdc87c30f","Type":"ContainerStarted","Data":"e3cfa62752f72ea9cf2158ddddfc2d625d7764b68add9b6a2199353a6363821b"} Oct 29 23:13:55.864463 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:55.863057 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p7x9w" podStartSLOduration=67.804474176 podStartE2EDuration="1m8.863034595s" totalImagesPullingTime="1.058560419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:55.862753903 +0000 UTC m=+69.117821278" watchObservedRunningTime="2026-10-29 23:13:55.863034595 +0000 UTC m=+69.118101970" Oct 29 23:13:57.832573 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:57.832089 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7n6qd" event={"ID":"d6660100-f2b0-46e1-bbd0-6566db43d9aa","Type":"ContainerStarted","Data":"a10ba815bd23c0adf71fb39194a51a5e119fcb2b453d6eab988af1f805ad9ce8"} Oct 29 23:13:57.832573 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:57.832225 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:57.873697 ip-10-0-137-132 kubenswrapper[2576]: I1029 23:13:57.873630 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7n6qd" podStartSLOduration=67.749460876 podStartE2EDuration="1m10.873611808s" totalImagesPullingTime="3.124150932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:57.872654362 +0000 UTC m=+71.127721782" watchObservedRunningTime="2026-10-29 23:13:57.873611808 +0000 UTC m=+71.128679184" Oct 29 23:13:58.242170 ip-10-0-137-132 systemd[1]: Stopping Kubernetes Kubelet... Oct 29 23:13:58.262892 ip-10-0-137-132 systemd[1]: kubelet.service: Deactivated successfully. Oct 29 23:13:58.263066 ip-10-0-137-132 systemd[1]: Stopped Kubernetes Kubelet. Oct 29 23:13:58.263246 ip-10-0-137-132 systemd[1]: kubelet.service: Consumed 4.023s CPU time. Oct 29 23:13:58.277218 ip-10-0-137-132 systemd[1]: Starting Kubernetes Kubelet... Oct 29 23:13:58.340243 ip-10-0-137-132 kubenswrapper[5976]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:13:58.340243 ip-10-0-137-132 kubenswrapper[5976]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 29 23:13:58.340243 ip-10-0-137-132 kubenswrapper[5976]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:13:58.340243 ip-10-0-137-132 kubenswrapper[5976]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:13:58.342372 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342281 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.342372 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342372 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342377 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342383 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342387 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342390 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342393 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342400 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342403 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342407 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342409 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342412 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342414 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342417 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342419 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342422 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342425 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342427 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342430 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342433 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.342440 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342435 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342438 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342441 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342444 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342446 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342449 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342452 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342455 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342458 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342460 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342463 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342465 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342468 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342470 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342473 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342475 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342478 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342480 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342483 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342486 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.342927 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342489 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342492 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342494 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342497 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342499 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342501 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342504 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342507 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342509 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342512 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342514 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342518 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342520 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342523 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342525 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342528 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342530 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342533 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342536 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342539 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.343404 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342541 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342544 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342547 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342563 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342566 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342569 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342571 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342574 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342576 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342579 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342581 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342584 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342587 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342589 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342592 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342594 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342598 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342600 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342603 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.343929 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342605 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342610 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342614 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342618 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342622 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342625 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342627 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342630 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342632 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342635 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342637 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342640 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342643 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342645 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342648 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342650 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342653 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342655 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342658 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.344386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342660 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342664 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342667 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342670 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342672 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342675 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342677 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.342681 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343446 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343452 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343456 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343459 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343462 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343465 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343467 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343472 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343476 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343479 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343483 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.344888 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343486 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343489 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343492 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343494 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343497 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343499 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343502 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343505 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343507 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343510 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343513 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343516 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343518 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343521 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343523 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343526 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343529 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343531 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343534 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.345355 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343536 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343539 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343542 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343545 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343547 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343566 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343569 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343572 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343574 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343577 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343579 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343582 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343584 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343587 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343589 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343592 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343594 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343597 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343599 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343602 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.345916 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343604 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343607 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343610 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343613 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343615 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343619 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343622 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343625 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343628 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343634 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343636 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343639 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343641 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343643 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343646 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343650 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343653 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343656 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343659 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.346409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343661 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343664 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343666 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343669 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343671 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343673 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343677 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343679 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343686 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343689 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343691 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343693 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343696 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343698 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343701 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343704 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343706 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343709 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343712 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343716 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.346925 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343718 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343721 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343725 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343737 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343739 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343742 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343744 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343747 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343750 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343753 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343756 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343759 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343761 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343764 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343766 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343769 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.343771 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344287 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344292 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.347409 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344295 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344298 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344300 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344303 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344306 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344309 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344312 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344314 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344317 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344319 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344321 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344324 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344327 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344329 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344333 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344337 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344340 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344342 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344345 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344347 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.347896 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344350 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344352 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344358 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344361 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344363 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344366 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344368 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344371 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344373 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344376 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344379 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344381 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344383 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344386 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344388 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344391 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344393 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344396 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344399 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.348576 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344401 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344404 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344406 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344408 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344411 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344413 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344416 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344420 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344424 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344428 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344432 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344434 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344437 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344440 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344443 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344445 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344449 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344451 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344454 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.349389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344457 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344459 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344464 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344467 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344470 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344473 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344475 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344478 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344480 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344483 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344486 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344488 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344491 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344493 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344495 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344498 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344500 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344503 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344505 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.350269 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344507 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344512 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344516 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344518 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344521 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344523 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344525 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344528 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344531 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344533 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344536 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344539 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344541 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344544 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344546 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344563 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344566 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344569 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344571 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344575 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.351108 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344577 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344580 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344582 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344585 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344587 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344590 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.344592 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344684 5976 flags.go:64] FLAG: --address="0.0.0.0" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344691 5976 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344707 5976 flags.go:64] FLAG: --anonymous-auth="true" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344712 5976 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344717 5976 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344720 5976 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344728 5976 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344734 5976 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344737 5976 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344740 5976 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344743 5976 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344747 5976 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344750 5976 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344753 5976 flags.go:64] FLAG: --cgroup-root="" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344756 5976 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344759 5976 flags.go:64] FLAG: --client-ca-file="" Oct 29 23:13:58.352011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344762 5976 flags.go:64] FLAG: --cloud-provider="external" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344765 5976 flags.go:64] FLAG: --cluster-dns="[]" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344772 5976 flags.go:64] FLAG: --cluster-domain="" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344775 5976 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344778 5976 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344781 5976 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344785 5976 flags.go:64] FLAG: --container-log-max-files="5" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344789 5976 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344792 5976 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344796 5976 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344799 5976 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344802 5976 flags.go:64] FLAG: --contention-profiling="false" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344805 5976 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344808 5976 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344811 5976 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344814 5976 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344818 5976 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344821 5976 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344824 5976 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344827 5976 flags.go:64] FLAG: --enable-load-reader="false" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344830 5976 flags.go:64] FLAG: --enable-server="true" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344833 5976 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344840 5976 flags.go:64] FLAG: --event-burst="100" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344845 5976 flags.go:64] FLAG: --event-qps="50" Oct 29 23:13:58.352850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344848 5976 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344851 5976 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344854 5976 flags.go:64] FLAG: --eviction-hard="" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344859 5976 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344862 5976 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344865 5976 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344868 5976 flags.go:64] FLAG: --eviction-soft="" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344871 5976 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344874 5976 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344877 5976 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344881 5976 flags.go:64] FLAG: --experimental-mounter-path="" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344884 5976 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344887 5976 flags.go:64] FLAG: --fail-swap-on="true" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344890 5976 flags.go:64] FLAG: --feature-gates="" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344894 5976 flags.go:64] FLAG: --file-check-frequency="20s" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344897 5976 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344900 5976 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344903 5976 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344906 5976 flags.go:64] FLAG: --healthz-port="10248" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344909 5976 flags.go:64] FLAG: --help="false" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344912 5976 flags.go:64] FLAG: --hostname-override="ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344916 5976 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344918 5976 flags.go:64] FLAG: --http-check-frequency="20s" Oct 29 23:13:58.353800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344922 5976 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344925 5976 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344929 5976 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344931 5976 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344934 5976 flags.go:64] FLAG: --image-service-endpoint="" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344937 5976 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344940 5976 flags.go:64] FLAG: --kube-api-burst="100" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344944 5976 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344947 5976 flags.go:64] FLAG: --kube-api-qps="50" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344950 5976 flags.go:64] FLAG: --kube-reserved="" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344953 5976 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344956 5976 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344959 5976 flags.go:64] FLAG: --kubelet-cgroups="" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344961 5976 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344964 5976 flags.go:64] FLAG: --lock-file="" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344967 5976 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344970 5976 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344973 5976 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344978 5976 flags.go:64] FLAG: --log-json-split-stream="false" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344981 5976 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344984 5976 flags.go:64] FLAG: --log-text-split-stream="false" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344987 5976 flags.go:64] FLAG: --logging-format="text" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344990 5976 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344994 5976 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 29 23:13:58.354478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344996 5976 flags.go:64] FLAG: --manifest-url="" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.344999 5976 flags.go:64] FLAG: --manifest-url-header="" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345004 5976 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345007 5976 flags.go:64] FLAG: --max-open-files="1000000" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345011 5976 flags.go:64] FLAG: --max-pods="110" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345014 5976 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345017 5976 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345020 5976 flags.go:64] FLAG: --memory-manager-policy="None" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345022 5976 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345025 5976 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345028 5976 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345031 5976 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345039 5976 flags.go:64] FLAG: --node-status-max-images="50" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345042 5976 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345044 5976 flags.go:64] FLAG: --oom-score-adj="-999" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345048 5976 flags.go:64] FLAG: --pod-cidr="" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345051 5976 flags.go:64] FLAG: --pod-manifest-path="" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345054 5976 flags.go:64] FLAG: --pod-max-pids="-1" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345057 5976 flags.go:64] FLAG: --pods-per-core="0" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345060 5976 flags.go:64] FLAG: --port="10250" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345063 5976 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345066 5976 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e831c866f403e3a3" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345069 5976 flags.go:64] FLAG: --qos-reserved="" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345072 5976 flags.go:64] FLAG: --read-only-port="10255" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345075 5976 flags.go:64] FLAG: --register-node="true" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345078 5976 flags.go:64] FLAG: --register-with-taints="" Oct 29 23:13:58.355105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345082 5976 flags.go:64] FLAG: --registry-burst="10" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345085 5976 flags.go:64] FLAG: --registry-qps="5" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345088 5976 flags.go:64] FLAG: --reserved-cpus="" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345091 5976 flags.go:64] FLAG: --reserved-memory="" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345095 5976 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345098 5976 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345101 5976 flags.go:64] FLAG: --rotate-certificates="false" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345104 5976 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345107 5976 flags.go:64] FLAG: --runonce="false" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345110 5976 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345113 5976 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345115 5976 flags.go:64] FLAG: --seccomp-default="false" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345118 5976 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345121 5976 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345124 5976 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345127 5976 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345131 5976 flags.go:64] FLAG: --storage-driver-password="root" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345133 5976 flags.go:64] FLAG: --storage-driver-secure="false" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345136 5976 flags.go:64] FLAG: --storage-driver-table="stats" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345139 5976 flags.go:64] FLAG: --storage-driver-user="root" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345142 5976 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345145 5976 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345148 5976 flags.go:64] FLAG: --system-cgroups="" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345151 5976 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345156 5976 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 29 23:13:58.355835 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345158 5976 flags.go:64] FLAG: --tls-cert-file="" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345161 5976 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345165 5976 flags.go:64] FLAG: --tls-min-version="" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345168 5976 flags.go:64] FLAG: --tls-private-key-file="" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345171 5976 flags.go:64] FLAG: --topology-manager-policy="none" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345173 5976 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345176 5976 flags.go:64] FLAG: --topology-manager-scope="container" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345179 5976 flags.go:64] FLAG: --v="2" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345183 5976 flags.go:64] FLAG: --version="false" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345187 5976 flags.go:64] FLAG: --vmodule="" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345192 5976 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345195 5976 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345333 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345336 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345339 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345342 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345345 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345347 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345349 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345352 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345354 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345357 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.356454 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345360 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345362 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345365 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345368 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345371 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345374 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345376 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345379 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345383 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345386 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345389 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345392 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345395 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345397 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345400 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345402 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345405 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345407 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345410 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345413 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.357512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345415 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345418 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345423 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345426 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345428 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345432 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345435 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345438 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345442 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345444 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345447 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345449 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345452 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345454 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345457 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345459 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345462 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345464 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345467 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345469 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.358100 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345472 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345474 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345477 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345479 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345482 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345484 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345487 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345489 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345492 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345494 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345497 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345499 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345502 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345505 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345507 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345510 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345513 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345516 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345519 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345522 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.358664 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345526 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345528 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345531 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345533 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345536 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345538 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345541 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345543 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345546 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345562 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345565 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345568 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345571 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345573 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345576 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345579 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345581 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345584 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345586 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.359510 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345589 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345591 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345594 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345597 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345599 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345602 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345606 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345610 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345612 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345616 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345620 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345623 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345625 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345629 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345632 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345634 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.360343 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345637 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.345664 5976 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345701 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345706 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345709 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345711 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345714 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345718 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345720 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345723 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345725 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345728 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345731 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345734 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345736 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345739 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.360958 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345742 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345744 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345747 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345749 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345752 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345754 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345757 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345760 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345762 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345764 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345769 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345771 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345774 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345776 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345781 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345783 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345786 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345789 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345791 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345794 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.361450 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345796 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345799 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345801 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345804 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345806 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345809 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345812 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345814 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345817 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345819 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345823 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345827 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345830 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345833 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345835 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345838 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345840 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345843 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345845 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.361989 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345848 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345850 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345852 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345856 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345859 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345862 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345864 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345868 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345871 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345874 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345877 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345880 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345882 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345885 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345887 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345890 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345893 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345895 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345898 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345900 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.362508 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345904 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345907 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345910 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345913 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345915 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345918 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345922 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345925 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345927 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345930 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345933 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345936 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345938 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345941 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345943 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345947 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345950 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345952 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345955 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345958 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.363046 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345961 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345964 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345966 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345969 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345971 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345974 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345976 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345979 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345982 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345984 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345986 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345990 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.345993 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.350779 5976 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.350799 5976 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.350824 5976 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.350832 5976 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350924 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350932 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.363531 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350938 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350943 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350947 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350951 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350956 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350960 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350965 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350969 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350973 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350977 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350983 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350988 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350992 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.350997 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351001 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351006 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351010 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351015 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351019 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351023 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.364011 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351027 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351032 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351037 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351041 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351046 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351050 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351054 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351059 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351063 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351067 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351072 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351077 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351081 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351085 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351090 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351094 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351098 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351102 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351106 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.364526 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351111 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351115 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351120 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351123 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351130 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351134 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351138 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351143 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351147 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351151 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351156 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351161 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351165 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351170 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351175 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351179 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351184 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351188 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351192 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351197 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.365017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351201 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351206 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351210 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351216 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351222 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351228 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351233 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351237 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351242 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351246 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351250 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351254 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351259 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351263 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351267 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351272 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351276 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351281 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351286 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.365502 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351290 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351294 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351299 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351303 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351307 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351312 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351317 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351321 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351326 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351330 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351335 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351339 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351343 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351347 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351352 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351356 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351360 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351367 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351373 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.366017 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351378 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351383 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351388 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351392 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351396 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351400 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351405 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.351448 5976 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351725 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351745 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351750 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351755 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351761 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351765 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351769 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351774 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.366475 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351778 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351782 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351786 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351791 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351795 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351820 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351828 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351833 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351839 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351843 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351848 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351852 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351857 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351863 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351867 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351871 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351875 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351880 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351884 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351888 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.366917 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351893 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351897 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351901 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351906 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351910 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351915 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351919 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351923 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351928 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351933 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351938 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351942 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351948 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351954 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351958 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351963 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351967 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351971 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351976 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351981 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.367387 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351985 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351990 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351994 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.351999 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352004 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352008 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352012 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352016 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352020 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352024 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352028 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352032 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352036 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352040 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352045 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352049 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352054 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352058 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352063 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352067 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.367926 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352071 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352075 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352080 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352085 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352091 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352097 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352101 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352106 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352110 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352115 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352120 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352124 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352133 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352138 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352142 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352147 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352151 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352156 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352160 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.368399 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352164 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352169 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352173 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352177 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352181 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352186 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352190 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352194 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352199 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352203 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352207 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352211 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352216 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352221 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352225 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352230 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352235 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352240 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.368937 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352243 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.352289 5976 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.352627 5976 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353022 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353031 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353037 5976 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353043 5976 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353048 5976 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353053 5976 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353058 5976 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353070 5976 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353074 5976 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353078 5976 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353083 5976 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353088 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353092 5976 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:13:58.369359 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353097 5976 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353101 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353106 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353110 5976 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353115 5976 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353119 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353128 5976 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353133 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353137 5976 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353142 5976 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353148 5976 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353155 5976 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353161 5976 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353165 5976 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353170 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353177 5976 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353181 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353186 5976 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353190 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:13:58.369968 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353201 5976 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353205 5976 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353209 5976 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353214 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353218 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353223 5976 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353228 5976 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353232 5976 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353237 5976 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353242 5976 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353247 5976 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353251 5976 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353256 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353265 5976 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353270 5976 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353274 5976 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353279 5976 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353284 5976 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353291 5976 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:13:58.370696 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353295 5976 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353299 5976 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353304 5976 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353308 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353313 5976 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353317 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353328 5976 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353332 5976 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353336 5976 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353341 5976 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353346 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353351 5976 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353356 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353360 5976 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353365 5976 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353369 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353374 5976 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353378 5976 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353387 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353392 5976 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:13:58.371357 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353397 5976 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353401 5976 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353405 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353409 5976 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353415 5976 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353419 5976 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353424 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353429 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353433 5976 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353438 5976 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353442 5976 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353452 5976 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353457 5976 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353461 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353466 5976 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353470 5976 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353475 5976 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353479 5976 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353484 5976 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353488 5976 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:13:58.372159 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353492 5976 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353496 5976 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353501 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353507 5976 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353516 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353521 5976 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353528 5976 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353535 5976 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353540 5976 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353545 5976 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353572 5976 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353578 5976 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353583 5976 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:13:58.353590 5976 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.353906 5976 server.go:957] "Client rotation is on, will bootstrap in background" Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.354951 5976 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.355014 5976 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.355196 5976 server.go:1014] "Starting client certificate rotation" Oct 29 23:13:58.372752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.355349 5976 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.355396 5976 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:47 +0000 UTC" deadline="2028-04-19 07:56:32.943529023 +0000 UTC" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.355432 5976 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12896h42m34.58810024s" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.355816 5976 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.356946 5976 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.358189 5976 log.go:25] "Validated CRI v1 runtime API" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.360456 5976 log.go:25] "Validated CRI v1 image API" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.361229 5976 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 29 23:13:58.373242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.363193 5976 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bebaffc7-5713-4b1d-a5a6-cd7c74a3f56c:/dev/nvme0n1p3 d0289357-131c-4e73-b19b-783510a53e8b:/dev/nvme0n1p4] Oct 29 23:13:58.373463 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.363215 5976 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6/userdata/shm major:0 minor:319 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd/userdata/shm major:0 minor:297 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214/userdata/shm major:0 minor:347 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9/userdata/shm major:0 minor:252 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b/userdata/shm major:0 minor:359 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06/userdata/shm major:0 minor:366 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54/userdata/shm major:0 minor:364 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7/userdata/shm major:0 minor:203 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volumes/kubernetes.io~projected/kube-api-access-nm5wf:{mountpoint:/var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volumes/kubernetes.io~projected/kube-api-access-nm5wf major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24ca50cb-c977-4fbd-848f-c4ff5f7be381/volumes/kubernetes.io~projected/kube-api-access-7sdz7:{mountpoint:/var/lib/kubelet/pods/24ca50cb-c977-4fbd-848f-c4ff5f7be381/volumes/kubernetes.io~projected/kube-api-access-7sdz7 major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/24ca50cb-c977-4fbd-848f-c4ff5f7be381/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/24ca50cb-c977-4fbd-848f-c4ff5f7be381/volumes/kubernetes.io~secret/metrics-tls major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17/volumes/kubernetes.io~projected/kube-api-access-z9snd:{mountpoint:/var/lib/kubelet/pods/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17/volumes/kubernetes.io~projected/kube-api-access-z9snd major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~empty-dir/tmp major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~projected/kube-api-access-tp9c8:{mountpoint:/var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~projected/kube-api-access-tp9c8 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c91594d-41ac-4d03-a9cc-910cdc87c30f/volumes/kubernetes.io~projected/kube-api-access-bzgd7:{mountpoint:/var/lib/kubelet/pods/4c91594d-41ac-4d03-a9cc-910cdc87c30f/volumes/kubernetes.io~projected/kube-api-access-bzgd7 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4c91594d-41ac-4d03-a9cc-910cdc87c30f/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/4c91594d-41ac-4d03-a9cc-910cdc87c30f/volumes/kubernetes.io~secret/metrics-certs major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4cabad06-e774-45b2-ae79-fbe2a70e413f/volumes/kubernetes.io~projected/kube-api-access-jtjv2:{mountpoint:/var/lib/kubelet/pods/4cabad06-e774-45b2-ae79-fbe2a70e413f/volumes/kubernetes.io~projected/kube-api-access-jtjv2 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39/volumes/kubernetes.io~projected/kube-api-access-fmn4k:{mountpoint:/var/lib/kubelet/pods/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39/volumes/kubernetes.io~projected/kube-api-access-fmn4k major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~projected/kube-api-access-ttrjk:{mountpoint:/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~projected/kube-api-access-ttrjk major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~projected/kube-api-access-r2dt8:{mountpoint:/var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~projected/kube-api-access-r2dt8 major:0 minor:244 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:242 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/92eceb2e-00de-4593-84de-6e5878c81f4e/volumes/kubernetes.io~projected/kube-api-access-jz8xl:{mountpoint:/var/lib/kubelet/pods/92eceb2e-00de-4593-84de-6e5878c81f4e/volumes/kubernetes.io~projected/kube-api-access-jz8xl major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/959a0d7f-8036-42ad-bacd-bdeb7da391ec/volumes/kubernetes.io~projected/kube-api-access-tlxql:{mountpoint:/var/lib/kubelet/pods/959a0d7f-8036-42ad-bacd-bdeb7da391ec/volumes/kubernetes.io~projected/kube-api-access-tlxql major:0 minor:318 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/959a0d7f-8036-42ad-bacd-bdeb7da391ec/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/959a0d7f-8036-42ad-bacd-bdeb7da391ec/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9c2205ed-fff4-48e9-9461-c085df16e0ba/volumes/kubernetes.io~projected/kube-api-access-m6xc8:{mountpoint:/var/lib/kubelet/pods/9c2205ed-fff4-48e9-9461-c085df16e0ba/volumes/kubernetes.io~projected/kube-api-access-m6xc8 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9c2205ed-fff4-48e9-9461-c085df16e0ba/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/9c2205ed-fff4-48e9-9461-c085df16e0ba/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/afd5d371-4d02-428a-878a-f2b78f7f8e6c/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/afd5d371-4d02-428a-878a-f2b78f7f8e6c/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/be5750a5-cb62-4414-a5b7-273edc9e9c1e/volumes/kubernetes.io~projected/kube-api-access-js8zk:{mountpoint:/var/lib/kubelet/pods/be5750a5-cb62-4414-a5b7-273edc9e9c1e/volumes/kubernetes.io~projected/kube-api-access-js8zk major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6660100-f2b0-46e1-bbd0-6566db43d9aa/volumes/kubernetes.io~projected/kube-api-access-frlwb:{mountpoint:/var/lib/kubelet/pods/d6660100-f2b0-46e1-bbd0-6566db43d9aa/volumes/kubernetes.io~projected/kube-api-access-frlwb major:0 minor:361 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e743b094-7e5d-496c-a8fd-5f2b801b4cee/volumes/kubernetes.io~projected/kube-api-access-cg2wm:{mountpoint:/var/lib/kubelet/pods/e743b094-7e5d-496c-a8fd-5f2b801b4cee/volumes/kubernetes.io~projected/kube-api-access-cg2wm major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9adb857-fd51-4830-b99c-2a0d1a1ffeea/volumes/kubernetes.io~projected/kube-api-access-dzqnc:{mountpoint:/var/lib/kubelet/pods/e9adb857-fd51-4830-b99c-2a0d1a1ffeea/volumes/kubernetes.io~projected/kube-api-access-dzqnc major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~projected/kube-api-access-wn4c4:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~projected/kube-api-access-wn4c4 major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:292 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ecb4e993-6e54-4680-8e52-4988c38199f0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/ecb4e993-6e54-4680-8e52-4988c38199f0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:353 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~projected/kube-api-access-rc7zk:{mountpoint:/var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~projected/kube-api-access-rc7zk major:0 minor:249 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:248 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/5a0896368dfa6f59ebae04edf36661795728073bc6343240df529a53e91a9713/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/9383ca09b41d1d7843251bdb80326ceae730b8adce0b6b802a5d07aaffc86622/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/5924931062fd12668548030466670cc14d258085dd0ea05c8af125409f006227/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/483dcdfe32a7aed303f591a52fb1cc9d15eace3aaf87cb51e3fb41a366c1acbb/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/2eaafb6fc8c8f883d7d8edbe93a0143614b1fc929b8385037298512d3c5fd2d6/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/f930424e48a213f55cfc25513d704414fcc047b17cdaa959cb735e43579ac9b5/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/c568852f85691264e9b13cbcc70d60baef0360f476dcc8e6d457586201a4f4c1/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/e614943393228418ce90d5258bc28ce29866242d3cc6aa319579c992055baf4e/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/3e34e7566c2be59b21b6b54a339b3cb512fbe1f762412e13834c10e5d39adc4c/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/3934f4228e538b4bbe99e71fedaf95e6feabb05b90642f0bb704d7666886400b/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/199bf455352043469e3b254a8ff62f39b651897898351f0416efac8a880f1ced/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/1d9f9240219f7e21a1266a4dc0b8d009b67131447b9763c7b4da1d7fe6b09bcf/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/2e5de5d93524b9ea9e2a80c3c357700598acc8e77cdefea56844d0467130592d/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-159:{mountpoint:/var/lib/containers/storage/overlay/75a94fa6d6554b6b7cc19ec9074074bafeba8eb35edff3ab2c20f6b138c736e9/merged major:0 minor:159 fsType:overlay blockSize:0} overlay_0-160:{mountpoint:/var/lib/containers/storage/overlay/ca7615364edd33aa78780d47ebd6b5e5403d49a239fb20c1acba099b2a3f5609/merged major:0 minor:160 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/adfc34b9df01a3a91d13a582f8db4002ddb2b4655c32292db07b07149c89cf37/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/9d30c7ab594794489b6053c38cf9dc1c3bf03c476c68722fcf7cbe57962aed46/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/982a514bf8dbb2fb4d99cf84a7bbe67f86583582e88d4765bd9bb29178f7fc06/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/72c8844234b57d6b586d633f7870b2ea4429122abcf160f3d35e9c27e9805eed/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/8a34074081cfaec0ff4678c4fb487346e762b0a92a9c18b77d689655a4200e9e/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/0edd3723dcf3877eced4ef35e0b86a1fb44cbb2e41e293794d85539cbaf47d88/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/1328a0d05b4fd2b6e1a2d048a700aa31ccf6685cec74a4ed904b18fd07214396/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/1fcb3efeca1d097d035c201743033be5bab9d40a0de933da5e7de55abcd866bf/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/dcfd27a21d530db8b5aaeccbd0aefc4bfb959110d26631b729fc1b37fcc4083d/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/2218e5e1887332bcb831f3b9a65c2ce305522b06cf34d881af6c79225f72100b/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-222:{mountpoint:/var/lib/containers/storage/overlay/e0cbc435869fb77422395122c98c1fb562e0bee6121569fb624fc245a8cbab8e/merged major:0 minor:222 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/219ef06fc578585aea14e393d77023dd0cedd1a2cb2ce35bf3a338fdef3bab7d/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/f449a506829381cbe9f81be2efc8525c9d17dd9010d4e3ba1758e849eafa18ca/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-236:{mountpoint:/var/lib/containers/storage/overlay/54dab14cfef0046b4a9cdde611315ffd49be0351dfa23de68b205fc0173fb9f1/merged major:0 minor:236 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/0787b5dc27d0e00f7f37f3cd9eb2103b5f0e8ffa8b825231b5121a5f69cd1937/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/eac22e8e0805e7942a3e8437356286c5f2cd300fb3d2bb5d6ca59e198ccd22c4/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/2ea98c7e708588cab557954842dfeefc9246f061cdcee626a32ef800c9133eee/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/be3b735f2b874d006b725515a00ba376d6fda2409f1d5dd6361c147927ffcc38/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/75749fdcf0ec685502344ccb575df37cac359f83c349dda3d2a55a0a67bd2def/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/5518b91be63630ecfce36d3a00bfa74ecc8692057ffc8d752946685651662c99/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/97d36adc50acc67d9619afee9f09130529b992a73d984ad2b23e97636816ca17/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/90f767d153cf935e6ad317eccdeef0779c03c0f7c74728a2d6b56f4c993c7d13/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-299:{mountpoint:/var/lib/containers/storage/overlay/21a9168b82e70b7bff6a6d7817e3ac15eba55bedaeedd1a2f2c3e8f065b9c2be/merged major:0 minor:299 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/ade71d04372de02989fb56a2857a09c822ce6f5e298aa06b72e43152bf7bc8d0/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/52e3804b5b52427258b6cad1641ea8ac3a829883ed76d6008de77a1ba2a52a57/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-309:{mountpoint:/var/lib/containers/storage/overlay/4120e31b77e807e7174efc49fd2f55afa4be0f0195ff7c1271fc47fa87bc4b06/merged major:0 minor:309 fsType:overlay blockSize:0} overlay_0-321:{mountpoint:/var/lib/containers/storage/overlay/51b3c7f3ee2f5dfd0c451bc0b9ba560b2e8fd51900679b2d0e9af65c5bb5bea1/merged major:0 minor:321 fsType:overlay blockSize:0} overlay_0-323:{mountpoint:/var/lib/containers/storage/overlay/cf492bb0f32daef08f5c59e57535046d321d2c4420ea67a72ebec4676f86388d/merged major:0 minor:323 fsType:overlay blockSize:0} overlay_0-324:{mountpoint:/var/lib/containers/storage/overlay/dd09a39c321ae1e819ce9f22b7ad052201c4c0cb1131fab184ad657a0e6cd31f/merged major:0 minor:324 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/95cc01cf6da64819c310061dadacf912cc6bd040bcce02b960c725aebdf3c3b2/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-335:{mountpoint:/var/lib/containers/storage/overlay/a3f169b8c7ff04e8bdb1f47640d85d7d34cf7126bbf33a31cbd70e9b4afa67ed/merged major:0 minor:335 fsType:overlay blockSize:0} overlay_0-349:{mountpoint:/var/lib/containers/storage/overlay/66197abeb28e9b22cafdd09531ad6167c9e8f88705dc686a80bf62b0a946ac77/merged major:0 minor:349 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/a762a697a4f92054769b07333596611ef98a5ab3997405a2349ff49e602a5261/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/d2002264d39ac5bff4f3da860ef8e071786347e8ee4f4a9621f8ea9f3cbca026/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/7a6f854249dfbf36a2096bab56d98189da73c4470bce3d42bad2cefb7d0d0fed/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-370:{mountpoint:/var/lib/containers/storage/overlay/ca7dcca60c6e25bdcb5779254829fc8272a1726c0b5d69f469324dc3b7530e02/merged major:0 minor:370 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/78d842e873f2780d31bb62a3fbbf38828256783e995a28fca42acd6e606cd074/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/ede8e6a78fb72d889e1963926aef7cf66782af92a75a00fdf162bdef912aa34b/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/2f6ce23a04e1384a30a0b6273e681eed505c96bd61a9407d6b144a0a53dc6ba7/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/639422b0f87ed2e8068da68450fc3e5fd59cedd3af7c809f771febe446243769/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/aca898a8c85921cbadf91b38ec273a4f06e791ce85466f912ae5726cf45872af/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/fb8a7cc914fd23495fcc23d3fbea1c0fe606fdda4c2681a88d13207ab6400e2f/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/208af07f1d8eed6390b660f60c0a6547416cdea49f6bf3410390294c74a705a0/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/359e69c9502a1374896cfa8032281bd64b1a9525fd3eea0b0acba9b938ca1a43/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/1e27b9514d03fb5faff14e0e8f666330983d4c75021f924ec2c052c9072ef1c8/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/fc95567fb08fb9d22f18916022ad4afb63771edc27aae0dd2ef31d7aeccfece9/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/f0e73657197ad68379182c6b0a808dab39a3d0ab240d8c7cd200b40cf2f4a0bf/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/dbca4a990700731df276d3e9b1e22eb327dc76b490e4a2b50f628cf0e3493e18/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/78d4ad89c29bd8f49312bfff520ca54cb903f1474e51559d239bdf0eb705189b/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/5362f6e9e359a28ea30124dac7b93da5fe6180da4e2df5475e5515589eab4e9a/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.370368 5976 manager.go:217] Machine: {Timestamp:2026-10-29 23:13:58.369748544 +0000 UTC m=+0.060401842 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099634 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21079c7601fc049f45b5b0ea7b2eb0 SystemUUID:ec21079c-7601-fc04-9f45-b5b0ea7b2eb0 BootID:36fa91d4-887a-4e40-83e0-f2692d89c13d Filesystems:[{Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:294 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/959a0d7f-8036-42ad-bacd-bdeb7da391ec/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/4cabad06-e774-45b2-ae79-fbe2a70e413f/volumes/kubernetes.io~projected/kube-api-access-jtjv2 DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c96e38217e3f7402629f78b60bfe4ed3826418e7001e3cfbdedb1a00d53417b6/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9c2205ed-fff4-48e9-9461-c085df16e0ba/volumes/kubernetes.io~projected/kube-api-access-m6xc8 DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:291 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39/volumes/kubernetes.io~projected/kube-api-access-fmn4k DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/24ca50cb-c977-4fbd-848f-c4ff5f7be381/volumes/kubernetes.io~projected/kube-api-access-7sdz7 DeviceMajor:0 DeviceMinor:208 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:243 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:340 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-349 DeviceMajor:0 DeviceMinor:349 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/afd5d371-4d02-428a-878a-f2b78f7f8e6c/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-323 DeviceMajor:0 DeviceMinor:323 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-335 DeviceMajor:0 DeviceMinor:335 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c91594d-41ac-4d03-a9cc-910cdc87c30f/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:358 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4676bb100f4bae665c71469a68a63a20c6b645f1049d0a4e7ce864b10587eaff/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ba136554f2c7da0b005792efaaeeb290519425a72a768c1ef6dcc45c195340e1/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0aa3068901da85048054dec072e7633441e4c9d4a7ddcfddd9f67db3b92af6f6/userdata/shm DeviceMajor:0 DeviceMinor:319 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~projected/kube-api-access-ttrjk DeviceMajor:0 DeviceMinor:346 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d330bbcb55d4ec2ca27a47a87aca13f02584c76ec50a7a63adfc8d0c5ef26aee/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-299 DeviceMajor:0 DeviceMinor:299 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:295 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:296 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-321 DeviceMajor:0 DeviceMinor:321 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5b5c5dde2539c62ae612dd22cd0480b37c1a493346d2d1f1ea6a2a7312f37f54/userdata/shm DeviceMajor:0 DeviceMinor:364 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7fd5b248c6ea8d8a16a9510d63e31ff2180267e750349eb3ea7afa48de6413a7/userdata/shm DeviceMajor:0 DeviceMinor:203 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volumes/kubernetes.io~projected/kube-api-access-nm5wf DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~projected/kube-api-access-tp9c8 DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9ad261c2646072b2283f4ab06efc91d84770988e6bf9d9c1f42c3f8af1e8a7ac/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:242 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/be5750a5-cb62-4414-a5b7-273edc9e9c1e/volumes/kubernetes.io~projected/kube-api-access-js8zk DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e743b094-7e5d-496c-a8fd-5f2b801b4cee/volumes/kubernetes.io~projected/kube-api-access-cg2wm DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/251760404b7f048f0940603d50bccdbb0f808b71af943e9adb622ae623e1d715/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c28d43e1ea81e05c96852649a7e5458502d73d5ccd5aa6b1b5b671e57fd3e69/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-222 DeviceMajor:0 DeviceMinor:222 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214/userdata/shm DeviceMajor:0 DeviceMinor:347 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-160 DeviceMajor:0 DeviceMinor:160 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e7a99318e42d783e0c98c590fa682d62d7d2b64ba6487089a567f7552c21b8fb/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:345 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d6660100-f2b0-46e1-bbd0-6566db43d9aa/volumes/kubernetes.io~projected/kube-api-access-frlwb DeviceMajor:0 DeviceMinor:361 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9c2205ed-fff4-48e9-9461-c085df16e0ba/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffce1395e8ad24a06a4a6297ed117fc13f713d6759c4d9b2a8aa337b85eb0bdb/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:248 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/164322e0-a486-4897-9da0-a8bb7a6244fb/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:292 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~projected/kube-api-access-wn4c4 DeviceMajor:0 DeviceMinor:287 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~projected/kube-api-access-r2dt8 DeviceMajor:0 DeviceMinor:244 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/959a0d7f-8036-42ad-bacd-bdeb7da391ec/volumes/kubernetes.io~projected/kube-api-access-tlxql DeviceMajor:0 DeviceMinor:318 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-324 DeviceMajor:0 DeviceMinor:324 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:293 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3874f15183965a071ffbd0192c566a1fd11df3f0159708759d07fc19efcb4d06/userdata/shm DeviceMajor:0 DeviceMinor:366 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-309 DeviceMajor:0 DeviceMinor:309 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-159 DeviceMajor:0 DeviceMinor:159 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4c91594d-41ac-4d03-a9cc-910cdc87c30f/volumes/kubernetes.io~projected/kube-api-access-bzgd7 DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/24ca50cb-c977-4fbd-848f-c4ff5f7be381/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:207 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-236 DeviceMajor:0 DeviceMinor:236 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-370 DeviceMajor:0 DeviceMinor:370 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/92eceb2e-00de-4593-84de-6e5878c81f4e/volumes/kubernetes.io~projected/kube-api-access-jz8xl DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fb861dea9402029a5f01bef7b03d7e51f66357774a713598326beb6b8a0d7ea2/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6dab03a0-efe3-4b27-b982-66628c8dc8a1/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:241 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2c54427e2c700f25e6f278cc8802777735cd68aa1de2de8e53b567c44361d68b/userdata/shm DeviceMajor:0 DeviceMinor:359 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/27bd6aea5e0c94f21d315b8640e3afeb813454d2aba8d6d2fea1a65c92882eb9/userdata/shm DeviceMajor:0 DeviceMinor:252 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0f7ad209236d71c68e05403483d919772732be32cddbc64b3eb71c0eb19d48fd/userdata/shm DeviceMajor:0 DeviceMinor:297 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17/volumes/kubernetes.io~projected/kube-api-access-z9snd DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/28dfeb0347d0e2cb30956fc7e83d5534e37e7cd2e55548b7555cb07bdb6bfc18/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ecb4e993-6e54-4680-8e52-4988c38199f0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:353 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e9adb857-fd51-4830-b99c-2a0d1a1ffeea/volumes/kubernetes.io~projected/kube-api-access-dzqnc DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/fa38333f-05b6-4cac-bddf-9bc834ef25f8/volumes/kubernetes.io~projected/kube-api-access-rc7zk DeviceMajor:0 DeviceMinor:249 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0aa3068901da850 MacAddress:76:aa:83:f3:25:b6 Speed:10000 Mtu:8901} {Name:0f7ad209236d71c MacAddress:36:02:d5:f6:c0:83 Speed:10000 Mtu:8901} {Name:15fa8f73ac72322 MacAddress:1a:73:c0:39:58:42 Speed:10000 Mtu:8901} {Name:2c54427e2c700f2 MacAddress:b6:42:da:9f:53:58 Speed:10000 Mtu:8901} {Name:3874f15183965a0 MacAddress:3a:7b:52:a8:a9:55 Speed:10000 Mtu:8901} {Name:5b5c5dde2539c62 MacAddress:6a:ed:d1:4a:96:b6 Speed:10000 Mtu:8901} {Name:7fd5b248c6ea8d8 MacAddress:0a:9b:71:0f:a5:f0 Speed:10000 Mtu:8901} {Name:9ad261c2646072b MacAddress:0a:23:bf:3b:64:f5 Speed:10000 Mtu:8901} {Name:ba136554f2c7da0 MacAddress:1a:c6:c8:98:0a:0f Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f8:fe:b9:99 Speed:0 Mtu:9001} {Name:br-int MacAddress:56:9b:0d:4e:26:f9 Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:ff:f8:fe:b9:99 Speed:0 Mtu:9001} {Name:ffce1395e8ad24a MacAddress:a2:52:31:c7:d5:99 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:32:38:7c:4b:58:e9 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:12:39:b4:07:9c:ae Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371070 5976 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371141 5976 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371492 5976 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371534 5976 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371879 5976 topology_manager.go:143] "Creating topology manager with none policy" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371889 5976 container_manager_linux.go:311] "Creating device plugin manager" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371909 5976 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.371935 5976 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372053 5976 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372517 5976 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372671 5976 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372709 5976 kubelet.go:493] "Attempting to sync node with API server" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372724 5976 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372734 5976 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372743 5976 kubelet.go:405] "Adding apiserver pod source" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.372752 5976 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.373353 5976 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 29 23:13:58.373770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.373363 5976 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:13:58.374981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.373825 5976 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 29 23:13:58.376706 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.376689 5976 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 29 23:13:58.376706 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.376704 5976 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:13:58.376868 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.376824 5976 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 29 23:13:58.377075 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377058 5976 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 29 23:13:58.377142 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377099 5976 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 29 23:13:58.377223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377212 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 29 23:13:58.377276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377231 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 29 23:13:58.377276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377243 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 29 23:13:58.377276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377253 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 29 23:13:58.377276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377262 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 29 23:13:58.377276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377272 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377282 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377292 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377302 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377311 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377325 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377341 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377390 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 29 23:13:58.377509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.377401 5976 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 29 23:13:58.380949 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.380933 5976 server.go:1263] "Started kubelet" Oct 29 23:13:58.381045 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.380998 5976 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 29 23:13:58.381858 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.381023 5976 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 29 23:13:58.381625 ip-10-0-137-132 systemd[1]: Started Kubernetes Kubelet. Oct 29 23:13:58.382300 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.382203 5976 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 29 23:13:58.382396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.382361 5976 server.go:317] "Adding debug handlers to kubelet server" Oct 29 23:13:58.382757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.382710 5976 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 29 23:13:58.386186 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386167 5976 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 29 23:13:58.386385 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386314 5976 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 29 23:13:58.386506 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386465 5976 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:49 +0000 UTC" deadline="2028-04-28 20:58:18.268913808 +0000 UTC" Oct 29 23:13:58.386592 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386508 5976 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h44m19.882410141s" Oct 29 23:13:58.386661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386653 5976 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 29 23:13:58.386661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386661 5976 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 29 23:13:58.386783 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.386771 5976 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 29 23:13:58.387702 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.387680 5976 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-137-132.ec2.internal\" not found" Oct 29 23:13:58.388282 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.388242 5976 factory.go:55] Registering systemd factory Oct 29 23:13:58.390039 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.389837 5976 factory.go:223] Registration of the systemd container factory successfully Oct 29 23:13:58.390653 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.390570 5976 factory.go:153] Registering CRI-O factory Oct 29 23:13:58.390653 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.390588 5976 factory.go:223] Registration of the crio container factory successfully Oct 29 23:13:58.390802 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.390656 5976 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 29 23:13:58.390802 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.390688 5976 factory.go:103] Registering Raw factory Oct 29 23:13:58.390802 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.390706 5976 manager.go:1199] Started watching for new ooms in manager Oct 29 23:13:58.391133 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391111 5976 manager.go:319] Starting recovery of all containers Oct 29 23:13:58.391289 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391254 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c91594d-41ac-4d03-a9cc-910cdc87c30f" volumeName="kubernetes.io/projected/4c91594d-41ac-4d03-a9cc-910cdc87c30f-kube-api-access-bzgd7" seLinuxMountContext="" Oct 29 23:13:58.391289 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391286 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e743b094-7e5d-496c-a8fd-5f2b801b4cee" volumeName="kubernetes.io/projected/e743b094-7e5d-496c-a8fd-5f2b801b4cee-kube-api-access-cg2wm" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391299 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9adb857-fd51-4830-b99c-2a0d1a1ffeea" volumeName="kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cni-binary-copy" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391309 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9adb857-fd51-4830-b99c-2a0d1a1ffeea" volumeName="kubernetes.io/projected/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-kube-api-access-dzqnc" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391319 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391328 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa38333f-05b6-4cac-bddf-9bc834ef25f8" volumeName="kubernetes.io/empty-dir/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-textfile" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391337 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa38333f-05b6-4cac-bddf-9bc834ef25f8" volumeName="kubernetes.io/projected/fa38333f-05b6-4cac-bddf-9bc834ef25f8-kube-api-access-rc7zk" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391346 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="164322e0-a486-4897-9da0-a8bb7a6244fb" volumeName="kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-env-overrides" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391357 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24ca50cb-c977-4fbd-848f-c4ff5f7be381" volumeName="kubernetes.io/empty-dir/24ca50cb-c977-4fbd-848f-c4ff5f7be381-tmp-dir" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391367 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4cabad06-e774-45b2-ae79-fbe2a70e413f" volumeName="kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-binary-copy" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391376 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-grpc-tls" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391386 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa38333f-05b6-4cac-bddf-9bc834ef25f8" volumeName="kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-tls" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391393 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b62b29d-bf73-44c3-9d91-7c7d3de6ab39" volumeName="kubernetes.io/configmap/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391402 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391415 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dab03a0-efe3-4b27-b982-66628c8dc8a1" volumeName="kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391422 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92eceb2e-00de-4593-84de-6e5878c81f4e" volumeName="kubernetes.io/projected/92eceb2e-00de-4593-84de-6e5878c81f4e-kube-api-access-jz8xl" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391435 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa38333f-05b6-4cac-bddf-9bc834ef25f8" volumeName="kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391445 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391453 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391460 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dab03a0-efe3-4b27-b982-66628c8dc8a1" volumeName="kubernetes.io/empty-dir/6dab03a0-efe3-4b27-b982-66628c8dc8a1-volume-directive-shadow" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391469 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afd5d371-4d02-428a-878a-f2b78f7f8e6c" volumeName="kubernetes.io/secret/afd5d371-4d02-428a-878a-f2b78f7f8e6c-agent-certs" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391478 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="164322e0-a486-4897-9da0-a8bb7a6244fb" volumeName="kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-config" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391492 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24ca50cb-c977-4fbd-848f-c4ff5f7be381" volumeName="kubernetes.io/projected/24ca50cb-c977-4fbd-848f-c4ff5f7be381-kube-api-access-7sdz7" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391500 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4cabad06-e774-45b2-ae79-fbe2a70e413f" volumeName="kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-sysctl-allowlist" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391507 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dab03a0-efe3-4b27-b982-66628c8dc8a1" volumeName="kubernetes.io/projected/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-api-access-r2dt8" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391514 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9c2205ed-fff4-48e9-9461-c085df16e0ba" volumeName="kubernetes.io/projected/9c2205ed-fff4-48e9-9461-c085df16e0ba-kube-api-access-m6xc8" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391522 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9adb857-fd51-4830-b99c-2a0d1a1ffeea" volumeName="kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-daemon-config" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391528 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="959a0d7f-8036-42ad-bacd-bdeb7da391ec" volumeName="kubernetes.io/secret/959a0d7f-8036-42ad-bacd-bdeb7da391ec-monitoring-plugin-cert" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391541 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9c2205ed-fff4-48e9-9461-c085df16e0ba" volumeName="kubernetes.io/secret/9c2205ed-fff4-48e9-9461-c085df16e0ba-cert" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391580 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3b17fd4e-b2fa-46a8-af6b-a59f4fafda17" volumeName="kubernetes.io/projected/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kube-api-access-z9snd" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391591 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c91594d-41ac-4d03-a9cc-910cdc87c30f" volumeName="kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391600 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4cabad06-e774-45b2-ae79-fbe2a70e413f" volumeName="kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391610 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b62b29d-bf73-44c3-9d91-7c7d3de6ab39" volumeName="kubernetes.io/empty-dir/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-data-volume" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391618 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b62b29d-bf73-44c3-9d91-7c7d3de6ab39" volumeName="kubernetes.io/projected/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-api-access-fmn4k" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391628 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391647 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="164322e0-a486-4897-9da0-a8bb7a6244fb" volumeName="kubernetes.io/projected/164322e0-a486-4897-9da0-a8bb7a6244fb-kube-api-access-nm5wf" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391656 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4cabad06-e774-45b2-ae79-fbe2a70e413f" volumeName="kubernetes.io/projected/4cabad06-e774-45b2-ae79-fbe2a70e413f-kube-api-access-jtjv2" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391666 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b62b29d-bf73-44c3-9d91-7c7d3de6ab39" volumeName="kubernetes.io/secret/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391675 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391684 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dab03a0-efe3-4b27-b982-66628c8dc8a1" volumeName="kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-tls" seLinuxMountContext="" Oct 29 23:13:58.391665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391694 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dab03a0-efe3-4b27-b982-66628c8dc8a1" volumeName="kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391704 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391713 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391722 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391740 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="959a0d7f-8036-42ad-bacd-bdeb7da391ec" volumeName="kubernetes.io/projected/959a0d7f-8036-42ad-bacd-bdeb7da391ec-kube-api-access-tlxql" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391750 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/empty-dir/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-tmp" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391760 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2" volumeName="kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-tuned" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391769 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be5750a5-cb62-4414-a5b7-273edc9e9c1e" volumeName="kubernetes.io/projected/be5750a5-cb62-4414-a5b7-273edc9e9c1e-kube-api-access-js8zk" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391778 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391787 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2" volumeName="kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-tmp" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391797 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e743b094-7e5d-496c-a8fd-5f2b801b4cee" volumeName="kubernetes.io/configmap/e743b094-7e5d-496c-a8fd-5f2b801b4cee-serviceca" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391806 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="164322e0-a486-4897-9da0-a8bb7a6244fb" volumeName="kubernetes.io/secret/164322e0-a486-4897-9da0-a8bb7a6244fb-ovn-node-metrics-cert" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391816 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24ca50cb-c977-4fbd-848f-c4ff5f7be381" volumeName="kubernetes.io/configmap/24ca50cb-c977-4fbd-848f-c4ff5f7be381-config-volume" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391824 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6660100-f2b0-46e1-bbd0-6566db43d9aa" volumeName="kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391834 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-tls" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391844 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa38333f-05b6-4cac-bddf-9bc834ef25f8" volumeName="kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391863 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2" volumeName="kubernetes.io/projected/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-kube-api-access-tp9c8" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391876 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391917 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/configmap/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-metrics-client-ca" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391928 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="164322e0-a486-4897-9da0-a8bb7a6244fb" volumeName="kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-script-lib" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391937 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ecb4e993-6e54-4680-8e52-4988c38199f0" volumeName="kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391949 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0" volumeName="kubernetes.io/projected/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-kube-api-access-wn4c4" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391959 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61b15df4-920b-471e-8070-c8916918c55e" volumeName="kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391967 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dab03a0-efe3-4b27-b982-66628c8dc8a1" volumeName="kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.391980 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="92eceb2e-00de-4593-84de-6e5878c81f4e" volumeName="kubernetes.io/empty-dir/92eceb2e-00de-4593-84de-6e5878c81f4e-tmp-dir" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.392006 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="afd5d371-4d02-428a-878a-f2b78f7f8e6c" volumeName="kubernetes.io/configmap/afd5d371-4d02-428a-878a-f2b78f7f8e6c-konnectivity-ca" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.392016 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="be5750a5-cb62-4414-a5b7-273edc9e9c1e" volumeName="kubernetes.io/configmap/be5750a5-cb62-4414-a5b7-273edc9e9c1e-iptables-alerter-script" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.392028 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa38333f-05b6-4cac-bddf-9bc834ef25f8" volumeName="kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.392038 5976 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="24ca50cb-c977-4fbd-848f-c4ff5f7be381" volumeName="kubernetes.io/secret/24ca50cb-c977-4fbd-848f-c4ff5f7be381-metrics-tls" seLinuxMountContext="" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.392049 5976 reconstruct.go:97] "Volume reconstruction finished" Oct 29 23:13:58.393476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.392060 5976 reconciler.go:29] "Reconciler: start to sync state" Oct 29 23:13:58.420435 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.420368 5976 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 29 23:13:58.422255 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.422055 5976 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 29 23:13:58.422255 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.422079 5976 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 29 23:13:58.422255 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.422100 5976 kubelet.go:2521] "Starting kubelet main sync loop" Oct 29 23:13:58.422255 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.422139 5976 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 29 23:13:58.426011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.425974 5976 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 29 23:13:58.428569 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.428521 5976 generic.go:356] "Generic (PLEG): container finished" podID="01348cd00e880c068c6ab3ecc9c090d7" containerID="f1d9de301787f80f7ac8292504ff109aa3bb56f1ac3718fee9114e170225225a" exitCode=0 Oct 29 23:13:58.435207 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.435170 5976 generic.go:356] "Generic (PLEG): container finished" podID="fa38333f-05b6-4cac-bddf-9bc834ef25f8" containerID="350840afc49eacc60d136c60a77c8ed68494349d3769de0a62a0d73a646fa748" exitCode=0 Oct 29 23:13:58.435822 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.435803 5976 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:58.435986 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.435967 5976 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:58.446389 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.446364 5976 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:58.446389 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.446371 5976 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:13:58.458053 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.458026 5976 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="9f00b39290d181a478aa73b47eed0659201540cacc6558f3c324fc4a04dc7011" exitCode=0 Oct 29 23:13:58.458053 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.458051 5976 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="a3fbc8edba22d23e141c10e002d00976848812bb4cd175a2ae7adabb0c88598a" exitCode=0 Oct 29 23:13:58.458053 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.458059 5976 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="a45bf9a8d912948f2c0db390f7f39be3125ccb03a34d3c8f4ac1acb1778018c0" exitCode=0 Oct 29 23:13:58.458261 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.458066 5976 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="6ecf7ec02e8a8bbf4f067cae080fb1fa7f580ede1af462a04726f3e732a29481" exitCode=0 Oct 29 23:13:58.458261 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.458072 5976 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="5d4f49d138312ccb2c49487f351d99ba69f8cb1e4d58441c508648e4765e1cca" exitCode=0 Oct 29 23:13:58.458261 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.458077 5976 generic.go:356] "Generic (PLEG): container finished" podID="4cabad06-e774-45b2-ae79-fbe2a70e413f" containerID="9ba53189ef40d8d367e2f53900ac8ca5327a4d8667b6405b0f3e79a4d3b42fcc" exitCode=0 Oct 29 23:13:58.494701 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.494632 5976 manager.go:324] Recovery completed Oct 29 23:13:58.514619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514588 5976 cpu_manager.go:226] "Starting" policy="none" Oct 29 23:13:58.514619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514609 5976 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 29 23:13:58.514801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514630 5976 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 29 23:13:58.514801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514769 5976 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 29 23:13:58.514801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514780 5976 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 29 23:13:58.514801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514798 5976 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 29 23:13:58.514904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514804 5976 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 29 23:13:58.514904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514809 5976 policy_none.go:50] "Start" Oct 29 23:13:58.514904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514817 5976 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 29 23:13:58.514904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.514826 5976 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 29 23:13:58.515906 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.515893 5976 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 29 23:13:58.515941 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.515907 5976 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 29 23:13:58.515941 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.515914 5976 policy_none.go:44] "Start" Oct 29 23:13:58.522046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.522014 5976 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 29 23:13:58.522214 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.522195 5976 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 29 23:13:58.525312 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.525297 5976 manager.go:341] "Starting Device Plugin manager" Oct 29 23:13:58.525875 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.525324 5976 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 29 23:13:58.525916 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.525880 5976 server.go:87] "Starting device plugin registration server" Oct 29 23:13:58.526154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526143 5976 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 29 23:13:58.526205 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526155 5976 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 29 23:13:58.526246 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526236 5976 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 29 23:13:58.526363 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526329 5976 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 29 23:13:58.526463 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526371 5976 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 29 23:13:58.526463 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526378 5976 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 29 23:13:58.526588 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.526437 5976 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:13:58.526358047Z","UUID":"b03194a1-fd9b-4020-b528-62a7f89d9409","Handler":null,"Name":"","Endpoint":""} Oct 29 23:13:58.527860 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.527840 5976 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 29 23:13:58.527968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.527881 5976 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 29 23:13:58.528050 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.528028 5976 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 29 23:13:58.626824 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.626770 5976 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:13:58.629061 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.629036 5976 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:13:58.629212 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.629085 5976 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:13:58.629212 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.629096 5976 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-137-132.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:13:58.629212 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.629136 5976 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.659185 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.659155 5976 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.659295 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.659240 5976 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.722834 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.722771 5976 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal"] Oct 29 23:13:58.723367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.723329 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" event={"ID":"01348cd00e880c068c6ab3ecc9c090d7","Type":"ContainerStarted","Data":"2a73fec122158688e1b225dbc30bf260ec87027e05a817e1d241368652e39092"} Oct 29 23:13:58.723476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.723459 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" event={"ID":"2db034d2cac0da0a261053f0bada2678","Type":"ContainerStarted","Data":"53aed25590b8b0c4d9fe0353ce18311e99ac236f0ef72558634b250808decaa1"} Oct 29 23:13:58.723532 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.723483 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" event={"ID":"2db034d2cac0da0a261053f0bada2678","Type":"ContainerStarted","Data":"57f2b68e603efe5a06b2e77c9e2144077a7c296655e0e6f33b95e01841e3d8b7"} Oct 29 23:13:58.723532 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.723503 5976 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.723653 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.723579 5976 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.746600 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.746507 5976 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:58.746600 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.746594 5976 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.746739 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.746691 5976 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:58.746739 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:58.746727 5976 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.828063 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.828027 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.828063 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.828061 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2db034d2cac0da0a261053f0bada2678-config\") pod \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" (UID: \"2db034d2cac0da0a261053f0bada2678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.828235 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.828079 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.928714 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.928679 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.928904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.928717 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.928904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.928744 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2db034d2cac0da0a261053f0bada2678-config\") pod \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" (UID: \"2db034d2cac0da0a261053f0bada2678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.928904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.928795 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2db034d2cac0da0a261053f0bada2678-config\") pod \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" (UID: \"2db034d2cac0da0a261053f0bada2678\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.928904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.928823 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:58.928904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:58.928795 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01348cd00e880c068c6ab3ecc9c090d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" (UID: \"01348cd00e880c068c6ab3ecc9c090d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:59.373199 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.373154 5976 apiserver.go:52] "Watching apiserver" Oct 29 23:13:59.420451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.420414 5976 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 29 23:13:59.421006 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.420978 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b8w9r","kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal","openshift-console/console-b8454765d-bk5jk","openshift-network-diagnostics/network-check-target-7n6qd","openshift-network-operator/iptables-alerter-p2xcq","kube-system/global-pull-secret-syncer-6s4mw","openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt","kube-system/konnectivity-agent-c47rv","openshift-multus/network-metrics-daemon-p7x9w","openshift-monitoring/thanos-querier-555fbcb47b-99nwc","openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7","openshift-dns/node-resolver-nnc2g","openshift-monitoring/node-exporter-4567x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9","openshift-ingress-canary/ingress-canary-rj4cr","openshift-multus/multus-additional-cni-plugins-bl5l6","openshift-multus/multus-pn77x","openshift-cluster-node-tuning-operator/tuned-4kl8q","openshift-dns/dns-default-2dpmf","openshift-ovn-kubernetes/ovnkube-node-djn9s","openshift-image-registry/node-ca-4qvsk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal"] Oct 29 23:13:59.438594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438539 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 29 23:13:59.438744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438611 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 29 23:13:59.438744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438681 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.438744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438720 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438744 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438758 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438746 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438800 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438802 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438819 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438843 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.438962 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439075 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439168 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.439220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439219 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c96z8\"" Oct 29 23:13:59.439575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439254 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\"" Oct 29 23:13:59.439575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439255 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\"" Oct 29 23:13:59.439575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439266 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4s2ql\"" Oct 29 23:13:59.439575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439333 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lj8k\"" Oct 29 23:13:59.439575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.439405 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kxr2\"" Oct 29 23:13:59.445425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.445404 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 29 23:13:59.445425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.445406 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 29 23:13:59.445663 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.445651 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:59.446871 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.446856 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.446935 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.446885 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 29 23:13:59.446935 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.446897 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:59.447033 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.446969 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t5hzf\"" Oct 29 23:13:59.447033 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.447025 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcbr2\"" Oct 29 23:13:59.447120 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.447062 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 29 23:13:59.448467 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448452 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nnrj\"" Oct 29 23:13:59.448706 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448683 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.448706 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448709 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27bdq\"" Oct 29 23:13:59.448877 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448724 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 29 23:13:59.448877 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448726 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.448877 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448764 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\"" Oct 29 23:13:59.448877 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448819 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 29 23:13:59.448877 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448855 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmxkp\"" Oct 29 23:13:59.448877 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448866 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448889 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448925 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448925 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448932 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448949 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.448992 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.449037 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.449096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.449076 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.452412 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.452397 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Oct 29 23:13:59.452412 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.452399 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Oct 29 23:13:59.452892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.452861 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Oct 29 23:13:59.452892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.452872 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 29 23:13:59.452892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.452889 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 29 23:13:59.453132 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453117 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.453209 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453195 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xpn55\"" Oct 29 23:13:59.453272 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453199 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 29 23:13:59.453272 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453240 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Oct 29 23:13:59.453441 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453418 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.453441 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453439 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h6cnq\"" Oct 29 23:13:59.453574 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453452 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 29 23:13:59.453696 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453682 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Oct 29 23:13:59.453791 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453729 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 29 23:13:59.453791 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453785 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crphw\"" Oct 29 23:13:59.453910 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453800 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.453910 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.453819 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.454037 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454020 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6s7px\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454022 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-984bt\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454049 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454054 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454040 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454056 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454069 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454082 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454071 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454092 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zvskk\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454115 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 29 23:13:59.454116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454119 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 29 23:13:59.454448 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454159 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 29 23:13:59.454448 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.454176 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Oct 29 23:13:59.455149 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.455134 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Oct 29 23:13:59.455288 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.455274 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eivphfkuffkj0\"" Oct 29 23:13:59.455345 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.455300 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ddvzx\"" Oct 29 23:13:59.455422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.455407 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 29 23:13:59.455484 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.455466 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Oct 29 23:13:59.455534 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.455522 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z8rhq\"" Oct 29 23:13:59.459191 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.459178 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 29 23:13:59.480950 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.480925 5976 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:59.481118 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.481020 5976 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:59.488503 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.488482 5976 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 29 23:13:59.500378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.500356 5976 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:59.500488 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:59.500403 5976 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-137-132.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-132.ec2.internal" Oct 29 23:13:59.501415 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.501401 5976 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:13:59.501491 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:13:59.501433 5976 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-132.ec2.internal" Oct 29 23:13:59.531428 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531397 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-hostroot\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.531589 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531436 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afd5d371-4d02-428a-878a-f2b78f7f8e6c-konnectivity-ca\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:13:59.531589 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531468 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.531589 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531524 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-var-lib-kubelet\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.531796 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531598 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-ovn\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.531796 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531655 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-metrics-client-ca\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.531796 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531698 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.531796 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531735 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xc8\" (UniqueName: \"kubernetes.io/projected/9c2205ed-fff4-48e9-9461-c085df16e0ba-kube-api-access-m6xc8\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:59.531796 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531761 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysconfig\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.531796 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531789 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531798 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/afd5d371-4d02-428a-878a-f2b78f7f8e6c-konnectivity-ca\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531824 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531965 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532004 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532011 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.531969 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.532076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532033 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-textfile\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532083 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-conf\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532111 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-dbus\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532203 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-textfile\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532250 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-bin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532303 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-registration-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532336 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-log-socket\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.532384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532365 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-metrics-client-ca\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532390 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532444 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e743b094-7e5d-496c-a8fd-5f2b801b4cee-host\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532473 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e743b094-7e5d-496c-a8fd-5f2b801b4cee-serviceca\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532532 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532581 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532610 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8zk\" (UniqueName: \"kubernetes.io/projected/be5750a5-cb62-4414-a5b7-273edc9e9c1e-kube-api-access-js8zk\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.532674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532651 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-etc-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.532987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532779 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.532987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532848 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.532987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532880 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cni-binary-copy\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.532987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532905 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-conf-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.532987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532922 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-tmp\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.532987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532941 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-var-lib-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.532987 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-tls\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533063 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-socket-dir-parent\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533080 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-tmp\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533116 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92eceb2e-00de-4593-84de-6e5878c81f4e-tmp-dir\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533139 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e743b094-7e5d-496c-a8fd-5f2b801b4cee-serviceca\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533160 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cni-binary-copy\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533174 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-daemon-config\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533194 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92eceb2e-00de-4593-84de-6e5878c81f4e-tmp-dir\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.533267 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533238 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-socket-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533342 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533354 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533353 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-tls\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533381 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be5750a5-cb62-4414-a5b7-273edc9e9c1e-host-slash\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533411 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-node-log\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533382 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-daemon-config\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533455 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cnibin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533485 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-kubelet\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533513 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sdz7\" (UniqueName: \"kubernetes.io/projected/24ca50cb-c977-4fbd-848f-c4ff5f7be381-kube-api-access-7sdz7\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.533619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533570 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533637 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533676 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533716 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dab03a0-efe3-4b27-b982-66628c8dc8a1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533737 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-root\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533761 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533777 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-crio-socket\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533785 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6dab03a0-efe3-4b27-b982-66628c8dc8a1-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533793 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533817 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-script-lib\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533828 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-binary-copy\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533904 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533922 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8xl\" (UniqueName: \"kubernetes.io/projected/92eceb2e-00de-4593-84de-6e5878c81f4e-kube-api-access-jz8xl\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533992 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.533999 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-wtmp\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.534046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534021 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534093 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-multus-certs\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534110 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-script-lib\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534122 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c2205ed-fff4-48e9-9461-c085df16e0ba-cert\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534145 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmn4k\" (UniqueName: \"kubernetes.io/projected/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-api-access-fmn4k\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534166 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534208 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-kubelet\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534243 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9snd\" (UniqueName: \"kubernetes.io/projected/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kube-api-access-z9snd\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534311 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c2205ed-fff4-48e9-9461-c085df16e0ba-cert\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:59.534616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534357 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.535017 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534873 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:59.535017 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534908 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.535124 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.534933 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535258 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-sys\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535460 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535496 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-kubernetes\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535543 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-data-volume\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535600 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535629 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be5750a5-cb62-4414-a5b7-273edc9e9c1e-iptables-alerter-script\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535660 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535693 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535722 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-tmp\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535765 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535797 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-k8s-cni-cncf-io\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535826 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ca50cb-c977-4fbd-848f-c4ff5f7be381-metrics-tls\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535852 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-system-cni-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535883 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzgd7\" (UniqueName: \"kubernetes.io/projected/4c91594d-41ac-4d03-a9cc-910cdc87c30f-kube-api-access-bzgd7\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535914 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535943 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.535971 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536006 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg2wm\" (UniqueName: \"kubernetes.io/projected/e743b094-7e5d-496c-a8fd-5f2b801b4cee-kube-api-access-cg2wm\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536034 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-systemd\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536063 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-slash\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536090 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-netns\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536114 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afd5d371-4d02-428a-878a-f2b78f7f8e6c-agent-certs\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536139 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-sys\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536167 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-host\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536202 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164322e0-a486-4897-9da0-a8bb7a6244fb-ovn-node-metrics-cert\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536235 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536262 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dt8\" (UniqueName: \"kubernetes.io/projected/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-api-access-r2dt8\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536303 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxql\" (UniqueName: \"kubernetes.io/projected/959a0d7f-8036-42ad-bacd-bdeb7da391ec-kube-api-access-tlxql\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536326 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-tuned\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536355 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536385 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-system-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536413 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-multus\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536436 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-modprobe-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536471 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24ca50cb-c977-4fbd-848f-c4ff5f7be381-config-volume\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536502 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjv2\" (UniqueName: \"kubernetes.io/projected/4cabad06-e774-45b2-ae79-fbe2a70e413f-kube-api-access-jtjv2\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536530 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-systemd-units\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536575 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-bin\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536830 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536893 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/afd5d371-4d02-428a-878a-f2b78f7f8e6c-agent-certs\") pod \"konnectivity-agent-c47rv\" (UID: \"afd5d371-4d02-428a-878a-f2b78f7f8e6c\") " pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.536930 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-data-volume\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537120 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537133 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be5750a5-cb62-4414-a5b7-273edc9e9c1e-iptables-alerter-script\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537315 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-lib-modules\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537480 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537689 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537734 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/24ca50cb-c977-4fbd-848f-c4ff5f7be381-metrics-tls\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537922 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537972 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-tmp\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.537973 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ca50cb-c977-4fbd-848f-c4ff5f7be381-tmp-dir\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538056 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ca50cb-c977-4fbd-848f-c4ff5f7be381-tmp-dir\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538128 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-accelerators-collector-config\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538315 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/164322e0-a486-4897-9da0-a8bb7a6244fb-ovn-node-metrics-cert\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538497 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/24ca50cb-c977-4fbd-848f-c4ff5f7be381-config-volume\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538541 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc7zk\" (UniqueName: \"kubernetes.io/projected/fa38333f-05b6-4cac-bddf-9bc834ef25f8-kube-api-access-rc7zk\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538598 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-sys-fs\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538630 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-systemd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538689 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-tuned\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538751 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-etc-kubernetes\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538784 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-metrics-client-ca\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538799 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538816 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-cnibin\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538851 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm5wf\" (UniqueName: \"kubernetes.io/projected/164322e0-a486-4897-9da0-a8bb7a6244fb-kube-api-access-nm5wf\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538884 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.538980 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqnc\" (UniqueName: \"kubernetes.io/projected/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-kube-api-access-dzqnc\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539007 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-grpc-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539247 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dab03a0-efe3-4b27-b982-66628c8dc8a1-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539294 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539418 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-secret-grpc-tls\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.539483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539466 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-metrics-client-ca\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539775 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539830 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.539904 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-run\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540344 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540361 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540383 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a0d7f-8036-42ad-bacd-bdeb7da391ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540468 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540487 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-kubelet-config\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540629 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540658 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4cabad06-e774-45b2-ae79-fbe2a70e413f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540669 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9c8\" (UniqueName: \"kubernetes.io/projected/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-kube-api-access-tp9c8\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540658 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ecb4e993-6e54-4680-8e52-4988c38199f0-original-pull-secret\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540695 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-netd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540702 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540718 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-env-overrides\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540739 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/959a0d7f-8036-42ad-bacd-bdeb7da391ec-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540761 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92eceb2e-00de-4593-84de-6e5878c81f4e-hosts-file\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540792 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4c4\" (UniqueName: \"kubernetes.io/projected/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-kube-api-access-wn4c4\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540815 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540836 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-device-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540858 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-netns\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540908 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-config\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.540916 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-env-overrides\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.541041 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c91594d-41ac-4d03-a9cc-910cdc87c30f-metrics-certs\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:59.542562 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.541085 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/164322e0-a486-4897-9da0-a8bb7a6244fb-ovnkube-config\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.548287 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.548261 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") pod \"console-b8454765d-bk5jk\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:13:59.548287 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.548278 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xc8\" (UniqueName: \"kubernetes.io/projected/9c2205ed-fff4-48e9-9461-c085df16e0ba-kube-api-access-m6xc8\") pod \"ingress-canary-rj4cr\" (UID: \"9c2205ed-fff4-48e9-9461-c085df16e0ba\") " pod="openshift-ingress-canary/ingress-canary-rj4cr" Oct 29 23:13:59.550151 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.550130 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sdz7\" (UniqueName: \"kubernetes.io/projected/24ca50cb-c977-4fbd-848f-c4ff5f7be381-kube-api-access-7sdz7\") pod \"dns-default-2dpmf\" (UID: \"24ca50cb-c977-4fbd-848f-c4ff5f7be381\") " pod="openshift-dns/dns-default-2dpmf" Oct 29 23:13:59.550699 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.550681 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9snd\" (UniqueName: \"kubernetes.io/projected/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kube-api-access-z9snd\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.551050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.551032 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlwb\" (UniqueName: \"kubernetes.io/projected/d6660100-f2b0-46e1-bbd0-6566db43d9aa-kube-api-access-frlwb\") pod \"network-check-target-7n6qd\" (UID: \"d6660100-f2b0-46e1-bbd0-6566db43d9aa\") " pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:13:59.551200 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.551167 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmn4k\" (UniqueName: \"kubernetes.io/projected/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-kube-api-access-fmn4k\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.551256 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.551219 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8zk\" (UniqueName: \"kubernetes.io/projected/be5750a5-cb62-4414-a5b7-273edc9e9c1e-kube-api-access-js8zk\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.551370 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.551353 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8xl\" (UniqueName: \"kubernetes.io/projected/92eceb2e-00de-4593-84de-6e5878c81f4e-kube-api-access-jz8xl\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.555775 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.555751 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dt8\" (UniqueName: \"kubernetes.io/projected/6dab03a0-efe3-4b27-b982-66628c8dc8a1-kube-api-access-r2dt8\") pod \"kube-state-metrics-5dc8d7d89b-lf6z7\" (UID: \"6dab03a0-efe3-4b27-b982-66628c8dc8a1\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-lf6z7" Oct 29 23:13:59.559672 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.559649 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxql\" (UniqueName: \"kubernetes.io/projected/959a0d7f-8036-42ad-bacd-bdeb7da391ec-kube-api-access-tlxql\") pod \"monitoring-plugin-77f4f76594-h6sgt\" (UID: \"959a0d7f-8036-42ad-bacd-bdeb7da391ec\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:13:59.560013 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.559982 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzgd7\" (UniqueName: \"kubernetes.io/projected/4c91594d-41ac-4d03-a9cc-910cdc87c30f-kube-api-access-bzgd7\") pod \"network-metrics-daemon-p7x9w\" (UID: \"4c91594d-41ac-4d03-a9cc-910cdc87c30f\") " pod="openshift-multus/network-metrics-daemon-p7x9w" Oct 29 23:13:59.560095 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.560019 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg2wm\" (UniqueName: \"kubernetes.io/projected/e743b094-7e5d-496c-a8fd-5f2b801b4cee-kube-api-access-cg2wm\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.560095 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.560060 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqnc\" (UniqueName: \"kubernetes.io/projected/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-kube-api-access-dzqnc\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.561494 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.561472 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjv2\" (UniqueName: \"kubernetes.io/projected/4cabad06-e774-45b2-ae79-fbe2a70e413f-kube-api-access-jtjv2\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.563668 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.563647 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9c8\" (UniqueName: \"kubernetes.io/projected/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-kube-api-access-tp9c8\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.563743 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.563683 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4c4\" (UniqueName: \"kubernetes.io/projected/ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0-kube-api-access-wn4c4\") pod \"thanos-querier-555fbcb47b-99nwc\" (UID: \"ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0\") " pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:13:59.564045 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.564027 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc7zk\" (UniqueName: \"kubernetes.io/projected/fa38333f-05b6-4cac-bddf-9bc834ef25f8-kube-api-access-rc7zk\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.564175 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.564159 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm5wf\" (UniqueName: \"kubernetes.io/projected/164322e0-a486-4897-9da0-a8bb7a6244fb-kube-api-access-nm5wf\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641391 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-sys\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.641478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641430 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-kubernetes\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641447 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.641478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641471 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-k8s-cni-cncf-io\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641487 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-system-cni-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641503 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641507 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-sys\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641518 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641530 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-kubernetes\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641588 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-systemd\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641540 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641595 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641610 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-slash\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641602 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641617 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-system-cni-dir\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641628 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-netns\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641585 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-k8s-cni-cncf-io\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641650 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-systemd\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641662 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-sys\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641670 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-slash\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641662 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-netns\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641716 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-host\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641723 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-sys\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641735 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-system-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641754 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-multus\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641759 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-host\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641768 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-modprobe-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641784 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-systemd-units\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641795 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-system-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641801 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-bin\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641832 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-bin\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641833 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-multus\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.641841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641848 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-lib-modules\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641865 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-sys-fs\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641880 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-systemd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641836 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-systemd-units\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641895 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-etc-kubernetes\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641896 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-modprobe-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641913 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-cnibin\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641931 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-etc-kubernetes\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641936 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-systemd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641934 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641961 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cabad06-e774-45b2-ae79-fbe2a70e413f-cnibin\") pod \"multus-additional-cni-plugins-bl5l6\" (UID: \"4cabad06-e774-45b2-ae79-fbe2a70e413f\") " pod="openshift-multus/multus-additional-cni-plugins-bl5l6" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641965 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641973 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-sys-fs\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.641989 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-run\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642003 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-lib-modules\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642013 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-kubelet-config\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642016 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642035 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-d\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642047 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-kubelet-config\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642045 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-netd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642060 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-run\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642078 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92eceb2e-00de-4593-84de-6e5878c81f4e-hosts-file\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642081 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-cni-netd\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642116 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-device-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642132 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92eceb2e-00de-4593-84de-6e5878c81f4e-hosts-file\") pod \"node-resolver-nnc2g\" (UID: \"92eceb2e-00de-4593-84de-6e5878c81f4e\") " pod="openshift-dns/node-resolver-nnc2g" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642140 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-netns\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642164 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-hostroot\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642173 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-netns\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642172 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-device-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642188 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-var-lib-kubelet\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642210 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-ovn\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642234 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysconfig\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642266 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-var-lib-kubelet\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642273 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-ovn\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642272 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-hostroot\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642286 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysconfig\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642303 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-conf\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642322 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-dbus\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642341 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-bin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642360 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-registration-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642372 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ecb4e993-6e54-4680-8e52-4988c38199f0-dbus\") pod \"global-pull-secret-syncer-6s4mw\" (UID: \"ecb4e993-6e54-4680-8e52-4988c38199f0\") " pod="kube-system/global-pull-secret-syncer-6s4mw" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642383 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-log-socket\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642396 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-cni-bin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642413 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2-etc-sysctl-conf\") pod \"tuned-4kl8q\" (UID: \"4c791ebc-3f07-4cd3-8a4a-db2cdd0d59a2\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl8q" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642425 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642426 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-registration-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642441 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e743b094-7e5d-496c-a8fd-5f2b801b4cee-host\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642469 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-log-socket\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642480 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e743b094-7e5d-496c-a8fd-5f2b801b4cee-host\") pod \"node-ca-4qvsk\" (UID: \"e743b094-7e5d-496c-a8fd-5f2b801b4cee\") " pod="openshift-image-registry/node-ca-4qvsk" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642493 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-etc-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642499 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-cni-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642519 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-conf-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642522 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-etc-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642537 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-var-lib-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642579 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-socket-dir-parent\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642595 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-socket-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642611 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be5750a5-cb62-4414-a5b7-273edc9e9c1e-host-slash\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642631 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-node-log\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642656 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cnibin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642660 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b17fd4e-b2fa-46a8-af6b-a59f4fafda17-socket-dir\") pod \"aws-ebs-csi-driver-node-n6rw9\" (UID: \"3b17fd4e-b2fa-46a8-af6b-a59f4fafda17\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6rw9" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642664 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-socket-dir-parent\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642662 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be5750a5-cb62-4414-a5b7-273edc9e9c1e-host-slash\") pod \"iptables-alerter-p2xcq\" (UID: \"be5750a5-cb62-4414-a5b7-273edc9e9c1e\") " pod="openshift-network-operator/iptables-alerter-p2xcq" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642679 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-kubelet\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642688 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-node-log\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642690 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-var-lib-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642711 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-var-lib-kubelet\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642703 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-multus-conf-dir\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642705 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-cnibin\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642712 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-root\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642746 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-root\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642763 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-crio-socket\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642779 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-wtmp\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642798 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-multus-certs\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642817 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b62b29d-bf73-44c3-9d91-7c7d3de6ab39-crio-socket\") pod \"insights-runtime-extractor-b8w9r\" (UID: \"5b62b29d-bf73-44c3-9d91-7c7d3de6ab39\") " pod="openshift-insights/insights-runtime-extractor-b8w9r" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642826 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-kubelet\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642826 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fa38333f-05b6-4cac-bddf-9bc834ef25f8-node-exporter-wtmp\") pod \"node-exporter-4567x\" (UID: \"fa38333f-05b6-4cac-bddf-9bc834ef25f8\") " pod="openshift-monitoring/node-exporter-4567x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642847 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9adb857-fd51-4830-b99c-2a0d1a1ffeea-host-run-multus-certs\") pod \"multus-pn77x\" (UID: \"e9adb857-fd51-4830-b99c-2a0d1a1ffeea\") " pod="openshift-multus/multus-pn77x" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642851 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642858 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-kubelet\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642873 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642879 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-run-openvswitch\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.642953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.642928 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/164322e0-a486-4897-9da0-a8bb7a6244fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-djn9s\" (UID: \"164322e0-a486-4897-9da0-a8bb7a6244fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:13:59.841375 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:13:59.841342 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-555fbcb47b-99nwc" Oct 29 23:14:02.069345 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:02.069314 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:14:02.301953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:02.301923 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2dpmf" Oct 29 23:14:03.508544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:03.508513 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:14:04.100678 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:04.100647 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:14:06.733171 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:06.733136 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-h6sgt" Oct 29 23:14:07.771776 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:07.771743 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:14:07.772132 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:07.771987 5976 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:14:13.774751 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:13.774675 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c47rv" Oct 29 23:14:19.349476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.349442 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs"] Oct 29 23:14:19.356587 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.356541 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.370935 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.370905 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Oct 29 23:14:19.380995 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.380969 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Oct 29 23:14:19.380995 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.380974 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Oct 29 23:14:19.381194 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.381075 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-r7fw5\"" Oct 29 23:14:19.381194 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.381125 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Oct 29 23:14:19.381541 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.381518 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs"] Oct 29 23:14:19.434489 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.434446 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Oct 29 23:14:19.445306 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.445281 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\"" Oct 29 23:14:19.471605 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471574 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-secret-telemeter-client\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.471710 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471615 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.471710 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471642 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-metrics-client-ca\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.471816 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471763 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd8nh\" (UniqueName: \"kubernetes.io/projected/6751556e-9ac0-4344-b2bb-bbdff9044caa-kube-api-access-nd8nh\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.471851 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471821 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-federate-client-tls\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.471894 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471850 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-serving-certs-ca-bundle\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.471967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471946 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.472024 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.471987 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-telemeter-client-tls\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573174 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573129 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd8nh\" (UniqueName: \"kubernetes.io/projected/6751556e-9ac0-4344-b2bb-bbdff9044caa-kube-api-access-nd8nh\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573174 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573172 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-federate-client-tls\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573428 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573195 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-serving-certs-ca-bundle\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573428 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573224 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573428 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573341 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-telemeter-client-tls\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573620 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573426 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-secret-telemeter-client\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573620 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573467 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573620 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573510 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-metrics-client-ca\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.573772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.573626 5976 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 29 23:14:19.574176 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.574149 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-serving-certs-ca-bundle\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.574299 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.574209 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.574426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.574405 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6751556e-9ac0-4344-b2bb-bbdff9044caa-metrics-client-ca\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.576173 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.576146 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.576293 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.576188 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-secret-telemeter-client\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.576383 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.576364 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-federate-client-tls\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.576459 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.576438 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6751556e-9ac0-4344-b2bb-bbdff9044caa-telemeter-client-tls\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.597395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.597363 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd8nh\" (UniqueName: \"kubernetes.io/projected/6751556e-9ac0-4344-b2bb-bbdff9044caa-kube-api-access-nd8nh\") pod \"telemeter-client-5cb894cfdf-wdfbs\" (UID: \"6751556e-9ac0-4344-b2bb-bbdff9044caa\") " pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.670339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.670306 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" Oct 29 23:14:19.997309 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:19.997230 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs"] Oct 29 23:14:20.012032 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:14:20.011987 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6751556e_9ac0_4344_b2bb_bbdff9044caa.slice/crio-5b97201895066c4b7fc38727f415d46e4c465a19fe64b9dbf9b9c278d082369d WatchSource:0}: Error finding container 5b97201895066c4b7fc38727f415d46e4c465a19fe64b9dbf9b9c278d082369d: Status 404 returned error can't find the container with id 5b97201895066c4b7fc38727f415d46e4c465a19fe64b9dbf9b9c278d082369d Oct 29 23:14:20.014105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:20.014087 5976 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:14:20.551241 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:20.551194 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" event={"ID":"6751556e-9ac0-4344-b2bb-bbdff9044caa","Type":"ContainerStarted","Data":"5b97201895066c4b7fc38727f415d46e4c465a19fe64b9dbf9b9c278d082369d"} Oct 29 23:14:21.556387 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:21.556349 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" event={"ID":"6751556e-9ac0-4344-b2bb-bbdff9044caa","Type":"ContainerStarted","Data":"1caa8dd830f61c0b17079fe22a64c6aea51948d6ce2a74783396bf7ecd574c6c"} Oct 29 23:14:22.561263 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.561170 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" event={"ID":"6751556e-9ac0-4344-b2bb-bbdff9044caa","Type":"ContainerStarted","Data":"a987ecb83cb3f2a8788bc469f291a4f782a1934386d817e003b6d2e05e683b54"} Oct 29 23:14:22.561263 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.561224 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" event={"ID":"6751556e-9ac0-4344-b2bb-bbdff9044caa","Type":"ContainerStarted","Data":"2b79f9b9b252b59331bc9c8fd9ea5f26ab38a3a9cc0f87f3d03084b4c31f2dce"} Oct 29 23:14:22.620978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.620922 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cb894cfdf-wdfbs" podStartSLOduration=1.420061242 podStartE2EDuration="3.620909725s" totalImagesPullingTime="2.200848483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:22.610725359 +0000 UTC m=+24.301378666" watchObservedRunningTime="2026-10-29 23:14:22.620909725 +0000 UTC m=+24.311563026" Oct 29 23:14:22.773103 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.773063 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d55cdd7bd-w4x2c"] Oct 29 23:14:22.775594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.775542 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.796929 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.796905 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d55cdd7bd-w4x2c"] Oct 29 23:14:22.899333 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899305 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899525 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899344 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899525 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899432 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899525 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899459 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899545 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899598 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899647 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:22.899769 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:22.899662 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szz4f\" (UniqueName: \"kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.000688 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000654 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.000688 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000687 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.000912 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000712 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.000912 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000827 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szz4f\" (UniqueName: \"kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.000912 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000877 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001023 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000930 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001023 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.000988 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001023 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.001011 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001161 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.001059 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.001481 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001768 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.001710 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.001768 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.001720 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.002027 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.001880 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.003593 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.003545 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.003705 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.003685 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.018519 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.018498 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szz4f\" (UniqueName: \"kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f\") pod \"console-6d55cdd7bd-w4x2c\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.085490 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.085451 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:23.379480 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.379386 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d55cdd7bd-w4x2c"] Oct 29 23:14:23.383461 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:14:23.383429 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ba180_298b_47dd_9a4a_ee16b8a1ded0.slice/crio-aa86cfb37d00d6408694723da290af77919a2816d6deae5434ba3f4e46163e16 WatchSource:0}: Error finding container aa86cfb37d00d6408694723da290af77919a2816d6deae5434ba3f4e46163e16: Status 404 returned error can't find the container with id aa86cfb37d00d6408694723da290af77919a2816d6deae5434ba3f4e46163e16 Oct 29 23:14:23.566492 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.566453 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d55cdd7bd-w4x2c" event={"ID":"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0","Type":"ContainerStarted","Data":"5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211"} Oct 29 23:14:23.566910 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.566506 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d55cdd7bd-w4x2c" event={"ID":"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0","Type":"ContainerStarted","Data":"aa86cfb37d00d6408694723da290af77919a2816d6deae5434ba3f4e46163e16"} Oct 29 23:14:23.609055 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:23.608984 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6d55cdd7bd-w4x2c" podStartSLOduration=1.60897224 podStartE2EDuration="1.60897224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:23.608864382 +0000 UTC m=+25.299517690" watchObservedRunningTime="2026-10-29 23:14:23.60897224 +0000 UTC m=+25.299625597" Oct 29 23:14:25.589345 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:25.589313 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-djn9s" Oct 29 23:14:27.252164 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:14:27.252129 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:14:33.085764 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:33.085722 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:33.086240 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:33.085792 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:33.090404 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:33.090381 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:33.511143 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:33.511115 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7n6qd" Oct 29 23:14:33.603911 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:33.603884 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:14:33.679398 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:33.679358 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8454765d-bk5jk"] Oct 29 23:14:45.248050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.248015 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5957f55f8f-qj9tl"] Oct 29 23:14:45.250341 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.250310 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266033 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266006 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-trusted-ca-bundle\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266040 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a641c475-e6f7-44cd-956a-f92f90016662-console-serving-cert\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266060 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a641c475-e6f7-44cd-956a-f92f90016662-console-oauth-config\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266143 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q44zl\" (UniqueName: \"kubernetes.io/projected/a641c475-e6f7-44cd-956a-f92f90016662-kube-api-access-q44zl\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266262 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266186 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a641c475-e6f7-44cd-956a-f92f90016662-tmp\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266262 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266212 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-service-ca\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266325 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266282 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-console-config\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.266325 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.266313 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-oauth-serving-cert\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.278515 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.278493 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5957f55f8f-qj9tl"] Oct 29 23:14:45.367050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367013 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a641c475-e6f7-44cd-956a-f92f90016662-console-serving-cert\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367049 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a641c475-e6f7-44cd-956a-f92f90016662-console-oauth-config\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367298 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367077 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q44zl\" (UniqueName: \"kubernetes.io/projected/a641c475-e6f7-44cd-956a-f92f90016662-kube-api-access-q44zl\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367298 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367103 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a641c475-e6f7-44cd-956a-f92f90016662-tmp\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367298 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367229 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-service-ca\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367298 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367286 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-console-config\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367525 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367324 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-oauth-serving-cert\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367525 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367355 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-trusted-ca-bundle\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.367749 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.367727 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a641c475-e6f7-44cd-956a-f92f90016662-tmp\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.368080 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.368058 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-service-ca\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.368165 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.368125 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-oauth-serving-cert\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.368261 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.368239 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-console-config\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.368513 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.368493 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a641c475-e6f7-44cd-956a-f92f90016662-trusted-ca-bundle\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.369841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.369817 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a641c475-e6f7-44cd-956a-f92f90016662-console-serving-cert\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.369942 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.369822 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a641c475-e6f7-44cd-956a-f92f90016662-console-oauth-config\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.385330 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.385306 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q44zl\" (UniqueName: \"kubernetes.io/projected/a641c475-e6f7-44cd-956a-f92f90016662-kube-api-access-q44zl\") pod \"console-5957f55f8f-qj9tl\" (UID: \"a641c475-e6f7-44cd-956a-f92f90016662\") " pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.560502 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.560392 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:45.854847 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:45.854752 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5957f55f8f-qj9tl"] Oct 29 23:14:45.858709 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:14:45.858678 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda641c475_e6f7_44cd_956a_f92f90016662.slice/crio-04c758c6baa6903ef794a12bdc0cfaed32cec7c086afeddb7826fe922359467a WatchSource:0}: Error finding container 04c758c6baa6903ef794a12bdc0cfaed32cec7c086afeddb7826fe922359467a: Status 404 returned error can't find the container with id 04c758c6baa6903ef794a12bdc0cfaed32cec7c086afeddb7826fe922359467a Oct 29 23:14:46.645793 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:46.645752 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5957f55f8f-qj9tl" event={"ID":"a641c475-e6f7-44cd-956a-f92f90016662","Type":"ContainerStarted","Data":"7959f2f39b0c6bfcf9be8726472ca3fee3f86e4865142deff91d5201d4ac9d8f"} Oct 29 23:14:46.646213 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:46.645808 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5957f55f8f-qj9tl" event={"ID":"a641c475-e6f7-44cd-956a-f92f90016662","Type":"ContainerStarted","Data":"04c758c6baa6903ef794a12bdc0cfaed32cec7c086afeddb7826fe922359467a"} Oct 29 23:14:46.683161 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:46.683115 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5957f55f8f-qj9tl" podStartSLOduration=1.683102398 podStartE2EDuration="1.683102398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:46.682353945 +0000 UTC m=+48.373007252" watchObservedRunningTime="2026-10-29 23:14:46.683102398 +0000 UTC m=+48.373755704" Oct 29 23:14:55.561297 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:55.561251 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:55.561825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:55.561328 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:55.566008 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:55.565984 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:55.679860 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:55.679829 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5957f55f8f-qj9tl" Oct 29 23:14:55.745643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:55.745607 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d55cdd7bd-w4x2c"] Oct 29 23:14:57.251779 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:14:57.251743 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:14:58.700459 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.700403 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-b8454765d-bk5jk" podUID="61b15df4-920b-471e-8070-c8916918c55e" containerName="console" containerID="cri-o://0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5" gracePeriod=15 Oct 29 23:14:58.943260 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.943225 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:14:58.975717 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975637 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975717 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975678 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975717 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975706 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975724 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975761 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975780 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975838 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.975981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975901 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") pod \"61b15df4-920b-471e-8070-c8916918c55e\" (UID: \"61b15df4-920b-471e-8070-c8916918c55e\") " Oct 29 23:14:58.976225 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.975950 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:58.976225 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.976163 5976 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61b15df4-920b-471e-8070-c8916918c55e-tmp\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:58.976225 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.976182 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:58.976338 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.976253 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:58.976338 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.976282 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:58.976705 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.976681 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:58.978270 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.978249 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "kube-api-access-ttrjk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:58.978597 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.978571 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:58.978687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:58.978640 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert" pod "61b15df4-920b-471e-8070-c8916918c55e" (UID: "61b15df4-920b-471e-8070-c8916918c55e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:59.076747 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076707 5976 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-console-config\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.076747 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076739 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttrjk\" (UniqueName: \"kubernetes.io/projected/61b15df4-920b-471e-8070-c8916918c55e-kube-api-access-ttrjk\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.076747 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076749 5976 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-oauth-serving-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.076980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076758 5976 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-trusted-ca-bundle\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.076980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076767 5976 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-serving-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.076980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076776 5976 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61b15df4-920b-471e-8070-c8916918c55e-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.076980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.076784 5976 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61b15df4-920b-471e-8070-c8916918c55e-console-oauth-config\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:14:59.689843 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.689803 5976 generic.go:356] "Generic (PLEG): container finished" podID="61b15df4-920b-471e-8070-c8916918c55e" containerID="0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5" exitCode=0 Oct 29 23:14:59.690015 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.689853 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8454765d-bk5jk" Oct 29 23:14:59.690015 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.689858 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8454765d-bk5jk" event={"ID":"61b15df4-920b-471e-8070-c8916918c55e","Type":"ContainerDied","Data":"0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5"} Oct 29 23:14:59.690015 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.689900 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8454765d-bk5jk" event={"ID":"61b15df4-920b-471e-8070-c8916918c55e","Type":"ContainerDied","Data":"15fa8f73ac723222339fb18aca1421ee0648934285c3c9c18341a0b7e412a214"} Oct 29 23:14:59.690015 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.689919 5976 scope.go:122] "RemoveContainer" containerID="0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5" Oct 29 23:14:59.698385 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.698368 5976 scope.go:122] "RemoveContainer" containerID="0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5" Oct 29 23:14:59.698701 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:14:59.698682 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5\": container with ID starting with 0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5 not found: ID does not exist" containerID="0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5" Oct 29 23:14:59.698772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.698711 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5"} err="failed to get container status \"0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5\": rpc error: code = NotFound desc = could not find container \"0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5\": container with ID starting with 0db16881e24b20ae834ee4ca9c2b1896881a4edb57fda065fcd24a123fc5d8a5 not found: ID does not exist" Oct 29 23:14:59.733358 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.733323 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8454765d-bk5jk"] Oct 29 23:14:59.743405 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:14:59.743374 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b8454765d-bk5jk"] Oct 29 23:15:00.427841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:00.427805 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61b15df4-920b-471e-8070-c8916918c55e" path="/var/lib/kubelet/pods/61b15df4-920b-471e-8070-c8916918c55e/volumes" Oct 29 23:15:20.766704 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:20.766659 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6d55cdd7bd-w4x2c" podUID="4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" containerName="console" containerID="cri-o://5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211" gracePeriod=15 Oct 29 23:15:21.005996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.005965 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:15:21.152690 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152653 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152690 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152695 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152722 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f\" (UniqueName: \"kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152754 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152783 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152810 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152863 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.152952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.152892 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert\") pod \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\" (UID: \"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0\") " Oct 29 23:15:21.153248 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.153215 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:15:21.153385 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.153354 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:15:21.153461 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.153387 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:15:21.153522 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.153455 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:15:21.153522 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.153502 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:15:21.155168 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.155148 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "kube-api-access-szz4f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:15:21.155630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.155612 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:15:21.155722 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.155637 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert" pod "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" (UID: "4e6ba180-298b-47dd-9a4a-ee16b8a1ded0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:15:21.254377 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254344 5976 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-oauth-serving-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254377 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254376 5976 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-serving-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254390 5976 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-config\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254402 5976 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-console-oauth-config\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254415 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szz4f\" (UniqueName: \"kubernetes.io/projected/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-kube-api-access-szz4f\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254427 5976 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254438 5976 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-tmp\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.254630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.254448 5976 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0-trusted-ca-bundle\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:15:21.764223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.764188 5976 generic.go:356] "Generic (PLEG): container finished" podID="4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" containerID="5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211" exitCode=0 Oct 29 23:15:21.764427 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.764234 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d55cdd7bd-w4x2c" Oct 29 23:15:21.764427 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.764276 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d55cdd7bd-w4x2c" event={"ID":"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0","Type":"ContainerDied","Data":"5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211"} Oct 29 23:15:21.764427 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.764333 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d55cdd7bd-w4x2c" event={"ID":"4e6ba180-298b-47dd-9a4a-ee16b8a1ded0","Type":"ContainerDied","Data":"aa86cfb37d00d6408694723da290af77919a2816d6deae5434ba3f4e46163e16"} Oct 29 23:15:21.764427 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.764360 5976 scope.go:122] "RemoveContainer" containerID="5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211" Oct 29 23:15:21.773328 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.773135 5976 scope.go:122] "RemoveContainer" containerID="5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211" Oct 29 23:15:21.773597 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:15:21.773419 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211\": container with ID starting with 5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211 not found: ID does not exist" containerID="5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211" Oct 29 23:15:21.773597 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.773443 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211"} err="failed to get container status \"5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211\": rpc error: code = NotFound desc = could not find container \"5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211\": container with ID starting with 5ce5ea11da127843f47b5ea3cfda13e352b49330b61f479266c546390a79b211 not found: ID does not exist" Oct 29 23:15:21.806411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.806380 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d55cdd7bd-w4x2c"] Oct 29 23:15:21.816458 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:21.816430 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d55cdd7bd-w4x2c"] Oct 29 23:15:22.427294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:15:22.427261 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" path="/var/lib/kubelet/pods/4e6ba180-298b-47dd-9a4a-ee16b8a1ded0/volumes" Oct 29 23:15:27.252994 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:15:27.252951 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:15:57.253322 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:15:57.253237 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:16:27.253357 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:16:27.253319 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:16:57.253925 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:16:57.253884 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:17:02.934163 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934128 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw"] Oct 29 23:17:02.934697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934446 5976 cpu_manager.go:414] "containerMap: removing container" podUID="4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" containerName="console" Oct 29 23:17:02.934697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934465 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" containerName="console" Oct 29 23:17:02.934697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934480 5976 cpu_manager.go:414] "containerMap: removing container" podUID="61b15df4-920b-471e-8070-c8916918c55e" containerName="console" Oct 29 23:17:02.934697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934488 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61b15df4-920b-471e-8070-c8916918c55e" containerName="console" Oct 29 23:17:02.934697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934574 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e6ba180-298b-47dd-9a4a-ee16b8a1ded0" containerName="console" Oct 29 23:17:02.934697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.934590 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="61b15df4-920b-471e-8070-c8916918c55e" containerName="console" Oct 29 23:17:02.937819 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.937791 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:02.965258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.965228 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-jz8cd\"" Oct 29 23:17:02.965395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.965278 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 29 23:17:02.965395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.965279 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 29 23:17:02.965863 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:02.965847 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw"] Oct 29 23:17:03.112302 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.112272 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.112472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.112309 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.112472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.112330 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgs9\" (UniqueName: \"kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.212963 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.212880 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.212963 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.212929 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.213175 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.212979 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgs9\" (UniqueName: \"kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.213276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.213260 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.213367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.213350 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.231819 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.231790 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgs9\" (UniqueName: \"kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.254533 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.254500 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:03.329600 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.328502 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps"] Oct 29 23:17:03.331889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.331864 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.346737 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346712 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 29 23:17:03.346855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346752 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 29 23:17:03.346855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346813 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Oct 29 23:17:03.346855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346830 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Oct 29 23:17:03.346855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346850 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Oct 29 23:17:03.347007 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346858 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 29 23:17:03.347007 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.346897 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-txq47\"" Oct 29 23:17:03.357945 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.357925 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps"] Oct 29 23:17:03.416335 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416295 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.416544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416358 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.416544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416397 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.416544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416463 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nl22\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.416544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416503 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.416544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416526 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.416837 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.416574 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517546 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517458 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517546 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517507 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517546 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517540 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517602 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nl22\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517640 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517660 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.517892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.517677 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.518363 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.518339 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.520378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.520348 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.520780 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.520760 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.520864 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.520807 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.521000 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.520975 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.535534 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.535473 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nl22\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.536629 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.536604 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token\") pod \"istiod-openshift-gateway-7876bfcb74-jwsps\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.551613 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.551587 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw"] Oct 29 23:17:03.555537 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:17:03.555512 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef4a198_3efe_42a6_8a33_89694ee30415.slice/crio-e3878b7e70f557eab15f17dd421dc487cb7cafc58c8ebe309e08309a6545f8c9 WatchSource:0}: Error finding container e3878b7e70f557eab15f17dd421dc487cb7cafc58c8ebe309e08309a6545f8c9: Status 404 returned error can't find the container with id e3878b7e70f557eab15f17dd421dc487cb7cafc58c8ebe309e08309a6545f8c9 Oct 29 23:17:03.643544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.643507 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:03.952355 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:03.952317 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps"] Oct 29 23:17:03.955281 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:17:03.955250 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59501ea_9816_4342_95ae_17028d5b8da4.slice/crio-229d9c626269f449f7a5a3e0adc1ea06ed5aa0ddf240c40cf87535fdc97dfc33 WatchSource:0}: Error finding container 229d9c626269f449f7a5a3e0adc1ea06ed5aa0ddf240c40cf87535fdc97dfc33: Status 404 returned error can't find the container with id 229d9c626269f449f7a5a3e0adc1ea06ed5aa0ddf240c40cf87535fdc97dfc33 Oct 29 23:17:04.098282 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:04.098248 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" event={"ID":"a59501ea-9816-4342-95ae-17028d5b8da4","Type":"ContainerStarted","Data":"229d9c626269f449f7a5a3e0adc1ea06ed5aa0ddf240c40cf87535fdc97dfc33"} Oct 29 23:17:04.099407 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:04.099381 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" event={"ID":"def4a198-3efe-42a6-8a33-89694ee30415","Type":"ContainerStarted","Data":"e3878b7e70f557eab15f17dd421dc487cb7cafc58c8ebe309e08309a6545f8c9"} Oct 29 23:17:06.987238 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:06.987197 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:17:06.987620 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:06.987277 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:17:07.112934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:07.112885 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" event={"ID":"a59501ea-9816-4342-95ae-17028d5b8da4","Type":"ContainerStarted","Data":"9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5"} Oct 29 23:17:07.113119 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:07.113091 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:07.174044 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:07.173972 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" podStartSLOduration=1.144857461 podStartE2EDuration="4.173952112s" totalImagesPullingTime="3.029094651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:07.163283161 +0000 UTC m=+188.853936462" watchObservedRunningTime="2026-10-29 23:17:07.173952112 +0000 UTC m=+188.864605420" Oct 29 23:17:08.119122 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:08.119073 5976 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7876bfcb74-jwsps container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:17:08.119791 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:08.119145 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" podUID="a59501ea-9816-4342-95ae-17028d5b8da4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:17:10.124936 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:10.124897 5976 generic.go:356] "Generic (PLEG): container finished" podID="def4a198-3efe-42a6-8a33-89694ee30415" containerID="f32a5fc4fea45bbb7cacdafb78f960e641615353b95037ecb113148dad738ab4" exitCode=0 Oct 29 23:17:10.125396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:10.124953 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" event={"ID":"def4a198-3efe-42a6-8a33-89694ee30415","Type":"ContainerDied","Data":"f32a5fc4fea45bbb7cacdafb78f960e641615353b95037ecb113148dad738ab4"} Oct 29 23:17:11.118036 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:11.118002 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:17:13.137258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:13.137219 5976 generic.go:356] "Generic (PLEG): container finished" podID="def4a198-3efe-42a6-8a33-89694ee30415" containerID="6aad012cba7228da66cd542c7589fea1a4202a93c6badf803213f9c9f1d5eb72" exitCode=0 Oct 29 23:17:13.137691 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:13.137273 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" event={"ID":"def4a198-3efe-42a6-8a33-89694ee30415","Type":"ContainerDied","Data":"6aad012cba7228da66cd542c7589fea1a4202a93c6badf803213f9c9f1d5eb72"} Oct 29 23:17:19.163788 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:19.163752 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" event={"ID":"def4a198-3efe-42a6-8a33-89694ee30415","Type":"ContainerStarted","Data":"1d574216e5968cef038ce2b7a5508e2b0f813fa2aed8a5c842d790f7e82b0bca"} Oct 29 23:17:19.199746 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:19.199703 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" podStartSLOduration=3.515404282 podStartE2EDuration="17.199686914s" totalImagesPullingTime="13.684282632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:19.199215897 +0000 UTC m=+200.889869203" watchObservedRunningTime="2026-10-29 23:17:19.199686914 +0000 UTC m=+200.890340220" Oct 29 23:17:20.168981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:20.168947 5976 generic.go:356] "Generic (PLEG): container finished" podID="def4a198-3efe-42a6-8a33-89694ee30415" containerID="1d574216e5968cef038ce2b7a5508e2b0f813fa2aed8a5c842d790f7e82b0bca" exitCode=0 Oct 29 23:17:20.169374 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:20.168985 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" event={"ID":"def4a198-3efe-42a6-8a33-89694ee30415","Type":"ContainerDied","Data":"1d574216e5968cef038ce2b7a5508e2b0f813fa2aed8a5c842d790f7e82b0bca"} Oct 29 23:17:21.298688 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.298663 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:21.366543 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.366503 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle\") pod \"def4a198-3efe-42a6-8a33-89694ee30415\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " Oct 29 23:17:21.366757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.366666 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util\") pod \"def4a198-3efe-42a6-8a33-89694ee30415\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " Oct 29 23:17:21.366757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.366714 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9\" (UniqueName: \"kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9\") pod \"def4a198-3efe-42a6-8a33-89694ee30415\" (UID: \"def4a198-3efe-42a6-8a33-89694ee30415\") " Oct 29 23:17:21.367311 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.367283 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle" pod "def4a198-3efe-42a6-8a33-89694ee30415" (UID: "def4a198-3efe-42a6-8a33-89694ee30415"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:21.369080 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.369052 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9" pod "def4a198-3efe-42a6-8a33-89694ee30415" (UID: "def4a198-3efe-42a6-8a33-89694ee30415"). InnerVolumeSpecName "kube-api-access-8hgs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:21.371147 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.371127 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util" pod "def4a198-3efe-42a6-8a33-89694ee30415" (UID: "def4a198-3efe-42a6-8a33-89694ee30415"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:21.467966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.467876 5976 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-util\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:17:21.467966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.467912 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hgs9\" (UniqueName: \"kubernetes.io/projected/def4a198-3efe-42a6-8a33-89694ee30415-kube-api-access-8hgs9\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:17:21.467966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:21.467925 5976 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/def4a198-3efe-42a6-8a33-89694ee30415-bundle\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:17:22.182218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:22.182190 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" Oct 29 23:17:22.182390 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:22.182193 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ctnqzw" event={"ID":"def4a198-3efe-42a6-8a33-89694ee30415","Type":"ContainerDied","Data":"e3878b7e70f557eab15f17dd421dc487cb7cafc58c8ebe309e08309a6545f8c9"} Oct 29 23:17:22.182390 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:22.182324 5976 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3878b7e70f557eab15f17dd421dc487cb7cafc58c8ebe309e08309a6545f8c9" Oct 29 23:17:27.253071 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:17:27.253033 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:17:50.203306 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203266 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9"] Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203564 5976 cpu_manager.go:414] "containerMap: removing container" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="pull" Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203576 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="pull" Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203589 5976 cpu_manager.go:414] "containerMap: removing container" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="util" Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203596 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="util" Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203623 5976 cpu_manager.go:414] "containerMap: removing container" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="extract" Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203628 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="extract" Oct 29 23:17:50.205022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.203700 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="def4a198-3efe-42a6-8a33-89694ee30415" containerName="extract" Oct 29 23:17:50.205701 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.205678 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.224675 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.224649 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 29 23:17:50.224931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.224916 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 29 23:17:50.275576 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.275525 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9"] Oct 29 23:17:50.292168 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.292130 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.292168 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.292166 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.292366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.292284 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ad25176-a56f-43d8-900e-08927fac2bd9-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.292366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.292317 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ad25176-a56f-43d8-900e-08927fac2bd9-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.292366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.292348 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.292515 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.292423 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlrf4\" (UniqueName: \"kubernetes.io/projected/0ad25176-a56f-43d8-900e-08927fac2bd9-kube-api-access-wlrf4\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.315958 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.315932 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 29 23:17:50.316235 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.316217 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-5l76q\"" Oct 29 23:17:50.316286 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.316268 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 29 23:17:50.316320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.316302 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 29 23:17:50.393420 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393388 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ad25176-a56f-43d8-900e-08927fac2bd9-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.393643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393433 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ad25176-a56f-43d8-900e-08927fac2bd9-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.393643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393461 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.393643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393487 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlrf4\" (UniqueName: \"kubernetes.io/projected/0ad25176-a56f-43d8-900e-08927fac2bd9-kube-api-access-wlrf4\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.393643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393526 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.393643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393571 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.393989 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.393958 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0ad25176-a56f-43d8-900e-08927fac2bd9-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.396048 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.396019 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ad25176-a56f-43d8-900e-08927fac2bd9-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.396211 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.396189 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.396287 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.396206 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.396340 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.396282 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0ad25176-a56f-43d8-900e-08927fac2bd9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.415102 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.415073 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlrf4\" (UniqueName: \"kubernetes.io/projected/0ad25176-a56f-43d8-900e-08927fac2bd9-kube-api-access-wlrf4\") pod \"opendatahub-operator-controller-manager-5588597fcf-7vkt9\" (UID: \"0ad25176-a56f-43d8-900e-08927fac2bd9\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.519472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.519376 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:50.861902 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:17:50.861873 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad25176_a56f_43d8_900e_08927fac2bd9.slice/crio-9a8b569f87c3769ad27c7b45874253359d02c1089bce284bb34f2a7795249ea1 WatchSource:0}: Error finding container 9a8b569f87c3769ad27c7b45874253359d02c1089bce284bb34f2a7795249ea1: Status 404 returned error can't find the container with id 9a8b569f87c3769ad27c7b45874253359d02c1089bce284bb34f2a7795249ea1 Oct 29 23:17:50.867161 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:50.867135 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9"] Oct 29 23:17:51.281806 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:51.281758 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" event={"ID":"0ad25176-a56f-43d8-900e-08927fac2bd9","Type":"ContainerStarted","Data":"9a8b569f87c3769ad27c7b45874253359d02c1089bce284bb34f2a7795249ea1"} Oct 29 23:17:54.293458 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:54.293424 5976 generic.go:356] "Generic (PLEG): container finished" podID="0ad25176-a56f-43d8-900e-08927fac2bd9" containerID="0ce7ed2793e98addca71ab353e5b5967885fa03bc39ef632b0640256526ffed6" exitCode=0 Oct 29 23:17:54.293875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:54.293478 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" event={"ID":"0ad25176-a56f-43d8-900e-08927fac2bd9","Type":"ContainerDied","Data":"0ce7ed2793e98addca71ab353e5b5967885fa03bc39ef632b0640256526ffed6"} Oct 29 23:17:55.298801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:55.298761 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" event={"ID":"0ad25176-a56f-43d8-900e-08927fac2bd9","Type":"ContainerStarted","Data":"682e632cd2b7c535d264fb2738c51b97540451ce1c79106cbeaf9996cea582f9"} Oct 29 23:17:55.299291 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:55.298888 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:17:55.373255 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:17:55.373195 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" podStartSLOduration=1.874265896 podStartE2EDuration="5.373181885s" totalImagesPullingTime="3.022361324s" totalInitContainerRuntime="476.554665ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:55.362675722 +0000 UTC m=+237.053329028" watchObservedRunningTime="2026-10-29 23:17:55.373181885 +0000 UTC m=+237.063835191" Oct 29 23:17:57.253396 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:17:57.253356 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:18:06.305119 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:06.305091 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-7vkt9" Oct 29 23:18:19.769504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.769469 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc"] Oct 29 23:18:19.771757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.771732 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:19.786412 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.786390 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Oct 29 23:18:19.786535 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.786416 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Oct 29 23:18:19.798162 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.798134 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vxxxb\"" Oct 29 23:18:19.799053 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.799026 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc"] Oct 29 23:18:19.838960 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.838921 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t59j\" (UniqueName: \"kubernetes.io/projected/fe332f4e-4408-4975-ac89-6d9efb52e180-kube-api-access-2t59j\") pod \"cert-manager-webhook-5dbbbf75cc-lvmqc\" (UID: \"fe332f4e-4408-4975-ac89-6d9efb52e180\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:19.839127 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.838987 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe332f4e-4408-4975-ac89-6d9efb52e180-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-lvmqc\" (UID: \"fe332f4e-4408-4975-ac89-6d9efb52e180\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:19.940009 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.939968 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t59j\" (UniqueName: \"kubernetes.io/projected/fe332f4e-4408-4975-ac89-6d9efb52e180-kube-api-access-2t59j\") pod \"cert-manager-webhook-5dbbbf75cc-lvmqc\" (UID: \"fe332f4e-4408-4975-ac89-6d9efb52e180\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:19.940215 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.940025 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe332f4e-4408-4975-ac89-6d9efb52e180-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-lvmqc\" (UID: \"fe332f4e-4408-4975-ac89-6d9efb52e180\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:19.959494 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.959461 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe332f4e-4408-4975-ac89-6d9efb52e180-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-lvmqc\" (UID: \"fe332f4e-4408-4975-ac89-6d9efb52e180\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:19.959654 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:19.959527 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t59j\" (UniqueName: \"kubernetes.io/projected/fe332f4e-4408-4975-ac89-6d9efb52e180-kube-api-access-2t59j\") pod \"cert-manager-webhook-5dbbbf75cc-lvmqc\" (UID: \"fe332f4e-4408-4975-ac89-6d9efb52e180\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:20.093233 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:20.093141 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:20.388749 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:20.388674 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc"] Oct 29 23:18:20.392767 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:18:20.392738 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe332f4e_4408_4975_ac89_6d9efb52e180.slice/crio-dfe2c9286444181f697e44a33ee776819d1874c39e05ae17215b70d05796a363 WatchSource:0}: Error finding container dfe2c9286444181f697e44a33ee776819d1874c39e05ae17215b70d05796a363: Status 404 returned error can't find the container with id dfe2c9286444181f697e44a33ee776819d1874c39e05ae17215b70d05796a363 Oct 29 23:18:21.390933 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:21.390896 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" event={"ID":"fe332f4e-4408-4975-ac89-6d9efb52e180","Type":"ContainerStarted","Data":"dfe2c9286444181f697e44a33ee776819d1874c39e05ae17215b70d05796a363"} Oct 29 23:18:23.399744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:23.399705 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" event={"ID":"fe332f4e-4408-4975-ac89-6d9efb52e180","Type":"ContainerStarted","Data":"7d867d02079e15abff40a90cbe5392c672ec5be4337af5761459951becc82e9e"} Oct 29 23:18:23.400178 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:23.399850 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:23.439051 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:23.438983 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" podStartSLOduration=1.733274424 podStartE2EDuration="4.438963689s" totalImagesPullingTime="2.705689265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:23.437569277 +0000 UTC m=+265.128222584" watchObservedRunningTime="2026-10-29 23:18:23.438963689 +0000 UTC m=+265.129616998" Oct 29 23:18:24.924718 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:24.924683 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz"] Oct 29 23:18:24.931287 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:24.931263 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:24.959890 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:24.959859 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz"] Oct 29 23:18:24.986313 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:24.986272 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7ad47e6-9afd-477f-b43d-abda37e95a84-tmp\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:24.986487 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:24.986400 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnvvv\" (UniqueName: \"kubernetes.io/projected/b7ad47e6-9afd-477f-b43d-abda37e95a84-kube-api-access-cnvvv\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:24.986487 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:24.986425 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ad47e6-9afd-477f-b43d-abda37e95a84-tls-certs\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.000171 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.000144 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r9wbl\"" Oct 29 23:18:25.000171 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.000161 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 29 23:18:25.000354 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.000149 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 29 23:18:25.087064 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.087026 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnvvv\" (UniqueName: \"kubernetes.io/projected/b7ad47e6-9afd-477f-b43d-abda37e95a84-kube-api-access-cnvvv\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.087064 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.087065 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ad47e6-9afd-477f-b43d-abda37e95a84-tls-certs\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.087361 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.087106 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7ad47e6-9afd-477f-b43d-abda37e95a84-tmp\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.089491 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.089464 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7ad47e6-9afd-477f-b43d-abda37e95a84-tmp\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.089744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.089726 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7ad47e6-9afd-477f-b43d-abda37e95a84-tls-certs\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.111398 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.111373 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnvvv\" (UniqueName: \"kubernetes.io/projected/b7ad47e6-9afd-477f-b43d-abda37e95a84-kube-api-access-cnvvv\") pod \"kube-auth-proxy-57dbfbcbdf-z72pz\" (UID: \"b7ad47e6-9afd-477f-b43d-abda37e95a84\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.244574 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.244486 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" Oct 29 23:18:25.552244 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:25.552169 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz"] Oct 29 23:18:25.554472 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:18:25.554442 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ad47e6_9afd_477f_b43d_abda37e95a84.slice/crio-426d78f8a53bb76cb8d2006b964f8fb26dd1d3c3c011b070f52cba832325e9b1 WatchSource:0}: Error finding container 426d78f8a53bb76cb8d2006b964f8fb26dd1d3c3c011b070f52cba832325e9b1: Status 404 returned error can't find the container with id 426d78f8a53bb76cb8d2006b964f8fb26dd1d3c3c011b070f52cba832325e9b1 Oct 29 23:18:26.412130 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:26.412088 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" event={"ID":"b7ad47e6-9afd-477f-b43d-abda37e95a84","Type":"ContainerStarted","Data":"426d78f8a53bb76cb8d2006b964f8fb26dd1d3c3c011b070f52cba832325e9b1"} Oct 29 23:18:27.260066 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:18:27.260023 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:18:28.422133 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:28.422097 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" event={"ID":"b7ad47e6-9afd-477f-b43d-abda37e95a84","Type":"ContainerStarted","Data":"c014a97e05032e546423d55a07365fd3d244df35a23f46d0f9b771b9f7531fb5"} Oct 29 23:18:28.466495 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:28.466441 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-z72pz" podStartSLOduration=2.246636292 podStartE2EDuration="4.466426836s" totalImagesPullingTime="2.219790544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:28.466098003 +0000 UTC m=+270.156751311" watchObservedRunningTime="2026-10-29 23:18:28.466426836 +0000 UTC m=+270.157080139" Oct 29 23:18:29.405536 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:29.405501 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-lvmqc" Oct 29 23:18:49.688762 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.688681 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:18:49.692682 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.692659 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:49.707172 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.707153 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 29 23:18:49.707281 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.707163 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 29 23:18:49.719138 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.719114 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Oct 29 23:18:49.719242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.719126 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hvkkc\"" Oct 29 23:18:49.720099 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.720082 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:18:49.798188 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.798159 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prbhd\" (UniqueName: \"kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd\") pod \"limitador-limitador-74dfcfb894-fnbcv\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:49.798400 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.798221 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file\") pod \"limitador-limitador-74dfcfb894-fnbcv\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:49.824302 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.824271 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:18:49.901007 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.900970 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbhd\" (UniqueName: \"kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd\") pod \"limitador-limitador-74dfcfb894-fnbcv\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:49.901007 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.901066 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file\") pod \"limitador-limitador-74dfcfb894-fnbcv\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:49.901740 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.901719 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file\") pod \"limitador-limitador-74dfcfb894-fnbcv\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:49.920948 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:49.920916 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prbhd\" (UniqueName: \"kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd\") pod \"limitador-limitador-74dfcfb894-fnbcv\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:50.004641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:50.004530 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:50.298115 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:50.298042 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:18:50.301869 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:18:50.301838 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60dace05_ab87_4675_80ec_db0892ec41ec.slice/crio-c95289cc446cdb05d6f36787452dfb0b9bd1b397bd3a209e30543b5669abb03a WatchSource:0}: Error finding container c95289cc446cdb05d6f36787452dfb0b9bd1b397bd3a209e30543b5669abb03a: Status 404 returned error can't find the container with id c95289cc446cdb05d6f36787452dfb0b9bd1b397bd3a209e30543b5669abb03a Oct 29 23:18:50.502092 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:50.502056 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" event={"ID":"60dace05-ab87-4675-80ec-db0892ec41ec","Type":"ContainerStarted","Data":"c95289cc446cdb05d6f36787452dfb0b9bd1b397bd3a209e30543b5669abb03a"} Oct 29 23:18:51.114632 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.114537 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cmmgt"] Oct 29 23:18:51.118571 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.118534 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:18:51.138234 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.138207 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s8gcm\"" Oct 29 23:18:51.151128 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.151095 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cmmgt"] Oct 29 23:18:51.211361 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.211319 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjw2j\" (UniqueName: \"kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j\") pod \"authorino-56c6c9ddd5-cmmgt\" (UID: \"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb\") " pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:18:51.312285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.312253 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjw2j\" (UniqueName: \"kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j\") pod \"authorino-56c6c9ddd5-cmmgt\" (UID: \"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb\") " pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:18:51.331531 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.331500 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjw2j\" (UniqueName: \"kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j\") pod \"authorino-56c6c9ddd5-cmmgt\" (UID: \"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb\") " pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:18:51.434762 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.434727 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:18:51.730397 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:51.730325 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cmmgt"] Oct 29 23:18:51.733452 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:18:51.733418 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce44ae8f_88f8_47e0_ae46_a40fd7c4adfb.slice/crio-69aaf5b8d70fea6b827180536b5f561996a01c0f98be91bc947e8279c699685c WatchSource:0}: Error finding container 69aaf5b8d70fea6b827180536b5f561996a01c0f98be91bc947e8279c699685c: Status 404 returned error can't find the container with id 69aaf5b8d70fea6b827180536b5f561996a01c0f98be91bc947e8279c699685c Oct 29 23:18:52.514575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:52.514514 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" event={"ID":"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb","Type":"ContainerStarted","Data":"69aaf5b8d70fea6b827180536b5f561996a01c0f98be91bc947e8279c699685c"} Oct 29 23:18:53.520072 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:53.520039 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" event={"ID":"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb","Type":"ContainerStarted","Data":"154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b"} Oct 29 23:18:53.521622 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:53.521592 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" event={"ID":"60dace05-ab87-4675-80ec-db0892ec41ec","Type":"ContainerStarted","Data":"2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb"} Oct 29 23:18:53.521728 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:53.521697 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:18:53.556458 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:53.556410 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" podStartSLOduration=0.83298412 podStartE2EDuration="2.556398404s" totalImagesPullingTime="1.723414284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:53.556075668 +0000 UTC m=+295.246728978" watchObservedRunningTime="2026-10-29 23:18:53.556398404 +0000 UTC m=+295.247051713" Oct 29 23:18:53.601273 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:18:53.601219 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" podStartSLOduration=2.092940221 podStartE2EDuration="4.601201697s" totalImagesPullingTime="2.508261476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:53.600339529 +0000 UTC m=+295.290992838" watchObservedRunningTime="2026-10-29 23:18:53.601201697 +0000 UTC m=+295.291855004" Oct 29 23:18:57.253689 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:18:57.253650 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:19:04.526513 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:04.526481 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:19:04.608812 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:04.608772 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:19:04.609014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:04.608967 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" podUID="60dace05-ab87-4675-80ec-db0892ec41ec" containerName="limitador" containerID="cri-o://2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb" gracePeriod=30 Oct 29 23:19:05.547214 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.547188 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:19:05.569880 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.569852 5976 generic.go:356] "Generic (PLEG): container finished" podID="60dace05-ab87-4675-80ec-db0892ec41ec" containerID="2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb" exitCode=0 Oct 29 23:19:05.570035 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.569894 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" Oct 29 23:19:05.570035 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.569930 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" event={"ID":"60dace05-ab87-4675-80ec-db0892ec41ec","Type":"ContainerDied","Data":"2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb"} Oct 29 23:19:05.570035 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.569992 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-fnbcv" event={"ID":"60dace05-ab87-4675-80ec-db0892ec41ec","Type":"ContainerDied","Data":"c95289cc446cdb05d6f36787452dfb0b9bd1b397bd3a209e30543b5669abb03a"} Oct 29 23:19:05.570035 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.570020 5976 scope.go:122] "RemoveContainer" containerID="2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb" Oct 29 23:19:05.579408 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.579385 5976 scope.go:122] "RemoveContainer" containerID="2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb" Oct 29 23:19:05.579751 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:19:05.579731 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb\": container with ID starting with 2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb not found: ID does not exist" containerID="2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb" Oct 29 23:19:05.579853 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.579763 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb"} err="failed to get container status \"2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb\": rpc error: code = NotFound desc = could not find container \"2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb\": container with ID starting with 2127e80fdc56a38b32638b9e675f4a24ff45b8b44e2ce4df0a38a24e80ffbafb not found: ID does not exist" Oct 29 23:19:05.638320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.638279 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file\" (UniqueName: \"kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file\") pod \"60dace05-ab87-4675-80ec-db0892ec41ec\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " Oct 29 23:19:05.638508 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.638351 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd\" (UniqueName: \"kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd\") pod \"60dace05-ab87-4675-80ec-db0892ec41ec\" (UID: \"60dace05-ab87-4675-80ec-db0892ec41ec\") " Oct 29 23:19:05.638719 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.638697 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file" pod "60dace05-ab87-4675-80ec-db0892ec41ec" (UID: "60dace05-ab87-4675-80ec-db0892ec41ec"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:19:05.640791 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.640763 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd" pod "60dace05-ab87-4675-80ec-db0892ec41ec" (UID: "60dace05-ab87-4675-80ec-db0892ec41ec"). InnerVolumeSpecName "kube-api-access-prbhd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:05.739809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.739703 5976 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60dace05-ab87-4675-80ec-db0892ec41ec-config-file\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:05.739809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.739751 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prbhd\" (UniqueName: \"kubernetes.io/projected/60dace05-ab87-4675-80ec-db0892ec41ec-kube-api-access-prbhd\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:05.912496 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.912465 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:19:05.924352 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:05.924319 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-fnbcv"] Oct 29 23:19:06.427200 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:06.427166 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60dace05-ab87-4675-80ec-db0892ec41ec" path="/var/lib/kubelet/pods/60dace05-ab87-4675-80ec-db0892ec41ec/volumes" Oct 29 23:19:07.856173 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.856140 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn"] Oct 29 23:19:07.856633 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.856467 5976 cpu_manager.go:414] "containerMap: removing container" podUID="60dace05-ab87-4675-80ec-db0892ec41ec" containerName="limitador" Oct 29 23:19:07.856633 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.856478 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60dace05-ab87-4675-80ec-db0892ec41ec" containerName="limitador" Oct 29 23:19:07.856633 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.856544 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="60dace05-ab87-4675-80ec-db0892ec41ec" containerName="limitador" Oct 29 23:19:07.859191 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.859166 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:07.874221 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.874195 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7n8qw\"" Oct 29 23:19:07.886409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.886380 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:19:07.886664 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.886598 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:19:07.887451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.887429 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn"] Oct 29 23:19:07.961742 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.961701 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f71f6b1-8b9f-4220-b2d1-1c6435911ce6-data\") pod \"postgres-7cdbf6dc44-wssrn\" (UID: \"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:07.961926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.961753 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqf7s\" (UniqueName: \"kubernetes.io/projected/4f71f6b1-8b9f-4220-b2d1-1c6435911ce6-kube-api-access-fqf7s\") pod \"postgres-7cdbf6dc44-wssrn\" (UID: \"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:07.967312 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:07.967289 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Oct 29 23:19:08.062714 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.062673 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f71f6b1-8b9f-4220-b2d1-1c6435911ce6-data\") pod \"postgres-7cdbf6dc44-wssrn\" (UID: \"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:08.062900 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.062732 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqf7s\" (UniqueName: \"kubernetes.io/projected/4f71f6b1-8b9f-4220-b2d1-1c6435911ce6-kube-api-access-fqf7s\") pod \"postgres-7cdbf6dc44-wssrn\" (UID: \"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:08.063091 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.063070 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4f71f6b1-8b9f-4220-b2d1-1c6435911ce6-data\") pod \"postgres-7cdbf6dc44-wssrn\" (UID: \"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:08.082266 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.082234 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqf7s\" (UniqueName: \"kubernetes.io/projected/4f71f6b1-8b9f-4220-b2d1-1c6435911ce6-kube-api-access-fqf7s\") pod \"postgres-7cdbf6dc44-wssrn\" (UID: \"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:08.171037 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.171003 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:08.462150 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.462065 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn"] Oct 29 23:19:08.465733 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:19:08.465702 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f71f6b1_8b9f_4220_b2d1_1c6435911ce6.slice/crio-d68769ef22703a610ffa09139f05e7489f49c6f9a95ddf9dff4d9af1654a6332 WatchSource:0}: Error finding container d68769ef22703a610ffa09139f05e7489f49c6f9a95ddf9dff4d9af1654a6332: Status 404 returned error can't find the container with id d68769ef22703a610ffa09139f05e7489f49c6f9a95ddf9dff4d9af1654a6332 Oct 29 23:19:08.585248 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:08.585207 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" event={"ID":"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6","Type":"ContainerStarted","Data":"d68769ef22703a610ffa09139f05e7489f49c6f9a95ddf9dff4d9af1654a6332"} Oct 29 23:19:13.608787 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:13.608753 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" event={"ID":"4f71f6b1-8b9f-4220-b2d1-1c6435911ce6","Type":"ContainerStarted","Data":"e28a33fce1cc026d1cfad7ba925754416921930481dcfcd0d3fa84655191adca"} Oct 29 23:19:13.609288 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:13.608854 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:13.645019 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:13.644969 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" podStartSLOduration=1.609963831 podStartE2EDuration="6.644956616s" totalImagesPullingTime="5.034992785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:13.644358989 +0000 UTC m=+315.335012295" watchObservedRunningTime="2026-10-29 23:19:13.644956616 +0000 UTC m=+315.335609923" Oct 29 23:19:19.642778 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:19.642750 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-wssrn" Oct 29 23:19:22.972597 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:22.972544 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk"] Oct 29 23:19:22.979577 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:22.979536 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.010335 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.010300 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk"] Oct 29 23:19:23.082593 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082538 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qghx\" (UniqueName: \"kubernetes.io/projected/930fc656-25ef-4cf6-8248-49e5cbb51b08-kube-api-access-2qghx\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.082593 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082596 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.082875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082680 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/930fc656-25ef-4cf6-8248-49e5cbb51b08-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.082875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082787 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.082875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082828 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.083043 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082876 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.083043 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.082968 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.183896 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.183856 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/930fc656-25ef-4cf6-8248-49e5cbb51b08-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.184075 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.183908 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.184075 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.184042 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.184176 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.184108 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.184176 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.184151 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.184254 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.184207 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qghx\" (UniqueName: \"kubernetes.io/projected/930fc656-25ef-4cf6-8248-49e5cbb51b08-kube-api-access-2qghx\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.184254 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.184242 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.185336 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.185303 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.186750 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.186722 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.186871 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.186725 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.186871 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.186764 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/930fc656-25ef-4cf6-8248-49e5cbb51b08-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.186871 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.186844 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/930fc656-25ef-4cf6-8248-49e5cbb51b08-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.200748 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.200723 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/930fc656-25ef-4cf6-8248-49e5cbb51b08-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.201141 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.201118 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qghx\" (UniqueName: \"kubernetes.io/projected/930fc656-25ef-4cf6-8248-49e5cbb51b08-kube-api-access-2qghx\") pod \"istiod-openshift-gateway-7ddd9cfdc8-652qk\" (UID: \"930fc656-25ef-4cf6-8248-49e5cbb51b08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.291829 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.291743 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:23.600219 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.600138 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk"] Oct 29 23:19:23.603627 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:19:23.603597 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930fc656_25ef_4cf6_8248_49e5cbb51b08.slice/crio-b95e2bed5c0428e8893b9b003d93650da21b1dd4bd447999d77b108cb02aeac1 WatchSource:0}: Error finding container b95e2bed5c0428e8893b9b003d93650da21b1dd4bd447999d77b108cb02aeac1: Status 404 returned error can't find the container with id b95e2bed5c0428e8893b9b003d93650da21b1dd4bd447999d77b108cb02aeac1 Oct 29 23:19:23.605708 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.605676 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:19:23.605772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.605747 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:19:23.648942 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:23.648913 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" event={"ID":"930fc656-25ef-4cf6-8248-49e5cbb51b08","Type":"ContainerStarted","Data":"b95e2bed5c0428e8893b9b003d93650da21b1dd4bd447999d77b108cb02aeac1"} Oct 29 23:19:24.655015 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:24.654974 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" event={"ID":"930fc656-25ef-4cf6-8248-49e5cbb51b08","Type":"ContainerStarted","Data":"ae03f703d4879430a708a09feb3d33c1eb633a116c15ce9f4a93ac823105240d"} Oct 29 23:19:24.655500 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:24.655213 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:24.656915 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:24.656894 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" Oct 29 23:19:24.701616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:24.701542 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-652qk" podStartSLOduration=2.701527993 podStartE2EDuration="2.701527993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:24.690721455 +0000 UTC m=+326.381374764" watchObservedRunningTime="2026-10-29 23:19:24.701527993 +0000 UTC m=+326.392181299" Oct 29 23:19:24.759448 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:24.759404 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps"] Oct 29 23:19:24.759730 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:24.759675 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" podUID="a59501ea-9816-4342-95ae-17028d5b8da4" containerName="discovery" containerID="cri-o://9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5" gracePeriod=30 Oct 29 23:19:25.051855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.051816 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:19:25.100306 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100273 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100488 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100315 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100488 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100376 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100488 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100421 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100488 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100455 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100488 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100483 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100793 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100526 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22\") pod \"a59501ea-9816-4342-95ae-17028d5b8da4\" (UID: \"a59501ea-9816-4342-95ae-17028d5b8da4\") " Oct 29 23:19:25.100793 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100730 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:19:25.100903 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.100862 5976 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-ca-configmap\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.103570 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.103502 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:19:25.103570 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.103529 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "kube-api-access-8nl22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:25.103797 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.103755 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:19:25.103956 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.103935 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:25.104119 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.104098 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:19:25.104747 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.104721 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert" pod "a59501ea-9816-4342-95ae-17028d5b8da4" (UID: "a59501ea-9816-4342-95ae-17028d5b8da4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:19:25.201934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.201871 5976 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-kubeconfig\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.201934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.201897 5976 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-istio-csr-dns-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.201934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.201907 5976 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-istio-token\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.201934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.201918 5976 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a59501ea-9816-4342-95ae-17028d5b8da4-local-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.201934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.201926 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nl22\" (UniqueName: \"kubernetes.io/projected/a59501ea-9816-4342-95ae-17028d5b8da4-kube-api-access-8nl22\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.201934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.201934 5976 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a59501ea-9816-4342-95ae-17028d5b8da4-cacerts\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:25.660987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.660954 5976 generic.go:356] "Generic (PLEG): container finished" podID="a59501ea-9816-4342-95ae-17028d5b8da4" containerID="9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5" exitCode=0 Oct 29 23:19:25.661395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.661006 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" Oct 29 23:19:25.661395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.661044 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" event={"ID":"a59501ea-9816-4342-95ae-17028d5b8da4","Type":"ContainerDied","Data":"9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5"} Oct 29 23:19:25.661395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.661096 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps" event={"ID":"a59501ea-9816-4342-95ae-17028d5b8da4","Type":"ContainerDied","Data":"229d9c626269f449f7a5a3e0adc1ea06ed5aa0ddf240c40cf87535fdc97dfc33"} Oct 29 23:19:25.661395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.661116 5976 scope.go:122] "RemoveContainer" containerID="9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5" Oct 29 23:19:25.670475 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.670457 5976 scope.go:122] "RemoveContainer" containerID="9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5" Oct 29 23:19:25.670770 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:19:25.670754 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5\": container with ID starting with 9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5 not found: ID does not exist" containerID="9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5" Oct 29 23:19:25.670827 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.670779 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5"} err="failed to get container status \"9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5\": rpc error: code = NotFound desc = could not find container \"9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5\": container with ID starting with 9d2ff2859bd5a0022a1457b04670df7053510400a9b5a467407d674b305845f5 not found: ID does not exist" Oct 29 23:19:25.705873 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.705846 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps"] Oct 29 23:19:25.716162 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:25.716132 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7876bfcb74-jwsps"] Oct 29 23:19:26.427531 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.427500 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a59501ea-9816-4342-95ae-17028d5b8da4" path="/var/lib/kubelet/pods/a59501ea-9816-4342-95ae-17028d5b8da4/volumes" Oct 29 23:19:26.666713 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.666682 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b4845f54d-8nmlc"] Oct 29 23:19:26.667094 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.667021 5976 cpu_manager.go:414] "containerMap: removing container" podUID="a59501ea-9816-4342-95ae-17028d5b8da4" containerName="discovery" Oct 29 23:19:26.667094 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.667033 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a59501ea-9816-4342-95ae-17028d5b8da4" containerName="discovery" Oct 29 23:19:26.667160 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.667101 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="a59501ea-9816-4342-95ae-17028d5b8da4" containerName="discovery" Oct 29 23:19:26.787176 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.787103 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b4845f54d-8nmlc"] Oct 29 23:19:26.787325 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.787222 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.800880 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.800855 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 29 23:19:26.810729 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.810710 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 29 23:19:26.810839 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.810820 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Oct 29 23:19:26.818344 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.818322 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n42lj\" (UniqueName: \"kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.818424 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.818363 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.818424 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.818392 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.862654 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.862615 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tw72w\"" Oct 29 23:19:26.862654 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.862626 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Oct 29 23:19:26.862842 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.862674 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Oct 29 23:19:26.919088 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.919049 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n42lj\" (UniqueName: \"kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.919285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.919098 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.919285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.919216 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.921888 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.921862 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.922005 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.921908 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:26.939208 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:26.939181 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n42lj\" (UniqueName: \"kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj\") pod \"maas-controller-b4845f54d-8nmlc\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:27.104760 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.104672 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:27.164972 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.164947 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b7d4f89c-l4v7h"] Oct 29 23:19:27.207420 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.207386 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b7d4f89c-l4v7h"] Oct 29 23:19:27.207588 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.207487 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.254233 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:19:27.254196 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:19:27.321885 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.321846 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d81acc9a-21a9-451d-af68-00f13882fe45-webhook-cert\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.322055 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.321886 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bwf5\" (UniqueName: \"kubernetes.io/projected/d81acc9a-21a9-451d-af68-00f13882fe45-kube-api-access-7bwf5\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.322055 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.322010 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81acc9a-21a9-451d-af68-00f13882fe45-metrics-certs\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.408626 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.408581 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b4845f54d-8nmlc"] Oct 29 23:19:27.413389 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:19:27.413360 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1934a3a0_9205_4a20_b457_d4743257761c.slice/crio-f0e38569e7fdf33480b16f10992044417cc0dd771e4a4ae71f83daf662bbfff7 WatchSource:0}: Error finding container f0e38569e7fdf33480b16f10992044417cc0dd771e4a4ae71f83daf662bbfff7: Status 404 returned error can't find the container with id f0e38569e7fdf33480b16f10992044417cc0dd771e4a4ae71f83daf662bbfff7 Oct 29 23:19:27.414846 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.414828 5976 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:19:27.422981 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.422955 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81acc9a-21a9-451d-af68-00f13882fe45-metrics-certs\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.423080 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.423007 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d81acc9a-21a9-451d-af68-00f13882fe45-webhook-cert\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.423080 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.423038 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bwf5\" (UniqueName: \"kubernetes.io/projected/d81acc9a-21a9-451d-af68-00f13882fe45-kube-api-access-7bwf5\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.425569 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.425530 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d81acc9a-21a9-451d-af68-00f13882fe45-metrics-certs\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.425655 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.425579 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d81acc9a-21a9-451d-af68-00f13882fe45-webhook-cert\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.441675 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.441653 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bwf5\" (UniqueName: \"kubernetes.io/projected/d81acc9a-21a9-451d-af68-00f13882fe45-kube-api-access-7bwf5\") pod \"maas-controller-69b7d4f89c-l4v7h\" (UID: \"d81acc9a-21a9-451d-af68-00f13882fe45\") " pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.539834 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.539800 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:27.671176 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.671091 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4845f54d-8nmlc" event={"ID":"1934a3a0-9205-4a20-b457-d4743257761c","Type":"ContainerStarted","Data":"f0e38569e7fdf33480b16f10992044417cc0dd771e4a4ae71f83daf662bbfff7"} Oct 29 23:19:27.862504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:27.862468 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b7d4f89c-l4v7h"] Oct 29 23:19:27.866210 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:19:27.866182 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd81acc9a_21a9_451d_af68_00f13882fe45.slice/crio-b109f86ae01c2758aca1a435e2b7d5b250b2e4750c9019e4676f3d36fceb291f WatchSource:0}: Error finding container b109f86ae01c2758aca1a435e2b7d5b250b2e4750c9019e4676f3d36fceb291f: Status 404 returned error can't find the container with id b109f86ae01c2758aca1a435e2b7d5b250b2e4750c9019e4676f3d36fceb291f Oct 29 23:19:28.678086 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:28.678046 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" event={"ID":"d81acc9a-21a9-451d-af68-00f13882fe45","Type":"ContainerStarted","Data":"b109f86ae01c2758aca1a435e2b7d5b250b2e4750c9019e4676f3d36fceb291f"} Oct 29 23:19:30.690945 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:30.690853 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" event={"ID":"d81acc9a-21a9-451d-af68-00f13882fe45","Type":"ContainerStarted","Data":"9fb7f2127cd5c0773f3436082e9d9ab67b878c01cfbba2ed5c7b43a20986a1cc"} Oct 29 23:19:30.691396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:30.691046 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:30.692624 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:30.692602 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4845f54d-8nmlc" event={"ID":"1934a3a0-9205-4a20-b457-d4743257761c","Type":"ContainerStarted","Data":"434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4"} Oct 29 23:19:30.692765 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:30.692746 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:30.730497 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:30.730434 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" podStartSLOduration=1.161906867 podStartE2EDuration="3.730421289s" totalImagesPullingTime="2.568514422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:30.729840469 +0000 UTC m=+332.420493776" watchObservedRunningTime="2026-10-29 23:19:30.730421289 +0000 UTC m=+332.421074590" Oct 29 23:19:30.769226 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:30.766445 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-b4845f54d-8nmlc" podStartSLOduration=2.025336136 podStartE2EDuration="4.766427615s" totalImagesPullingTime="2.741091479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:30.764840494 +0000 UTC m=+332.455493802" watchObservedRunningTime="2026-10-29 23:19:30.766427615 +0000 UTC m=+332.457080923" Oct 29 23:19:32.152997 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.152959 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w"] Oct 29 23:19:32.156339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.156315 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.170583 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.170539 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Oct 29 23:19:32.180317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.180290 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-5p6rc\"" Oct 29 23:19:32.182390 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.182360 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w"] Oct 29 23:19:32.203532 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.203501 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Oct 29 23:19:32.203727 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.203634 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Oct 29 23:19:32.263041 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.263005 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/1b19475e-e48a-46cb-b068-0ad4f09ede27-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.263231 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.263049 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b19475e-e48a-46cb-b068-0ad4f09ede27-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.263231 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.263076 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d8k\" (UniqueName: \"kubernetes.io/projected/1b19475e-e48a-46cb-b068-0ad4f09ede27-kube-api-access-47d8k\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.263231 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.263142 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b19475e-e48a-46cb-b068-0ad4f09ede27-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.364061 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.364023 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/1b19475e-e48a-46cb-b068-0ad4f09ede27-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.364259 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.364076 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b19475e-e48a-46cb-b068-0ad4f09ede27-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.364259 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.364112 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d8k\" (UniqueName: \"kubernetes.io/projected/1b19475e-e48a-46cb-b068-0ad4f09ede27-kube-api-access-47d8k\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.364259 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.364145 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b19475e-e48a-46cb-b068-0ad4f09ede27-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.364910 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.364883 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b19475e-e48a-46cb-b068-0ad4f09ede27-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.365084 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.365070 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/1b19475e-e48a-46cb-b068-0ad4f09ede27-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.366783 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.366760 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b19475e-e48a-46cb-b068-0ad4f09ede27-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.381409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.381378 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d8k\" (UniqueName: \"kubernetes.io/projected/1b19475e-e48a-46cb-b068-0ad4f09ede27-kube-api-access-47d8k\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-j5n6w\" (UID: \"1b19475e-e48a-46cb-b068-0ad4f09ede27\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.469050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.468968 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:32.765763 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:32.765682 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w"] Oct 29 23:19:32.769386 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:19:32.769360 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b19475e_e48a_46cb_b068_0ad4f09ede27.slice/crio-bbfce4f53c89235c6e0642862be17df2fdebff4a146b20f7b06caf833129b7d0 WatchSource:0}: Error finding container bbfce4f53c89235c6e0642862be17df2fdebff4a146b20f7b06caf833129b7d0: Status 404 returned error can't find the container with id bbfce4f53c89235c6e0642862be17df2fdebff4a146b20f7b06caf833129b7d0 Oct 29 23:19:33.705528 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:33.705486 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" event={"ID":"1b19475e-e48a-46cb-b068-0ad4f09ede27","Type":"ContainerStarted","Data":"bbfce4f53c89235c6e0642862be17df2fdebff4a146b20f7b06caf833129b7d0"} Oct 29 23:19:41.698972 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:41.698939 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b7d4f89c-l4v7h" Oct 29 23:19:41.699472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:41.699015 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:41.765202 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:41.765162 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b4845f54d-8nmlc"] Oct 29 23:19:41.765787 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:41.765732 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-b4845f54d-8nmlc" podUID="1934a3a0-9205-4a20-b457-d4743257761c" containerName="manager" containerID="cri-o://434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4" gracePeriod=30 Oct 29 23:19:42.044100 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.044066 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:42.156916 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.156883 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert\") pod \"1934a3a0-9205-4a20-b457-d4743257761c\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " Oct 29 23:19:42.157095 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.156990 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs\") pod \"1934a3a0-9205-4a20-b457-d4743257761c\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " Oct 29 23:19:42.157095 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.157032 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj\" (UniqueName: \"kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj\") pod \"1934a3a0-9205-4a20-b457-d4743257761c\" (UID: \"1934a3a0-9205-4a20-b457-d4743257761c\") " Oct 29 23:19:42.159956 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.159856 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj" pod "1934a3a0-9205-4a20-b457-d4743257761c" (UID: "1934a3a0-9205-4a20-b457-d4743257761c"). InnerVolumeSpecName "kube-api-access-n42lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:19:42.159956 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.159934 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs" pod "1934a3a0-9205-4a20-b457-d4743257761c" (UID: "1934a3a0-9205-4a20-b457-d4743257761c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:19:42.160139 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.160028 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert" pod "1934a3a0-9205-4a20-b457-d4743257761c" (UID: "1934a3a0-9205-4a20-b457-d4743257761c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:19:42.258216 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.258137 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:42.258216 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.258174 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n42lj\" (UniqueName: \"kubernetes.io/projected/1934a3a0-9205-4a20-b457-d4743257761c-kube-api-access-n42lj\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:42.258216 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.258185 5976 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1934a3a0-9205-4a20-b457-d4743257761c-webhook-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:19:42.752005 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.751974 5976 generic.go:356] "Generic (PLEG): container finished" podID="1934a3a0-9205-4a20-b457-d4743257761c" containerID="434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4" exitCode=0 Oct 29 23:19:42.752426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.752015 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4845f54d-8nmlc" event={"ID":"1934a3a0-9205-4a20-b457-d4743257761c","Type":"ContainerDied","Data":"434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4"} Oct 29 23:19:42.752426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.752041 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b4845f54d-8nmlc" Oct 29 23:19:42.752426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.752066 5976 scope.go:122] "RemoveContainer" containerID="434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4" Oct 29 23:19:42.752426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.752056 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b4845f54d-8nmlc" event={"ID":"1934a3a0-9205-4a20-b457-d4743257761c","Type":"ContainerDied","Data":"f0e38569e7fdf33480b16f10992044417cc0dd771e4a4ae71f83daf662bbfff7"} Oct 29 23:19:42.761724 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.761699 5976 scope.go:122] "RemoveContainer" containerID="434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4" Oct 29 23:19:42.762144 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:19:42.762117 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4\": container with ID starting with 434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4 not found: ID does not exist" containerID="434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4" Oct 29 23:19:42.762244 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.762156 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4"} err="failed to get container status \"434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4\": rpc error: code = NotFound desc = could not find container \"434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4\": container with ID starting with 434bddb4925491a217e1a5db65a14a9d83062b8b1e1d5454638cdf2f203662d4 not found: ID does not exist" Oct 29 23:19:42.794295 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.794260 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b4845f54d-8nmlc"] Oct 29 23:19:42.803334 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:42.803305 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b4845f54d-8nmlc"] Oct 29 23:19:43.757570 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:43.757504 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" event={"ID":"1b19475e-e48a-46cb-b068-0ad4f09ede27","Type":"ContainerStarted","Data":"bea861f8c95fb58a014c299ab4c4e49b6cbd20f4dcb1f6641b8b6bd7b65c9f60"} Oct 29 23:19:43.758033 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:43.757592 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:43.791376 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:43.791317 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" podStartSLOduration=1.3405282889999999 podStartE2EDuration="11.791301889s" totalImagesPullingTime="10.4507736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:43.790355071 +0000 UTC m=+345.481008380" watchObservedRunningTime="2026-10-29 23:19:43.791301889 +0000 UTC m=+345.481955222" Oct 29 23:19:44.427937 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:44.427907 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1934a3a0-9205-4a20-b457-d4743257761c" path="/var/lib/kubelet/pods/1934a3a0-9205-4a20-b457-d4743257761c/volumes" Oct 29 23:19:54.768237 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:19:54.768204 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-j5n6w" Oct 29 23:19:57.254419 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:19:57.254377 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:20:02.669789 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.669753 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p"] Oct 29 23:20:02.670317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.670089 5976 cpu_manager.go:414] "containerMap: removing container" podUID="1934a3a0-9205-4a20-b457-d4743257761c" containerName="manager" Oct 29 23:20:02.670317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.670100 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1934a3a0-9205-4a20-b457-d4743257761c" containerName="manager" Oct 29 23:20:02.670317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.670177 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="1934a3a0-9205-4a20-b457-d4743257761c" containerName="manager" Oct 29 23:20:02.674960 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.674939 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.700739 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.700705 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p"] Oct 29 23:20:02.771893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.771861 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kxcnq\"" Oct 29 23:20:02.771893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.771890 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 29 23:20:02.771893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.771894 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 29 23:20:02.836618 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.836585 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.836801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.836627 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6l2\" (UniqueName: \"kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.836801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.836651 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.836801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.836785 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.938249 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.938163 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.938249 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.938220 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.938451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.938347 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6l2\" (UniqueName: \"kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.938451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.938395 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.939053 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.939030 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.940855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.940834 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.940996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.940903 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.955220 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.955185 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6l2\" (UniqueName: \"kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2\") pod \"maas-api-644f94b5b4-s4t6p\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:02.988158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:02.988120 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:03.285372 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:03.285286 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p"] Oct 29 23:20:03.288534 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:20:03.288506 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6037cf_3a6d_49db_90ea_c9fdac389dae.slice/crio-3728ad7c2590ba999ea5a1a7827d31202f56ee71727d3b9bf24488b951aa585e WatchSource:0}: Error finding container 3728ad7c2590ba999ea5a1a7827d31202f56ee71727d3b9bf24488b951aa585e: Status 404 returned error can't find the container with id 3728ad7c2590ba999ea5a1a7827d31202f56ee71727d3b9bf24488b951aa585e Oct 29 23:20:03.844478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:03.844440 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" event={"ID":"ea6037cf-3a6d-49db-90ea-c9fdac389dae","Type":"ContainerStarted","Data":"3728ad7c2590ba999ea5a1a7827d31202f56ee71727d3b9bf24488b951aa585e"} Oct 29 23:20:05.854966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:05.854931 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" event={"ID":"ea6037cf-3a6d-49db-90ea-c9fdac389dae","Type":"ContainerStarted","Data":"a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921"} Oct 29 23:20:05.855356 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:05.855071 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:05.891807 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:05.891753 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" podStartSLOduration=2.150115671 podStartE2EDuration="3.891737724s" totalImagesPullingTime="1.741622053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:05.891167718 +0000 UTC m=+367.581821037" watchObservedRunningTime="2026-10-29 23:20:05.891737724 +0000 UTC m=+367.582391031" Oct 29 23:20:11.865103 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:11.865027 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:12.629993 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.629956 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-2jmkc"] Oct 29 23:20:12.876466 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.876429 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-2jmkc"] Oct 29 23:20:12.876466 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.876467 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq"] Oct 29 23:20:12.876926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.876568 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:12.892773 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.892748 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-2jmkc"] Oct 29 23:20:12.892773 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.892784 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq"] Oct 29 23:20:12.892938 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.892863 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:12.907122 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:20:12.907083 5976 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-r6wcb], unattached volumes=[], failed to process volumes=[kube-api-access-r6wcb]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" podUID="2a8fe2b7-230b-4f86-87bf-68e911429ba2" Oct 29 23:20:12.920816 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.920789 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28c29e6-4775-4930-92e1-fc23ea504d2a-openshift-service-ca\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:12.920926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.920823 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28c29e6-4775-4930-92e1-fc23ea504d2a-maas-api-tls\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:12.920926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.920854 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbg8\" (UniqueName: \"kubernetes.io/projected/e28c29e6-4775-4930-92e1-fc23ea504d2a-kube-api-access-nzbg8\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:12.921009 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.920921 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6wcb\" (UniqueName: \"kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb\") pod \"authorino-6f6944bcdd-2jmkc\" (UID: \"2a8fe2b7-230b-4f86-87bf-68e911429ba2\") " pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:12.921042 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:12.921030 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28c29e6-4775-4930-92e1-fc23ea504d2a-metrics-certs\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.021802 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.021761 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28c29e6-4775-4930-92e1-fc23ea504d2a-metrics-certs\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.021996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.021813 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28c29e6-4775-4930-92e1-fc23ea504d2a-openshift-service-ca\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.021996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.021844 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28c29e6-4775-4930-92e1-fc23ea504d2a-maas-api-tls\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.021996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.021873 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbg8\" (UniqueName: \"kubernetes.io/projected/e28c29e6-4775-4930-92e1-fc23ea504d2a-kube-api-access-nzbg8\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.021996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.021893 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6wcb\" (UniqueName: \"kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb\") pod \"authorino-6f6944bcdd-2jmkc\" (UID: \"2a8fe2b7-230b-4f86-87bf-68e911429ba2\") " pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:13.022920 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.022895 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28c29e6-4775-4930-92e1-fc23ea504d2a-openshift-service-ca\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.024448 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.024427 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e28c29e6-4775-4930-92e1-fc23ea504d2a-metrics-certs\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.024532 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.024508 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28c29e6-4775-4930-92e1-fc23ea504d2a-maas-api-tls\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.027694 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.027667 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bc79c8845-96wnv"] Oct 29 23:20:13.039172 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.039148 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6wcb\" (UniqueName: \"kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb\") pod \"authorino-6f6944bcdd-2jmkc\" (UID: \"2a8fe2b7-230b-4f86-87bf-68e911429ba2\") " pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:13.039856 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.039835 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbg8\" (UniqueName: \"kubernetes.io/projected/e28c29e6-4775-4930-92e1-fc23ea504d2a-kube-api-access-nzbg8\") pod \"maas-api-67bfc64665-hc2bq\" (UID: \"e28c29e6-4775-4930-92e1-fc23ea504d2a\") " pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.042617 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.042602 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.052460 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.052433 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bc79c8845-96wnv"] Oct 29 23:20:13.054825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.054804 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 29 23:20:13.122648 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.122617 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2lwq\" (UniqueName: \"kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq\") pod \"authorino-5bc79c8845-96wnv\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.122809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.122676 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert\") pod \"authorino-5bc79c8845-96wnv\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.223181 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.223147 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert\") pod \"authorino-5bc79c8845-96wnv\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.223389 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.223231 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2lwq\" (UniqueName: \"kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq\") pod \"authorino-5bc79c8845-96wnv\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.225948 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.225913 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert\") pod \"authorino-5bc79c8845-96wnv\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.229671 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.229648 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:13.239978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.239958 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2lwq\" (UniqueName: \"kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq\") pod \"authorino-5bc79c8845-96wnv\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.367456 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.367423 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:20:13.552800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.552707 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq"] Oct 29 23:20:13.556464 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:20:13.556436 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28c29e6_4775_4930_92e1_fc23ea504d2a.slice/crio-95301bea4d1b5c4f6fe9546d0e52e6d29f2e85da36d81379a46562c9b39d263f WatchSource:0}: Error finding container 95301bea4d1b5c4f6fe9546d0e52e6d29f2e85da36d81379a46562c9b39d263f: Status 404 returned error can't find the container with id 95301bea4d1b5c4f6fe9546d0e52e6d29f2e85da36d81379a46562c9b39d263f Oct 29 23:20:13.675111 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.675075 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bc79c8845-96wnv"] Oct 29 23:20:13.678785 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:20:13.678756 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46c0c396_c47b_45c5_9c24_34d2fee96ad5.slice/crio-24ba7c56b33860ac4ae71aa3c49c885d9414167d635750bf3e5a7b7742790ca0 WatchSource:0}: Error finding container 24ba7c56b33860ac4ae71aa3c49c885d9414167d635750bf3e5a7b7742790ca0: Status 404 returned error can't find the container with id 24ba7c56b33860ac4ae71aa3c49c885d9414167d635750bf3e5a7b7742790ca0 Oct 29 23:20:13.896618 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.896585 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" event={"ID":"e28c29e6-4775-4930-92e1-fc23ea504d2a","Type":"ContainerStarted","Data":"95301bea4d1b5c4f6fe9546d0e52e6d29f2e85da36d81379a46562c9b39d263f"} Oct 29 23:20:13.897845 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.897826 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:13.897950 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.897842 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc79c8845-96wnv" event={"ID":"46c0c396-c47b-45c5-9c24-34d2fee96ad5","Type":"ContainerStarted","Data":"24ba7c56b33860ac4ae71aa3c49c885d9414167d635750bf3e5a7b7742790ca0"} Oct 29 23:20:13.938596 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:13.938536 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:14.030664 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.030627 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb\" (UniqueName: \"kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb\") pod \"2a8fe2b7-230b-4f86-87bf-68e911429ba2\" (UID: \"2a8fe2b7-230b-4f86-87bf-68e911429ba2\") " Oct 29 23:20:14.032921 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.032894 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb" pod "2a8fe2b7-230b-4f86-87bf-68e911429ba2" (UID: "2a8fe2b7-230b-4f86-87bf-68e911429ba2"). InnerVolumeSpecName "kube-api-access-r6wcb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:14.131480 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.131455 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6wcb\" (UniqueName: \"kubernetes.io/projected/2a8fe2b7-230b-4f86-87bf-68e911429ba2-kube-api-access-r6wcb\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:20:14.905274 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.905224 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc79c8845-96wnv" event={"ID":"46c0c396-c47b-45c5-9c24-34d2fee96ad5","Type":"ContainerStarted","Data":"93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277"} Oct 29 23:20:14.906961 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.906938 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-2jmkc" Oct 29 23:20:14.907109 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.906994 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" event={"ID":"e28c29e6-4775-4930-92e1-fc23ea504d2a","Type":"ContainerStarted","Data":"4b42f4a471abfb20ca77616291566773161cd79a9638ac2ef340519b3c11d604"} Oct 29 23:20:14.940865 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.940806 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5bc79c8845-96wnv" podStartSLOduration=1.126801097 podStartE2EDuration="1.94078872s" totalImagesPullingTime="813.987623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:14.940354315 +0000 UTC m=+376.631007623" watchObservedRunningTime="2026-10-29 23:20:14.94078872 +0000 UTC m=+376.631442029" Oct 29 23:20:14.969900 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.964733 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cmmgt"] Oct 29 23:20:14.969900 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.966475 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" podUID="ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" containerName="authorino" containerID="cri-o://154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b" gracePeriod=30 Oct 29 23:20:14.979459 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:14.979398 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" podStartSLOduration=2.456826389 podStartE2EDuration="2.979385504s" totalImagesPullingTime="522.559115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:14.978428184 +0000 UTC m=+376.669081492" watchObservedRunningTime="2026-10-29 23:20:14.979385504 +0000 UTC m=+376.670038811" Oct 29 23:20:15.032985 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.032944 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-2jmkc"] Oct 29 23:20:15.035886 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.035855 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-2jmkc"] Oct 29 23:20:15.264304 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.264275 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:20:15.340964 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.340931 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j\" (UniqueName: \"kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j\") pod \"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb\" (UID: \"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb\") " Oct 29 23:20:15.343241 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.343217 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j" pod "ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" (UID: "ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb"). InnerVolumeSpecName "kube-api-access-rjw2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:15.442594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.442470 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjw2j\" (UniqueName: \"kubernetes.io/projected/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb-kube-api-access-rjw2j\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:20:15.912426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.912391 5976 generic.go:356] "Generic (PLEG): container finished" podID="ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" containerID="154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b" exitCode=0 Oct 29 23:20:15.913011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.912435 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" Oct 29 23:20:15.913011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.912476 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" event={"ID":"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb","Type":"ContainerDied","Data":"154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b"} Oct 29 23:20:15.913011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.912517 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-cmmgt" event={"ID":"ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb","Type":"ContainerDied","Data":"69aaf5b8d70fea6b827180536b5f561996a01c0f98be91bc947e8279c699685c"} Oct 29 23:20:15.913011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.912539 5976 scope.go:122] "RemoveContainer" containerID="154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b" Oct 29 23:20:15.913011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.912867 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:15.921674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.921655 5976 scope.go:122] "RemoveContainer" containerID="154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b" Oct 29 23:20:15.921933 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:20:15.921916 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b\": container with ID starting with 154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b not found: ID does not exist" containerID="154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b" Oct 29 23:20:15.921985 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.921943 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b"} err="failed to get container status \"154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b\": rpc error: code = NotFound desc = could not find container \"154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b\": container with ID starting with 154ab763c71ab7d6405e088f1501f8e68d5c67917b02ba2006fcfc1f8467af0b not found: ID does not exist" Oct 29 23:20:15.954892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.954866 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cmmgt"] Oct 29 23:20:15.963733 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:15.963709 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-cmmgt"] Oct 29 23:20:16.427788 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:16.427756 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2a8fe2b7-230b-4f86-87bf-68e911429ba2" path="/var/lib/kubelet/pods/2a8fe2b7-230b-4f86-87bf-68e911429ba2/volumes" Oct 29 23:20:16.428014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:16.428002 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" path="/var/lib/kubelet/pods/ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb/volumes" Oct 29 23:20:21.923223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:21.923189 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67bfc64665-hc2bq" Oct 29 23:20:21.991370 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:21.991333 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p"] Oct 29 23:20:21.991841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:21.991807 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" podUID="ea6037cf-3a6d-49db-90ea-c9fdac389dae" containerName="maas-api" containerID="cri-o://a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921" gracePeriod=30 Oct 29 23:20:22.223439 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.223409 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:22.288297 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.288268 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs\") pod \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " Oct 29 23:20:22.288489 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.288306 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca\") pod \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " Oct 29 23:20:22.288489 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.288324 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls\") pod \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " Oct 29 23:20:22.288489 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.288407 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2\" (UniqueName: \"kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2\") pod \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\" (UID: \"ea6037cf-3a6d-49db-90ea-c9fdac389dae\") " Oct 29 23:20:22.288758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.288727 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca" pod "ea6037cf-3a6d-49db-90ea-c9fdac389dae" (UID: "ea6037cf-3a6d-49db-90ea-c9fdac389dae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:20:22.290800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.290768 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2" pod "ea6037cf-3a6d-49db-90ea-c9fdac389dae" (UID: "ea6037cf-3a6d-49db-90ea-c9fdac389dae"). InnerVolumeSpecName "kube-api-access-bh6l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:22.290886 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.290801 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs" pod "ea6037cf-3a6d-49db-90ea-c9fdac389dae" (UID: "ea6037cf-3a6d-49db-90ea-c9fdac389dae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:20:22.290886 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.290819 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls" pod "ea6037cf-3a6d-49db-90ea-c9fdac389dae" (UID: "ea6037cf-3a6d-49db-90ea-c9fdac389dae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:20:22.388903 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.388870 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh6l2\" (UniqueName: \"kubernetes.io/projected/ea6037cf-3a6d-49db-90ea-c9fdac389dae-kube-api-access-bh6l2\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:20:22.388903 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.388897 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:20:22.388903 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.388908 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea6037cf-3a6d-49db-90ea-c9fdac389dae-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:20:22.389128 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.388917 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea6037cf-3a6d-49db-90ea-c9fdac389dae-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:20:22.942855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.942819 5976 generic.go:356] "Generic (PLEG): container finished" podID="ea6037cf-3a6d-49db-90ea-c9fdac389dae" containerID="a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921" exitCode=0 Oct 29 23:20:22.943354 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.942876 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" Oct 29 23:20:22.943354 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.942901 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" event={"ID":"ea6037cf-3a6d-49db-90ea-c9fdac389dae","Type":"ContainerDied","Data":"a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921"} Oct 29 23:20:22.943354 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.942958 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p" event={"ID":"ea6037cf-3a6d-49db-90ea-c9fdac389dae","Type":"ContainerDied","Data":"3728ad7c2590ba999ea5a1a7827d31202f56ee71727d3b9bf24488b951aa585e"} Oct 29 23:20:22.943354 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.942981 5976 scope.go:122] "RemoveContainer" containerID="a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921" Oct 29 23:20:22.951329 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.951302 5976 scope.go:122] "RemoveContainer" containerID="a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921" Oct 29 23:20:22.951644 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:20:22.951624 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921\": container with ID starting with a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921 not found: ID does not exist" containerID="a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921" Oct 29 23:20:22.951717 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.951655 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921"} err="failed to get container status \"a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921\": rpc error: code = NotFound desc = could not find container \"a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921\": container with ID starting with a412ddb004702bdf6a7a41fea945b5bea9b9be2d4e789513eaecd8a080ef0921 not found: ID does not exist" Oct 29 23:20:22.984356 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.984330 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p"] Oct 29 23:20:22.993808 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:22.993782 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-644f94b5b4-s4t6p"] Oct 29 23:20:24.428218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:20:24.428184 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea6037cf-3a6d-49db-90ea-c9fdac389dae" path="/var/lib/kubelet/pods/ea6037cf-3a6d-49db-90ea-c9fdac389dae/volumes" Oct 29 23:20:27.253006 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:20:27.252968 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:20:57.253359 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:20:57.253318 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:21:09.279141 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279111 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-5tj8h"] Oct 29 23:21:09.279640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279437 5976 cpu_manager.go:414] "containerMap: removing container" podUID="ea6037cf-3a6d-49db-90ea-c9fdac389dae" containerName="maas-api" Oct 29 23:21:09.279640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279447 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea6037cf-3a6d-49db-90ea-c9fdac389dae" containerName="maas-api" Oct 29 23:21:09.279640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279462 5976 cpu_manager.go:414] "containerMap: removing container" podUID="ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" containerName="authorino" Oct 29 23:21:09.279640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279466 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" containerName="authorino" Oct 29 23:21:09.279640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279536 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce44ae8f-88f8-47e0-ae46-a40fd7c4adfb" containerName="authorino" Oct 29 23:21:09.279640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.279547 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea6037cf-3a6d-49db-90ea-c9fdac389dae" containerName="maas-api" Oct 29 23:21:09.282451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.282428 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.304616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.304568 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Oct 29 23:21:09.304803 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.304745 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-l42wd\"" Oct 29 23:21:09.304803 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.304746 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Oct 29 23:21:09.306231 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.306207 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-5tj8h"] Oct 29 23:21:09.374547 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.374511 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-5tj8h\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.374756 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.374580 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqwhw\" (UniqueName: \"kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw\") pod \"ai-gateway-controller-7d85675f98-5tj8h\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.475715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.475675 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-5tj8h\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.475715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.475727 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqwhw\" (UniqueName: \"kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw\") pod \"ai-gateway-controller-7d85675f98-5tj8h\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.478273 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.478241 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs\") pod \"ai-gateway-controller-7d85675f98-5tj8h\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.492743 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.492712 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqwhw\" (UniqueName: \"kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw\") pod \"ai-gateway-controller-7d85675f98-5tj8h\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.594990 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.594900 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:09.904412 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:09.899923 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-5tj8h"] Oct 29 23:21:09.906261 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:09.906225 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c251ab_75c9_4edf_a620_61fc4d21f843.slice/crio-d301f01d3bd86d5de0fdd45456661312b8ab8a1e9a38c2dcb82cf34655451d95 WatchSource:0}: Error finding container d301f01d3bd86d5de0fdd45456661312b8ab8a1e9a38c2dcb82cf34655451d95: Status 404 returned error can't find the container with id d301f01d3bd86d5de0fdd45456661312b8ab8a1e9a38c2dcb82cf34655451d95 Oct 29 23:21:10.142419 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:10.142370 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" event={"ID":"78c251ab-75c9-4edf-a620-61fc4d21f843","Type":"ContainerStarted","Data":"d301f01d3bd86d5de0fdd45456661312b8ab8a1e9a38c2dcb82cf34655451d95"} Oct 29 23:21:12.152096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:12.152058 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" event={"ID":"78c251ab-75c9-4edf-a620-61fc4d21f843","Type":"ContainerStarted","Data":"b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309"} Oct 29 23:21:12.152620 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:12.152178 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:12.188889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:12.188824 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" podStartSLOduration=1.718525922 podStartE2EDuration="3.18881067s" totalImagesPullingTime="1.470284748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:12.186307483 +0000 UTC m=+433.876960789" watchObservedRunningTime="2026-10-29 23:21:12.18881067 +0000 UTC m=+433.879463977" Oct 29 23:21:13.712101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.712064 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-lfxg6"] Oct 29 23:21:13.715506 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.715480 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:13.728032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.728010 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Oct 29 23:21:13.738110 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.738083 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vnkxc\"" Oct 29 23:21:13.741017 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.740996 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-lfxg6"] Oct 29 23:21:13.779425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.779396 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-t885f"] Oct 29 23:21:13.782885 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.782861 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:13.803345 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.803321 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-t885f"] Oct 29 23:21:13.815388 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.815356 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138dd42f-4b7b-4dda-b27a-79056182c491-plugins-config-volume\") pod \"payload-processing-5f78687d5b-lfxg6\" (UID: \"138dd42f-4b7b-4dda-b27a-79056182c491\") " pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:13.815594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.815547 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d99f\" (UniqueName: \"kubernetes.io/projected/138dd42f-4b7b-4dda-b27a-79056182c491-kube-api-access-5d99f\") pod \"payload-processing-5f78687d5b-lfxg6\" (UID: \"138dd42f-4b7b-4dda-b27a-79056182c491\") " pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:13.916141 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.916102 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/579c94d3-d9cd-4aea-b845-1eb0a4908731-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-t885f\" (UID: \"579c94d3-d9cd-4aea-b845-1eb0a4908731\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:13.916141 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.916146 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d99f\" (UniqueName: \"kubernetes.io/projected/138dd42f-4b7b-4dda-b27a-79056182c491-kube-api-access-5d99f\") pod \"payload-processing-5f78687d5b-lfxg6\" (UID: \"138dd42f-4b7b-4dda-b27a-79056182c491\") " pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:13.916382 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.916165 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffqv4\" (UniqueName: \"kubernetes.io/projected/579c94d3-d9cd-4aea-b845-1eb0a4908731-kube-api-access-ffqv4\") pod \"payload-pre-processing-7b98bb678c-t885f\" (UID: \"579c94d3-d9cd-4aea-b845-1eb0a4908731\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:13.916382 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.916320 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138dd42f-4b7b-4dda-b27a-79056182c491-plugins-config-volume\") pod \"payload-processing-5f78687d5b-lfxg6\" (UID: \"138dd42f-4b7b-4dda-b27a-79056182c491\") " pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:13.917080 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.917056 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/138dd42f-4b7b-4dda-b27a-79056182c491-plugins-config-volume\") pod \"payload-processing-5f78687d5b-lfxg6\" (UID: \"138dd42f-4b7b-4dda-b27a-79056182c491\") " pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:13.933505 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:13.933464 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d99f\" (UniqueName: \"kubernetes.io/projected/138dd42f-4b7b-4dda-b27a-79056182c491-kube-api-access-5d99f\") pod \"payload-processing-5f78687d5b-lfxg6\" (UID: \"138dd42f-4b7b-4dda-b27a-79056182c491\") " pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:14.017437 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.017347 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/579c94d3-d9cd-4aea-b845-1eb0a4908731-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-t885f\" (UID: \"579c94d3-d9cd-4aea-b845-1eb0a4908731\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:14.017437 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.017390 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffqv4\" (UniqueName: \"kubernetes.io/projected/579c94d3-d9cd-4aea-b845-1eb0a4908731-kube-api-access-ffqv4\") pod \"payload-pre-processing-7b98bb678c-t885f\" (UID: \"579c94d3-d9cd-4aea-b845-1eb0a4908731\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:14.018106 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.018081 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/579c94d3-d9cd-4aea-b845-1eb0a4908731-plugins-config-volume\") pod \"payload-pre-processing-7b98bb678c-t885f\" (UID: \"579c94d3-d9cd-4aea-b845-1eb0a4908731\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:14.028256 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.028225 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:14.034190 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.034165 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffqv4\" (UniqueName: \"kubernetes.io/projected/579c94d3-d9cd-4aea-b845-1eb0a4908731-kube-api-access-ffqv4\") pod \"payload-pre-processing-7b98bb678c-t885f\" (UID: \"579c94d3-d9cd-4aea-b845-1eb0a4908731\") " pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:14.095647 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.095611 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:14.319155 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.319078 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5f78687d5b-lfxg6"] Oct 29 23:21:14.322586 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:14.322527 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138dd42f_4b7b_4dda_b27a_79056182c491.slice/crio-900472cf245fd237ded5231a95eea9118c93f23cc40083d953ed3e0e9f851e29 WatchSource:0}: Error finding container 900472cf245fd237ded5231a95eea9118c93f23cc40083d953ed3e0e9f851e29: Status 404 returned error can't find the container with id 900472cf245fd237ded5231a95eea9118c93f23cc40083d953ed3e0e9f851e29 Oct 29 23:21:14.391177 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:14.391149 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7b98bb678c-t885f"] Oct 29 23:21:14.394085 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:14.394056 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579c94d3_d9cd_4aea_b845_1eb0a4908731.slice/crio-07b2fe87523cf90e2c5c53b97237bb68540eca73f5b5f30eae23b5d93b246e3d WatchSource:0}: Error finding container 07b2fe87523cf90e2c5c53b97237bb68540eca73f5b5f30eae23b5d93b246e3d: Status 404 returned error can't find the container with id 07b2fe87523cf90e2c5c53b97237bb68540eca73f5b5f30eae23b5d93b246e3d Oct 29 23:21:15.170472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:15.170427 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" event={"ID":"138dd42f-4b7b-4dda-b27a-79056182c491","Type":"ContainerStarted","Data":"900472cf245fd237ded5231a95eea9118c93f23cc40083d953ed3e0e9f851e29"} Oct 29 23:21:15.172530 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:15.172488 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" event={"ID":"579c94d3-d9cd-4aea-b845-1eb0a4908731","Type":"ContainerStarted","Data":"07b2fe87523cf90e2c5c53b97237bb68540eca73f5b5f30eae23b5d93b246e3d"} Oct 29 23:21:17.183624 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:17.183584 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" event={"ID":"138dd42f-4b7b-4dda-b27a-79056182c491","Type":"ContainerStarted","Data":"9fc63f1be647165f90149a73e9ca025f98f0e4163825986ce1464b352a289b7f"} Oct 29 23:21:17.184127 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:17.183780 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:17.185187 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:17.185159 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" event={"ID":"579c94d3-d9cd-4aea-b845-1eb0a4908731","Type":"ContainerStarted","Data":"79de121e7faeb3145b22eea7f6bcf8a3a07ffb0ab1a2ab471dd54462ee8098b8"} Oct 29 23:21:17.185321 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:17.185282 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:17.221226 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:17.221168 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" podStartSLOduration=1.954547979 podStartE2EDuration="4.221149366s" totalImagesPullingTime="2.266601387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:17.220278806 +0000 UTC m=+438.910932114" watchObservedRunningTime="2026-10-29 23:21:17.221149366 +0000 UTC m=+438.911802651" Oct 29 23:21:17.257124 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:17.257061 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" podStartSLOduration=2.027901307 podStartE2EDuration="4.257049257s" totalImagesPullingTime="2.22914795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:17.255580044 +0000 UTC m=+438.946233348" watchObservedRunningTime="2026-10-29 23:21:17.257049257 +0000 UTC m=+438.947702578" Oct 29 23:21:23.159593 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.159536 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:23.426170 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.426082 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-6645466744-jv9mk"] Oct 29 23:21:23.429803 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.429780 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.451279 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.451251 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6645466744-jv9mk"] Oct 29 23:21:23.505937 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.505906 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkgpk\" (UniqueName: \"kubernetes.io/projected/4d45ecb4-5446-463b-aec6-044fe6da70e4-kube-api-access-vkgpk\") pod \"ai-gateway-controller-6645466744-jv9mk\" (UID: \"4d45ecb4-5446-463b-aec6-044fe6da70e4\") " pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.506113 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.505964 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d45ecb4-5446-463b-aec6-044fe6da70e4-metrics-certs\") pod \"ai-gateway-controller-6645466744-jv9mk\" (UID: \"4d45ecb4-5446-463b-aec6-044fe6da70e4\") " pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.606892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.606855 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d45ecb4-5446-463b-aec6-044fe6da70e4-metrics-certs\") pod \"ai-gateway-controller-6645466744-jv9mk\" (UID: \"4d45ecb4-5446-463b-aec6-044fe6da70e4\") " pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.607061 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.606947 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkgpk\" (UniqueName: \"kubernetes.io/projected/4d45ecb4-5446-463b-aec6-044fe6da70e4-kube-api-access-vkgpk\") pod \"ai-gateway-controller-6645466744-jv9mk\" (UID: \"4d45ecb4-5446-463b-aec6-044fe6da70e4\") " pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.609410 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.609386 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d45ecb4-5446-463b-aec6-044fe6da70e4-metrics-certs\") pod \"ai-gateway-controller-6645466744-jv9mk\" (UID: \"4d45ecb4-5446-463b-aec6-044fe6da70e4\") " pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.624535 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.624499 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkgpk\" (UniqueName: \"kubernetes.io/projected/4d45ecb4-5446-463b-aec6-044fe6da70e4-kube-api-access-vkgpk\") pod \"ai-gateway-controller-6645466744-jv9mk\" (UID: \"4d45ecb4-5446-463b-aec6-044fe6da70e4\") " pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:23.742901 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:23.742812 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:24.035482 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:24.035457 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-6645466744-jv9mk"] Oct 29 23:21:24.041253 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:24.041216 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d45ecb4_5446_463b_aec6_044fe6da70e4.slice/crio-23c1af9f95d9284ea9ce9645f8de68796542b380892cb0651d4d93ca85189661 WatchSource:0}: Error finding container 23c1af9f95d9284ea9ce9645f8de68796542b380892cb0651d4d93ca85189661: Status 404 returned error can't find the container with id 23c1af9f95d9284ea9ce9645f8de68796542b380892cb0651d4d93ca85189661 Oct 29 23:21:24.218472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:24.218437 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" event={"ID":"4d45ecb4-5446-463b-aec6-044fe6da70e4","Type":"ContainerStarted","Data":"23c1af9f95d9284ea9ce9645f8de68796542b380892cb0651d4d93ca85189661"} Oct 29 23:21:25.224293 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:25.224255 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" event={"ID":"4d45ecb4-5446-463b-aec6-044fe6da70e4","Type":"ContainerStarted","Data":"1a2198d6e5b88408d6850e2200148c887ce001c6a62fd1b38194632f951009f7"} Oct 29 23:21:25.224822 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:25.224363 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:25.259212 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:25.259157 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" podStartSLOduration=1.924585055 podStartE2EDuration="2.259143542s" totalImagesPullingTime="334.558487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:25.258263472 +0000 UTC m=+446.948916779" watchObservedRunningTime="2026-10-29 23:21:25.259143542 +0000 UTC m=+446.949796846" Oct 29 23:21:27.254230 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:21:27.254191 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:21:28.195369 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:28.195341 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5f78687d5b-lfxg6" Oct 29 23:21:28.195576 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:28.195419 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7b98bb678c-t885f" Oct 29 23:21:36.232133 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.232096 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-6645466744-jv9mk" Oct 29 23:21:36.293324 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.293292 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-5tj8h"] Oct 29 23:21:36.293690 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.293634 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" podUID="78c251ab-75c9-4edf-a620-61fc4d21f843" containerName="manager" containerID="cri-o://b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309" gracePeriod=30 Oct 29 23:21:36.537498 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.537476 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:36.625687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.625648 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw\" (UniqueName: \"kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw\") pod \"78c251ab-75c9-4edf-a620-61fc4d21f843\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " Oct 29 23:21:36.625873 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.625702 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs\") pod \"78c251ab-75c9-4edf-a620-61fc4d21f843\" (UID: \"78c251ab-75c9-4edf-a620-61fc4d21f843\") " Oct 29 23:21:36.628006 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.627973 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw" pod "78c251ab-75c9-4edf-a620-61fc4d21f843" (UID: "78c251ab-75c9-4edf-a620-61fc4d21f843"). InnerVolumeSpecName "kube-api-access-rqwhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:21:36.628127 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.627969 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs" pod "78c251ab-75c9-4edf-a620-61fc4d21f843" (UID: "78c251ab-75c9-4edf-a620-61fc4d21f843"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:21:36.726715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.726676 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqwhw\" (UniqueName: \"kubernetes.io/projected/78c251ab-75c9-4edf-a620-61fc4d21f843-kube-api-access-rqwhw\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:21:36.726715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:36.726708 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78c251ab-75c9-4edf-a620-61fc4d21f843-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:21:37.275102 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.275072 5976 generic.go:356] "Generic (PLEG): container finished" podID="78c251ab-75c9-4edf-a620-61fc4d21f843" containerID="b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309" exitCode=0 Oct 29 23:21:37.275535 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.275118 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" event={"ID":"78c251ab-75c9-4edf-a620-61fc4d21f843","Type":"ContainerDied","Data":"b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309"} Oct 29 23:21:37.275535 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.275123 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" Oct 29 23:21:37.275535 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.275154 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-7d85675f98-5tj8h" event={"ID":"78c251ab-75c9-4edf-a620-61fc4d21f843","Type":"ContainerDied","Data":"d301f01d3bd86d5de0fdd45456661312b8ab8a1e9a38c2dcb82cf34655451d95"} Oct 29 23:21:37.275535 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.275177 5976 scope.go:122] "RemoveContainer" containerID="b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309" Oct 29 23:21:37.283859 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.283838 5976 scope.go:122] "RemoveContainer" containerID="b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309" Oct 29 23:21:37.284110 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:21:37.284092 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309\": container with ID starting with b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309 not found: ID does not exist" containerID="b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309" Oct 29 23:21:37.284153 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.284118 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309"} err="failed to get container status \"b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309\": rpc error: code = NotFound desc = could not find container \"b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309\": container with ID starting with b7cec9872f0606727c7b0660546f55c908372baafa9d077837955fe4dba4d309 not found: ID does not exist" Oct 29 23:21:37.319233 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.319196 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-5tj8h"] Oct 29 23:21:37.329167 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:37.329137 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-7d85675f98-5tj8h"] Oct 29 23:21:38.429137 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:38.429104 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78c251ab-75c9-4edf-a620-61fc4d21f843" path="/var/lib/kubelet/pods/78c251ab-75c9-4edf-a620-61fc4d21f843/volumes" Oct 29 23:21:44.492374 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.492335 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj"] Oct 29 23:21:44.492814 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.492706 5976 cpu_manager.go:414] "containerMap: removing container" podUID="78c251ab-75c9-4edf-a620-61fc4d21f843" containerName="manager" Oct 29 23:21:44.492814 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.492717 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78c251ab-75c9-4edf-a620-61fc4d21f843" containerName="manager" Oct 29 23:21:44.492814 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.492787 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="78c251ab-75c9-4edf-a620-61fc4d21f843" containerName="manager" Oct 29 23:21:44.496693 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.496671 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.510787 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.510758 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 29 23:21:44.510926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.510837 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 29 23:21:44.520844 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.520814 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Oct 29 23:21:44.520844 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.520827 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lzw2b\"" Oct 29 23:21:44.522174 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.522153 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj"] Oct 29 23:21:44.594748 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.594707 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.594923 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.594769 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.594923 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.594800 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxv5d\" (UniqueName: \"kubernetes.io/projected/475cb2b8-3776-45d7-b48f-8bd79aef1c60-kube-api-access-qxv5d\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.595046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.594926 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475cb2b8-3776-45d7-b48f-8bd79aef1c60-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.595046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.595013 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.595119 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.595049 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.695696 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.695656 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.695696 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.695696 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.695931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.695758 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.695931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.695781 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.695931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.695806 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxv5d\" (UniqueName: \"kubernetes.io/projected/475cb2b8-3776-45d7-b48f-8bd79aef1c60-kube-api-access-qxv5d\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.696054 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.695948 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475cb2b8-3776-45d7-b48f-8bd79aef1c60-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.696133 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.696108 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.696247 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.696109 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.696247 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.696163 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.698340 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.698312 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/475cb2b8-3776-45d7-b48f-8bd79aef1c60-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.698609 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.698590 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/475cb2b8-3776-45d7-b48f-8bd79aef1c60-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.712584 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.712542 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxv5d\" (UniqueName: \"kubernetes.io/projected/475cb2b8-3776-45d7-b48f-8bd79aef1c60-kube-api-access-qxv5d\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj\" (UID: \"475cb2b8-3776-45d7-b48f-8bd79aef1c60\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:44.810767 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:44.810681 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:45.107219 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:45.107194 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj"] Oct 29 23:21:45.110261 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:45.110230 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod475cb2b8_3776_45d7_b48f_8bd79aef1c60.slice/crio-aa8ae2a97da0a8381f2e4c839f4fce9dd537f58d3a09fa5ee3be31fbec2ad704 WatchSource:0}: Error finding container aa8ae2a97da0a8381f2e4c839f4fce9dd537f58d3a09fa5ee3be31fbec2ad704: Status 404 returned error can't find the container with id aa8ae2a97da0a8381f2e4c839f4fce9dd537f58d3a09fa5ee3be31fbec2ad704 Oct 29 23:21:45.312718 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:45.312683 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" event={"ID":"475cb2b8-3776-45d7-b48f-8bd79aef1c60","Type":"ContainerStarted","Data":"aa8ae2a97da0a8381f2e4c839f4fce9dd537f58d3a09fa5ee3be31fbec2ad704"} Oct 29 23:21:47.322760 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:47.322718 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" event={"ID":"475cb2b8-3776-45d7-b48f-8bd79aef1c60","Type":"ContainerStarted","Data":"39a81d2616a8a0bdd663fec5341fe0bfed01b5cd7ab7948e6aa35058283e4df2"} Oct 29 23:21:47.359978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:47.359927 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" podStartSLOduration=2.115081626 podStartE2EDuration="3.35991371s" totalImagesPullingTime="1.244832084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:47.359110816 +0000 UTC m=+469.049764139" watchObservedRunningTime="2026-10-29 23:21:47.35991371 +0000 UTC m=+469.050567017" Oct 29 23:21:47.810948 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:47.810918 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:48.120790 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.120709 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb"] Oct 29 23:21:48.124061 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.124032 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.136709 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.136688 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Oct 29 23:21:48.151040 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.151012 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb"] Oct 29 23:21:48.227510 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.227473 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.227510 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.227513 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.227756 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.227530 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9km5\" (UniqueName: \"kubernetes.io/projected/9c7795e1-167b-4306-a138-a7b1afd3dd99-kube-api-access-f9km5\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.227756 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.227577 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7795e1-167b-4306-a138-a7b1afd3dd99-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.227828 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.227786 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.227828 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.227822 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328208 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328178 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328208 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328212 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328232 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9km5\" (UniqueName: \"kubernetes.io/projected/9c7795e1-167b-4306-a138-a7b1afd3dd99-kube-api-access-f9km5\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328261 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7795e1-167b-4306-a138-a7b1afd3dd99-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328329 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328454 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328653 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-tmp-dir\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328722 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-home\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.328973 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.328794 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-model-cache\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.330746 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.330723 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7795e1-167b-4306-a138-a7b1afd3dd99-dshm\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.330883 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.330862 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7795e1-167b-4306-a138-a7b1afd3dd99-tls-certs\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.345171 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.345148 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9km5\" (UniqueName: \"kubernetes.io/projected/9c7795e1-167b-4306-a138-a7b1afd3dd99-kube-api-access-f9km5\") pod \"e2e-distinct-simulated-kserve-7b998b79d9-gnzcb\" (UID: \"9c7795e1-167b-4306-a138-a7b1afd3dd99\") " pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.443704 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.443676 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:48.734698 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:48.734617 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb"] Oct 29 23:21:48.737870 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:48.737843 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7795e1_167b_4306_a138_a7b1afd3dd99.slice/crio-b0ee79463c87ca4b9c5a026ea2d08ad68d153ca2e7eee6b5ef958163c35b25fc WatchSource:0}: Error finding container b0ee79463c87ca4b9c5a026ea2d08ad68d153ca2e7eee6b5ef958163c35b25fc: Status 404 returned error can't find the container with id b0ee79463c87ca4b9c5a026ea2d08ad68d153ca2e7eee6b5ef958163c35b25fc Oct 29 23:21:49.333637 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:49.333592 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" event={"ID":"9c7795e1-167b-4306-a138-a7b1afd3dd99","Type":"ContainerStarted","Data":"5053a6ecadded348ba7368f91a04520a07d8b1a9be8e90dbbe42567784d00e73"} Oct 29 23:21:49.334065 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:49.333674 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" event={"ID":"9c7795e1-167b-4306-a138-a7b1afd3dd99","Type":"ContainerStarted","Data":"b0ee79463c87ca4b9c5a026ea2d08ad68d153ca2e7eee6b5ef958163c35b25fc"} Oct 29 23:21:49.369926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:49.369870 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" podStartSLOduration=1.178445779 podStartE2EDuration="1.369855632s" totalImagesPullingTime="191.409853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:49.369433095 +0000 UTC m=+471.060086417" watchObservedRunningTime="2026-10-29 23:21:49.369855632 +0000 UTC m=+471.060508940" Oct 29 23:21:49.444046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:49.444015 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:54.811515 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:54.811479 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:54.824353 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:54.824328 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:55.268465 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.268431 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8"] Oct 29 23:21:55.271378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.271355 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.290881 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.290842 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Oct 29 23:21:55.302048 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.302014 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8"] Oct 29 23:21:55.373204 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.373176 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj" Oct 29 23:21:55.396715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.396679 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.396715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.396721 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b723bd2-d498-4f3b-98eb-49638fd73dd7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.396927 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.396742 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.396927 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.396817 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.396927 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.396905 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.397037 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.396935 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88t9l\" (UniqueName: \"kubernetes.io/projected/8b723bd2-d498-4f3b-98eb-49638fd73dd7-kube-api-access-88t9l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.497687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.497651 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.497893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.497718 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88t9l\" (UniqueName: \"kubernetes.io/projected/8b723bd2-d498-4f3b-98eb-49638fd73dd7-kube-api-access-88t9l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.497893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.497752 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.497893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.497792 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b723bd2-d498-4f3b-98eb-49638fd73dd7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.497893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.497820 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.497893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.497846 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.498169 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.498117 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.498169 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.498150 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.498284 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.498215 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.500585 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.500539 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8b723bd2-d498-4f3b-98eb-49638fd73dd7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.501600 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.501546 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b723bd2-d498-4f3b-98eb-49638fd73dd7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.515271 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.515241 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88t9l\" (UniqueName: \"kubernetes.io/projected/8b723bd2-d498-4f3b-98eb-49638fd73dd7-kube-api-access-88t9l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8\" (UID: \"8b723bd2-d498-4f3b-98eb-49638fd73dd7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.586540 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.586443 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:55.884740 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:55.884647 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8"] Oct 29 23:21:55.887869 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:21:55.887840 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b723bd2_d498_4f3b_98eb_49638fd73dd7.slice/crio-327cb268fca76f5f2f3e347551617123b16ae9f1c73d5422d9e08875b334ea1f WatchSource:0}: Error finding container 327cb268fca76f5f2f3e347551617123b16ae9f1c73d5422d9e08875b334ea1f: Status 404 returned error can't find the container with id 327cb268fca76f5f2f3e347551617123b16ae9f1c73d5422d9e08875b334ea1f Oct 29 23:21:56.366493 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:56.366454 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" event={"ID":"8b723bd2-d498-4f3b-98eb-49638fd73dd7","Type":"ContainerStarted","Data":"9d2bd12fd8234bae88e196de745edc952e8c74bcc272ea03817ca11a6c699b80"} Oct 29 23:21:56.366706 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:56.366515 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" event={"ID":"8b723bd2-d498-4f3b-98eb-49638fd73dd7","Type":"ContainerStarted","Data":"327cb268fca76f5f2f3e347551617123b16ae9f1c73d5422d9e08875b334ea1f"} Oct 29 23:21:56.402205 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:56.402156 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" podStartSLOduration=1.204349834 podStartE2EDuration="1.402142331s" totalImagesPullingTime="197.792497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:56.4013592 +0000 UTC m=+478.092012689" watchObservedRunningTime="2026-10-29 23:21:56.402142331 +0000 UTC m=+478.092795637" Oct 29 23:21:56.587569 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:56.587509 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:21:57.256895 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:21:57.256862 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:21:58.444414 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:58.444384 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:58.457403 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:58.457378 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:59.399452 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.399418 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7b998b79d9-gnzcb" Oct 29 23:21:59.700701 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.700534 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl"] Oct 29 23:21:59.704465 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.704438 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.717151 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.717110 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Oct 29 23:21:59.733370 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.733338 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl"] Oct 29 23:21:59.840906 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.840871 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.841078 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.840916 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjst\" (UniqueName: \"kubernetes.io/projected/0264bad4-fd17-400b-a7a8-28727eee0008-kube-api-access-bbjst\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.841078 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.841002 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.841078 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.841072 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.841242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.841214 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.841348 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.841326 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0264bad4-fd17-400b-a7a8-28727eee0008-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.941963 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.941925 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.941963 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.941963 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjst\" (UniqueName: \"kubernetes.io/projected/0264bad4-fd17-400b-a7a8-28727eee0008-kube-api-access-bbjst\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942292 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.941989 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942292 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.942025 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942292 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.942103 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942292 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.942155 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0264bad4-fd17-400b-a7a8-28727eee0008-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.942452 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.942502 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.942544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.942522 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.944670 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.944645 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0264bad4-fd17-400b-a7a8-28727eee0008-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.944914 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.944891 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0264bad4-fd17-400b-a7a8-28727eee0008-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:21:59.959610 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:21:59.959517 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjst\" (UniqueName: \"kubernetes.io/projected/0264bad4-fd17-400b-a7a8-28727eee0008-kube-api-access-bbjst\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl\" (UID: \"0264bad4-fd17-400b-a7a8-28727eee0008\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:22:00.021389 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:00.021346 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:22:00.347577 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:00.346354 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl"] Oct 29 23:22:00.397903 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:00.397715 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" event={"ID":"0264bad4-fd17-400b-a7a8-28727eee0008","Type":"ContainerStarted","Data":"1866744249cdfdb1d888cc6d4774d486ecae587248d6cc321b5d9b960e1dbc0b"} Oct 29 23:22:01.403458 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:01.403424 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" event={"ID":"0264bad4-fd17-400b-a7a8-28727eee0008","Type":"ContainerStarted","Data":"3b59eaa17defc65d7d6d2177b51a2ebbd034432105be6fba02a43e440a12b3d1"} Oct 29 23:22:01.439994 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:01.439942 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" podStartSLOduration=2.229669529 podStartE2EDuration="2.439930678s" totalImagesPullingTime="210.261149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:01.439692364 +0000 UTC m=+483.130345671" watchObservedRunningTime="2026-10-29 23:22:01.439930678 +0000 UTC m=+483.130583984" Oct 29 23:22:02.021963 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:02.021920 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:22:05.587524 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:05.587487 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:22:05.600085 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:05.600053 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:22:06.437916 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:06.437883 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8" Oct 29 23:22:10.022265 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:10.022231 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:22:10.034800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:10.034770 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:22:10.456126 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:10.456091 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl" Oct 29 23:22:14.940273 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:14.940236 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f5d94f994-t9489"] Oct 29 23:22:14.943217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:14.943193 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:14.963950 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:14.963919 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5d94f994-t9489"] Oct 29 23:22:15.091862 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.091824 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86-tls-cert\") pod \"authorino-7f5d94f994-t9489\" (UID: \"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86\") " pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.091862 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.091864 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmsjf\" (UniqueName: \"kubernetes.io/projected/f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86-kube-api-access-pmsjf\") pod \"authorino-7f5d94f994-t9489\" (UID: \"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86\") " pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.193230 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.193135 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86-tls-cert\") pod \"authorino-7f5d94f994-t9489\" (UID: \"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86\") " pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.193230 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.193183 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmsjf\" (UniqueName: \"kubernetes.io/projected/f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86-kube-api-access-pmsjf\") pod \"authorino-7f5d94f994-t9489\" (UID: \"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86\") " pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.195847 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.195814 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86-tls-cert\") pod \"authorino-7f5d94f994-t9489\" (UID: \"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86\") " pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.210679 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.210651 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmsjf\" (UniqueName: \"kubernetes.io/projected/f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86-kube-api-access-pmsjf\") pod \"authorino-7f5d94f994-t9489\" (UID: \"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86\") " pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.254284 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.254257 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f5d94f994-t9489" Oct 29 23:22:15.544346 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:15.544143 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f5d94f994-t9489"] Oct 29 23:22:15.547333 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:15.547293 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a4d1fe_b1ca_40bc_ac4d_f0c4b5a27b86.slice/crio-8448390b90256e77eab0de7b4310c6cd4b9245a2d2336cb994f9c41479ff8439 WatchSource:0}: Error finding container 8448390b90256e77eab0de7b4310c6cd4b9245a2d2336cb994f9c41479ff8439: Status 404 returned error can't find the container with id 8448390b90256e77eab0de7b4310c6cd4b9245a2d2336cb994f9c41479ff8439 Oct 29 23:22:16.482501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.482460 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5d94f994-t9489" event={"ID":"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86","Type":"ContainerStarted","Data":"8fd7110ef04e4da1da0a97581375dbfd39b77074303eb89245f7cd58847d5746"} Oct 29 23:22:16.483039 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.482539 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f5d94f994-t9489" event={"ID":"f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86","Type":"ContainerStarted","Data":"8448390b90256e77eab0de7b4310c6cd4b9245a2d2336cb994f9c41479ff8439"} Oct 29 23:22:16.519037 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.518920 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7f5d94f994-t9489" podStartSLOduration=2.08544363 podStartE2EDuration="2.518897179s" totalImagesPullingTime="433.453549ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:16.516797368 +0000 UTC m=+498.207450674" watchObservedRunningTime="2026-10-29 23:22:16.518897179 +0000 UTC m=+498.209550487" Oct 29 23:22:16.539578 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.538749 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bc79c8845-96wnv"] Oct 29 23:22:16.539578 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.538943 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5bc79c8845-96wnv" podUID="46c0c396-c47b-45c5-9c24-34d2fee96ad5" containerName="authorino" containerID="cri-o://93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277" gracePeriod=30 Oct 29 23:22:16.802759 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.802721 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:22:16.910417 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.910381 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert\" (UniqueName: \"kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert\") pod \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " Oct 29 23:22:16.910624 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.910455 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq\" (UniqueName: \"kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq\") pod \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\" (UID: \"46c0c396-c47b-45c5-9c24-34d2fee96ad5\") " Oct 29 23:22:16.912635 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.912601 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq" pod "46c0c396-c47b-45c5-9c24-34d2fee96ad5" (UID: "46c0c396-c47b-45c5-9c24-34d2fee96ad5"). InnerVolumeSpecName "kube-api-access-l2lwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:22:16.922031 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:16.921999 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert" pod "46c0c396-c47b-45c5-9c24-34d2fee96ad5" (UID: "46c0c396-c47b-45c5-9c24-34d2fee96ad5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:22:17.012247 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.012207 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2lwq\" (UniqueName: \"kubernetes.io/projected/46c0c396-c47b-45c5-9c24-34d2fee96ad5-kube-api-access-l2lwq\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:22:17.012247 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.012242 5976 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46c0c396-c47b-45c5-9c24-34d2fee96ad5-tls-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:22:17.488767 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.488679 5976 generic.go:356] "Generic (PLEG): container finished" podID="46c0c396-c47b-45c5-9c24-34d2fee96ad5" containerID="93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277" exitCode=0 Oct 29 23:22:17.488767 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.488730 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bc79c8845-96wnv" Oct 29 23:22:17.489341 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.488764 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc79c8845-96wnv" event={"ID":"46c0c396-c47b-45c5-9c24-34d2fee96ad5","Type":"ContainerDied","Data":"93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277"} Oct 29 23:22:17.489341 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.488814 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bc79c8845-96wnv" event={"ID":"46c0c396-c47b-45c5-9c24-34d2fee96ad5","Type":"ContainerDied","Data":"24ba7c56b33860ac4ae71aa3c49c885d9414167d635750bf3e5a7b7742790ca0"} Oct 29 23:22:17.489341 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.488834 5976 scope.go:122] "RemoveContainer" containerID="93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277" Oct 29 23:22:17.502225 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.502201 5976 scope.go:122] "RemoveContainer" containerID="93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277" Oct 29 23:22:17.502574 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:17.502527 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277\": container with ID starting with 93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277 not found: ID does not exist" containerID="93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277" Oct 29 23:22:17.502675 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.502570 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277"} err="failed to get container status \"93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277\": rpc error: code = NotFound desc = could not find container \"93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277\": container with ID starting with 93b6192a79815beb2e35f0b14af699cb844cbf38159da9fa1812f2733683d277 not found: ID does not exist" Oct 29 23:22:17.535608 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.535575 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bc79c8845-96wnv"] Oct 29 23:22:17.545578 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:17.545535 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bc79c8845-96wnv"] Oct 29 23:22:18.430433 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:18.430395 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46c0c396-c47b-45c5-9c24-34d2fee96ad5" path="/var/lib/kubelet/pods/46c0c396-c47b-45c5-9c24-34d2fee96ad5/volumes" Oct 29 23:22:24.332497 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.332462 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9"] Oct 29 23:22:24.333072 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.333036 5976 cpu_manager.go:414] "containerMap: removing container" podUID="46c0c396-c47b-45c5-9c24-34d2fee96ad5" containerName="authorino" Oct 29 23:22:24.333072 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.333063 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46c0c396-c47b-45c5-9c24-34d2fee96ad5" containerName="authorino" Oct 29 23:22:24.333229 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.333195 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="46c0c396-c47b-45c5-9c24-34d2fee96ad5" containerName="authorino" Oct 29 23:22:24.336236 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.336218 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.348314 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.348292 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-htpp6\"" Oct 29 23:22:24.365692 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.365659 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9"] Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370029 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370075 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370122 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zs6\" (UniqueName: \"kubernetes.io/projected/a9b1150d-e419-493b-a0b2-8420d20cde91-kube-api-access-79zs6\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370175 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370222 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370275 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.370602 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.370308 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.371472 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.371444 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.372131 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.371618 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b1150d-e419-493b-a0b2-8420d20cde91-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472226 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472192 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472239 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zs6\" (UniqueName: \"kubernetes.io/projected/a9b1150d-e419-493b-a0b2-8420d20cde91-kube-api-access-79zs6\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472285 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472324 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472394 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472423 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472472 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472498 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b1150d-e419-493b-a0b2-8420d20cde91-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472532 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472639 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472773 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.472996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.472884 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.473107 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.473061 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.473320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.473301 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9b1150d-e419-493b-a0b2-8420d20cde91-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.474735 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.474716 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.475147 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.475128 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.489708 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.489675 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9b1150d-e419-493b-a0b2-8420d20cde91-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.489810 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.489729 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zs6\" (UniqueName: \"kubernetes.io/projected/a9b1150d-e419-493b-a0b2-8420d20cde91-kube-api-access-79zs6\") pod \"maas-default-gateway-openshift-default-7d9897b54c-grxl9\" (UID: \"a9b1150d-e419-493b-a0b2-8420d20cde91\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.648430 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.648402 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:24.970988 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:24.970959 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9"] Oct 29 23:22:24.973599 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:24.973570 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b1150d_e419_493b_a0b2_8420d20cde91.slice/crio-5c1714e85cf2958cc3ecc527f900a493e0a4fe1d6ec71636ea7a075d5bb2e612 WatchSource:0}: Error finding container 5c1714e85cf2958cc3ecc527f900a493e0a4fe1d6ec71636ea7a075d5bb2e612: Status 404 returned error can't find the container with id 5c1714e85cf2958cc3ecc527f900a493e0a4fe1d6ec71636ea7a075d5bb2e612 Oct 29 23:22:25.537431 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:25.537377 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" event={"ID":"a9b1150d-e419-493b-a0b2-8420d20cde91","Type":"ContainerStarted","Data":"5c1714e85cf2958cc3ecc527f900a493e0a4fe1d6ec71636ea7a075d5bb2e612"} Oct 29 23:22:27.257778 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:27.257729 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:22:27.460505 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:27.460467 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:27.460634 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:27.460539 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:27.460634 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:27.460586 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:27.549053 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:27.549017 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" event={"ID":"a9b1150d-e419-493b-a0b2-8420d20cde91","Type":"ContainerStarted","Data":"d5fd9951e6cdcf641d27a63aceb1c9d37966e636dd109e71ffc7112524750f55"} Oct 29 23:22:27.608290 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:27.608220 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podStartSLOduration=1.124322358 podStartE2EDuration="3.608200749s" totalImagesPullingTime="2.483878391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:27.59711977 +0000 UTC m=+509.287773078" watchObservedRunningTime="2026-10-29 23:22:27.608200749 +0000 UTC m=+509.298854058" Oct 29 23:22:27.648984 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:27.648945 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:28.650430 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:28.650392 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:28.650949 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:28.650447 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:29.649293 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:29.649256 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:29.649463 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:29.649315 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:30.648985 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:30.648949 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:30.649366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:30.649003 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:31.649407 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:31.649374 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:31.649841 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:31.649437 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:32.649078 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:32.649039 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:32.649256 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:32.649123 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:33.649400 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:33.649363 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:33.649810 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:33.649423 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:34.649408 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:34.649364 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-grxl9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Oct 29 23:22:34.649830 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:34.649437 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" podUID="a9b1150d-e419-493b-a0b2-8420d20cde91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Oct 29 23:22:35.687908 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:35.687868 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:35.688696 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:35.688666 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:35.689320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:35.689299 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-grxl9" Oct 29 23:22:39.368864 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.368826 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm"] Oct 29 23:22:39.371622 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.371599 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.402800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.402749 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.402800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.402786 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.402820 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.402829 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm"] Oct 29 23:22:39.403004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.402912 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.403036 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.403068 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.403103 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403154 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.403129 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5vnf\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.403485 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.403243 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504117 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504075 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504117 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504113 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504375 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504135 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504375 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504249 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504375 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504288 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504747 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504309 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5vnf\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504859 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504828 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504962 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.504980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.504967 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.505111 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.505002 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.505111 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.505077 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.505345 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.505323 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.505484 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.505458 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.505599 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.505535 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.508697 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.508676 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.510191 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.510152 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.526099 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.526078 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.526285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.526264 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5vnf\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf\") pod \"maas-default-gateway-openshift-default-7d9897b54c-w4knm\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.684885 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.684852 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:39.993453 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.993428 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm"] Oct 29 23:22:39.996278 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:39.996249 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c47d1f_1807_4782_90c5_ed3bb8ad828b.slice/crio-ef66a2d815f2e3cd383e9e6d85b9476414de35bd96377df5941d02296d7a4c71 WatchSource:0}: Error finding container ef66a2d815f2e3cd383e9e6d85b9476414de35bd96377df5941d02296d7a4c71: Status 404 returned error can't find the container with id ef66a2d815f2e3cd383e9e6d85b9476414de35bd96377df5941d02296d7a4c71 Oct 29 23:22:39.998249 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.998216 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:39.998327 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.998280 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:39.998327 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:39.998313 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:40.613629 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:40.613591 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" event={"ID":"31c47d1f-1807-4782-90c5-ed3bb8ad828b","Type":"ContainerStarted","Data":"56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba"} Oct 29 23:22:40.614106 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:40.613650 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" event={"ID":"31c47d1f-1807-4782-90c5-ed3bb8ad828b","Type":"ContainerStarted","Data":"ef66a2d815f2e3cd383e9e6d85b9476414de35bd96377df5941d02296d7a4c71"} Oct 29 23:22:40.660948 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:40.660886 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podStartSLOduration=1.660873092 podStartE2EDuration="1.660873092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:40.6593713 +0000 UTC m=+522.350024606" watchObservedRunningTime="2026-10-29 23:22:40.660873092 +0000 UTC m=+522.351526399" Oct 29 23:22:40.689759 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:40.689671 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:41.709284 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:41.709236 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-w4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Oct 29 23:22:41.709866 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:41.709302 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Oct 29 23:22:42.692578 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:42.687967 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-w4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Oct 29 23:22:42.692578 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:42.688030 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Oct 29 23:22:43.709022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.708984 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-w4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Oct 29 23:22:43.709657 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.709612 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Oct 29 23:22:43.802581 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.798981 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt"] Oct 29 23:22:43.808495 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.808468 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.822793 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.822767 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-46444d59-openshift-default-dockercfg-t9kxz\"" Oct 29 23:22:43.836093 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.836061 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt"] Oct 29 23:22:43.846647 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846609 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.846805 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846653 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm8s6\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.846805 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846690 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.846805 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846745 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.846805 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846773 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.847003 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846822 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.847003 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846872 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.847003 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846901 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.847003 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.846917 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948360 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948321 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948386 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948408 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948454 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948760 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948598 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948760 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948668 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948760 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948699 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948760 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948739 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948965 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948770 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm8s6\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948965 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948846 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948965 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948869 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.948965 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.948951 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.949172 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.949114 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.949274 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.949251 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.951580 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.951529 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.955532 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.955510 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.971014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.970942 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm8s6\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:43.971285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:43.971263 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token\") pod \"e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:44.125900 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.125865 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:44.445631 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.445590 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt"] Oct 29 23:22:44.453098 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:44.451788 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a058f1_c110_4729_8a4e_56d5a0925457.slice/crio-e12c000cf435fabe6a66e77f80c03583b4e45759457590e2a1b7a0c9aae1258f WatchSource:0}: Error finding container e12c000cf435fabe6a66e77f80c03583b4e45759457590e2a1b7a0c9aae1258f: Status 404 returned error can't find the container with id e12c000cf435fabe6a66e77f80c03583b4e45759457590e2a1b7a0c9aae1258f Oct 29 23:22:44.454492 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.454458 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:44.454580 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.454531 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:44.454625 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.454582 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:44.633469 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.633427 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" event={"ID":"68a058f1-c110-4729-8a4e-56d5a0925457","Type":"ContainerStarted","Data":"50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2"} Oct 29 23:22:44.633641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.633499 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" event={"ID":"68a058f1-c110-4729-8a4e-56d5a0925457","Type":"ContainerStarted","Data":"e12c000cf435fabe6a66e77f80c03583b4e45759457590e2a1b7a0c9aae1258f"} Oct 29 23:22:44.673217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.673165 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podStartSLOduration=1.673149558 podStartE2EDuration="1.673149558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:44.672179656 +0000 UTC m=+526.362832962" watchObservedRunningTime="2026-10-29 23:22:44.673149558 +0000 UTC m=+526.363802890" Oct 29 23:22:44.687586 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.685680 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-w4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Oct 29 23:22:44.687586 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:44.685760 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Oct 29 23:22:45.126926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.126887 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:45.132302 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.132276 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:45.508373 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.508334 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq"] Oct 29 23:22:45.515838 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.515814 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.531226 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.531199 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4afba12a-openshift-default-dockercfg-thz5j\"" Oct 29 23:22:45.546889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.543846 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq"] Oct 29 23:22:45.568847 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.568809 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569021 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.568907 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569021 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.568973 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569186 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.569045 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzm7\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569186 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.569079 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569186 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.569107 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.569177 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.569262 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.569339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.569298 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.637949 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.637916 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:45.638810 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.638791 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.670932 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.670989 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671043 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671076 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671149 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671218 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzm7\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671287 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671328 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671359 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671878 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.671931 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.672726 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.673218 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.674579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.673799 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.680173 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.677244 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.680173 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.677820 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.705729 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.699173 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-w4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Oct 29 23:22:45.705729 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.699229 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Oct 29 23:22:45.732500 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.728139 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzm7\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.732500 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.732146 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token\") pod \"e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:45.831512 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:45.831428 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:46.164859 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.164817 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq"] Oct 29 23:22:46.169102 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:46.169059 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f114db_a6a4_4e5a_8080_a935c8785b7d.slice/crio-747c060f223d2b88c3107721b7ca1fd05d8b030998dbdb964342c30dff277f6c WatchSource:0}: Error finding container 747c060f223d2b88c3107721b7ca1fd05d8b030998dbdb964342c30dff277f6c: Status 404 returned error can't find the container with id 747c060f223d2b88c3107721b7ca1fd05d8b030998dbdb964342c30dff277f6c Oct 29 23:22:46.171907 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.171872 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:46.171997 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.171942 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:46.171997 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.171970 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:22:46.645710 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.645674 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" event={"ID":"56f114db-a6a4-4e5a-8080-a935c8785b7d","Type":"ContainerStarted","Data":"9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737"} Oct 29 23:22:46.645919 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.645732 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" event={"ID":"56f114db-a6a4-4e5a-8080-a935c8785b7d","Type":"ContainerStarted","Data":"747c060f223d2b88c3107721b7ca1fd05d8b030998dbdb964342c30dff277f6c"} Oct 29 23:22:46.685810 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.685777 5976 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-w4knm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Oct 29 23:22:46.685970 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.685833 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Oct 29 23:22:46.687710 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.687668 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podStartSLOduration=1.687655726 podStartE2EDuration="1.687655726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:46.687249718 +0000 UTC m=+528.377903026" watchObservedRunningTime="2026-10-29 23:22:46.687655726 +0000 UTC m=+528.378309032" Oct 29 23:22:46.832111 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:46.832072 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:47.838875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:47.838839 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:48.130504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.130399 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5"] Oct 29 23:22:48.133541 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.133515 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.148907 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.148884 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-46444d59-serving-cert\"" Oct 29 23:22:48.158313 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.158277 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5"] Oct 29 23:22:48.201123 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.201095 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.201123 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.201129 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2ctm\" (UniqueName: \"kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.201330 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.201179 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.201330 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.201257 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.302366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.302320 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.302528 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.302396 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2ctm\" (UniqueName: \"kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.302528 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.302492 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.302674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.302526 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.303654 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.303620 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.305187 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.305164 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.305292 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.305215 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.321404 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.321368 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2ctm\" (UniqueName: \"kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm\") pod \"maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.337320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.337283 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv"] Oct 29 23:22:48.342908 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.342881 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.369157 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.367057 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-46444d59-dockercfg-hrt6f\"" Oct 29 23:22:48.389987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.373293 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv"] Oct 29 23:22:48.389987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.375536 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-46444d59\"" Oct 29 23:22:48.403782 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.403613 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume\") pod \"payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.403782 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.403677 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bns47\" (UniqueName: \"kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47\") pod \"payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.449251 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.449182 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:48.504332 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.504303 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:48.505752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.505709 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:48.506398 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.506363 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume\") pod \"payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.506788 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.506762 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:22:48.507196 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.507176 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume\") pod \"payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.507288 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.507268 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bns47\" (UniqueName: \"kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47\") pod \"payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.525482 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.525423 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bns47\" (UniqueName: \"kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47\") pod \"payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.657208 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.657176 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:48.658442 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.658417 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:22:48.709742 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.709712 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:48.773347 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:48.773308 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5"] Oct 29 23:22:48.777941 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:48.777889 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e70ad2c_ee7e_433b_ac0d_4d89ca71acad.slice/crio-99472e10fa89ee472714b69ad3bd6638aaf84ce334e18c7750fce075025b064c WatchSource:0}: Error finding container 99472e10fa89ee472714b69ad3bd6638aaf84ce334e18c7750fce075025b064c: Status 404 returned error can't find the container with id 99472e10fa89ee472714b69ad3bd6638aaf84ce334e18c7750fce075025b064c Oct 29 23:22:49.495151 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.494797 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv"] Oct 29 23:22:49.498661 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:49.498621 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09119b16_1fb6_44c0_a136_49226df09437.slice/crio-75c1f5df0d0f165cc36e4f6250fbd522f5fb9e99f7749125d8047f858a526029 WatchSource:0}: Error finding container 75c1f5df0d0f165cc36e4f6250fbd522f5fb9e99f7749125d8047f858a526029: Status 404 returned error can't find the container with id 75c1f5df0d0f165cc36e4f6250fbd522f5fb9e99f7749125d8047f858a526029 Oct 29 23:22:49.662956 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.662913 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" event={"ID":"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad","Type":"ContainerStarted","Data":"5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376"} Oct 29 23:22:49.663146 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.662982 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" event={"ID":"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad","Type":"ContainerStarted","Data":"99472e10fa89ee472714b69ad3bd6638aaf84ce334e18c7750fce075025b064c"} Oct 29 23:22:49.663146 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.663035 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:49.664634 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.664601 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" event={"ID":"09119b16-1fb6-44c0-a136-49226df09437","Type":"ContainerStarted","Data":"3f11e32a01c58b9e96c01d3a7a8ed968949ac23809dd830054db6c06c967bcf8"} Oct 29 23:22:49.664774 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.664658 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" event={"ID":"09119b16-1fb6-44c0-a136-49226df09437","Type":"ContainerStarted","Data":"75c1f5df0d0f165cc36e4f6250fbd522f5fb9e99f7749125d8047f858a526029"} Oct 29 23:22:49.664900 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.664882 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:22:49.716395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.716345 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" podStartSLOduration=1.3498729360000001 podStartE2EDuration="1.716332682s" totalImagesPullingTime="366.459746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:49.714842312 +0000 UTC m=+531.405495619" watchObservedRunningTime="2026-10-29 23:22:49.716332682 +0000 UTC m=+531.406985989" Oct 29 23:22:49.752514 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:49.751878 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" podStartSLOduration=1.751857461 podStartE2EDuration="1.751857461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:49.751584682 +0000 UTC m=+531.442237982" watchObservedRunningTime="2026-10-29 23:22:49.751857461 +0000 UTC m=+531.442510770" Oct 29 23:22:50.488528 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.488491 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz"] Oct 29 23:22:50.491155 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.491136 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.508729 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.508704 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-85b460de-dockercfg-n99wp\"" Oct 29 23:22:50.508729 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.508708 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-85b460de\"" Oct 29 23:22:50.520770 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.520742 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz"] Oct 29 23:22:50.539273 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.539226 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9tk\" (UniqueName: \"kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk\") pod \"payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.539464 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.539298 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.640645 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.640606 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9tk\" (UniqueName: \"kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk\") pod \"payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.640814 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.640657 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.641544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.641521 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.657574 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.657531 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9tk\" (UniqueName: \"kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk\") pod \"payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.803030 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.802944 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:50.920676 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.920638 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn"] Oct 29 23:22:50.924360 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.924335 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:50.951821 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.951794 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e687ff69-serving-cert\"" Oct 29 23:22:50.955593 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:50.955548 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn"] Oct 29 23:22:51.044904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.044870 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq89l\" (UniqueName: \"kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.044904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.044914 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.045188 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.044985 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.045188 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.045024 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.095665 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.095633 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz"] Oct 29 23:22:51.097395 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:51.097371 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875b0738_5e69_4dcb_954d_5d66d15c6260.slice/crio-6dea0c9a2b4e103fe390adf8019eac637406f83bc5b4fff56cd1791d3cd269bc WatchSource:0}: Error finding container 6dea0c9a2b4e103fe390adf8019eac637406f83bc5b4fff56cd1791d3cd269bc: Status 404 returned error can't find the container with id 6dea0c9a2b4e103fe390adf8019eac637406f83bc5b4fff56cd1791d3cd269bc Oct 29 23:22:51.146722 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.146693 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.146844 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.146820 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq89l\" (UniqueName: \"kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.146899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.146864 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.147057 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.147036 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.147420 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.147397 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.149582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.149537 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.149676 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.149602 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.163586 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.163534 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq89l\" (UniqueName: \"kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l\") pod \"maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.237772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.237735 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:51.539630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.539599 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn"] Oct 29 23:22:51.542512 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:51.542484 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb79da5_6c82_45c5_8907_158a0ee8dfdf.slice/crio-4bee63baf076847c2bd308887fc8f44bfd17aa3447b81223fa2d0d1ae86d8e2f WatchSource:0}: Error finding container 4bee63baf076847c2bd308887fc8f44bfd17aa3447b81223fa2d0d1ae86d8e2f: Status 404 returned error can't find the container with id 4bee63baf076847c2bd308887fc8f44bfd17aa3447b81223fa2d0d1ae86d8e2f Oct 29 23:22:51.675673 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.675641 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" event={"ID":"875b0738-5e69-4dcb-954d-5d66d15c6260","Type":"ContainerStarted","Data":"e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280"} Oct 29 23:22:51.675838 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.675693 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" event={"ID":"875b0738-5e69-4dcb-954d-5d66d15c6260","Type":"ContainerStarted","Data":"6dea0c9a2b4e103fe390adf8019eac637406f83bc5b4fff56cd1791d3cd269bc"} Oct 29 23:22:51.675838 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.675741 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:22:51.677028 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.677005 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" event={"ID":"0cb79da5-6c82-45c5-8907-158a0ee8dfdf","Type":"ContainerStarted","Data":"4bee63baf076847c2bd308887fc8f44bfd17aa3447b81223fa2d0d1ae86d8e2f"} Oct 29 23:22:51.711642 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:51.711575 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" podStartSLOduration=1.711541687 podStartE2EDuration="1.711541687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:51.710180802 +0000 UTC m=+533.400834111" watchObservedRunningTime="2026-10-29 23:22:51.711541687 +0000 UTC m=+533.402194993" Oct 29 23:22:52.684868 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.684786 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" event={"ID":"0cb79da5-6c82-45c5-8907-158a0ee8dfdf","Type":"ContainerStarted","Data":"5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6"} Oct 29 23:22:52.723635 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.723586 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" podStartSLOduration=2.40623982 podStartE2EDuration="2.723574004s" totalImagesPullingTime="317.334184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:52.722502767 +0000 UTC m=+534.413156077" watchObservedRunningTime="2026-10-29 23:22:52.723574004 +0000 UTC m=+534.414227305" Oct 29 23:22:52.836734 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.836691 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll"] Oct 29 23:22:52.839664 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.839640 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:52.852569 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.852537 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-85b460de-serving-cert\"" Oct 29 23:22:52.869132 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.869099 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll"] Oct 29 23:22:52.966638 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.966510 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:52.966638 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.966583 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-892b9\" (UniqueName: \"kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:52.966991 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.966963 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:52.967252 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:52.967227 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.068574 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.068512 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.068751 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.068655 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.068751 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.068716 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.068832 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.068780 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-892b9\" (UniqueName: \"kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.068832 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:53.068797 5976 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-serving-cert: secret "maas-api-e2e-ait-85b460de-serving-cert" not found Oct 29 23:22:53.068906 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:53.068864 5976 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls podName:21739c2c-b526-4c3a-bf28-64e684fea426 nodeName:}" failed. No retries permitted until 2026-10-29 23:22:53.568848122 +0000 UTC m=+535.259501421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls") pod "maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" (UID: "21739c2c-b526-4c3a-bf28-64e684fea426") : secret "maas-api-e2e-ait-85b460de-serving-cert" not found Oct 29 23:22:53.069358 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.069332 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.071105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.071078 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.088935 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.088912 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-892b9\" (UniqueName: \"kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.575195 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.575158 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.577767 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.577740 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\") pod \"maas-api-e2e-ait-85b460de-6f4495875f-rm7ll\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.692059 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.692020 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:53.752572 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.752525 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:53.790115 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.790071 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq"] Oct 29 23:22:53.794155 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.794128 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:53.814862 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.813779 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4afba12a-dockercfg-gc8sg\"" Oct 29 23:22:53.814862 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.813915 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4afba12a\"" Oct 29 23:22:53.816778 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.816500 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq"] Oct 29 23:22:53.878709 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.878667 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:53.878907 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.878878 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbss4\" (UniqueName: \"kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4\") pod \"payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:53.980576 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.980187 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:53.980576 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.980344 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbss4\" (UniqueName: \"kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4\") pod \"payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:54.004497 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:53.981502 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:54.007437 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.007402 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbss4\" (UniqueName: \"kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4\") pod \"payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:54.079926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.079838 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll"] Oct 29 23:22:54.123737 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.123700 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:54.452773 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.451486 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq"] Oct 29 23:22:54.455763 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:22:54.455726 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod661c20e3_d7b9_41bd_bb7e_55e6c3bd1dd2.slice/crio-260475a268f14c239574ded1443d215a2fab1afb092c3aead7258d54a45d29f5 WatchSource:0}: Error finding container 260475a268f14c239574ded1443d215a2fab1afb092c3aead7258d54a45d29f5: Status 404 returned error can't find the container with id 260475a268f14c239574ded1443d215a2fab1afb092c3aead7258d54a45d29f5 Oct 29 23:22:54.698425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.698318 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" event={"ID":"21739c2c-b526-4c3a-bf28-64e684fea426","Type":"ContainerStarted","Data":"1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d"} Oct 29 23:22:54.698425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.698382 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" event={"ID":"21739c2c-b526-4c3a-bf28-64e684fea426","Type":"ContainerStarted","Data":"0735012cfe0727384d692d80cdf3af44f0b141a0fb2659da02fbd37e2ff7c736"} Oct 29 23:22:54.698425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.698409 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:22:54.700037 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.700013 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" event={"ID":"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2","Type":"ContainerStarted","Data":"7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d"} Oct 29 23:22:54.700143 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.700063 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" event={"ID":"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2","Type":"ContainerStarted","Data":"260475a268f14c239574ded1443d215a2fab1afb092c3aead7258d54a45d29f5"} Oct 29 23:22:54.700143 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.700091 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:22:54.739349 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.739300 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" podStartSLOduration=2.423162565 podStartE2EDuration="2.739280827s" totalImagesPullingTime="316.118262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:54.738716826 +0000 UTC m=+536.429370143" watchObservedRunningTime="2026-10-29 23:22:54.739280827 +0000 UTC m=+536.429934163" Oct 29 23:22:54.773339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:54.773293 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" podStartSLOduration=1.7732796419999999 podStartE2EDuration="1.773279642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:54.772118902 +0000 UTC m=+536.462772208" watchObservedRunningTime="2026-10-29 23:22:54.773279642 +0000 UTC m=+536.463932949" Oct 29 23:22:55.675076 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:55.675050 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:22:57.216926 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.216852 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6"] Oct 29 23:22:57.219851 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.219827 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.235426 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.235393 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4afba12a-serving-cert\"" Oct 29 23:22:57.249001 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.248967 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6"] Oct 29 23:22:57.263839 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:57.263795 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:22:57.331250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.331213 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.331402 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.331280 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.331485 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.331466 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw5dw\" (UniqueName: \"kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.331541 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.331525 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.432259 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.432225 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw5dw\" (UniqueName: \"kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.432440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.432288 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.432440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.432380 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.432616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.432439 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.432616 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:57.432599 5976 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-serving-cert: secret "maas-api-e2e-ait-4afba12a-serving-cert" not found Oct 29 23:22:57.432744 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:22:57.432731 5976 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls podName:1d7577c1-350c-4fcb-b6e2-053c509b9152 nodeName:}" failed. No retries permitted until 2026-10-29 23:22:57.93269571 +0000 UTC m=+539.623349009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls") pod "maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" (UID: "1d7577c1-350c-4fcb-b6e2-053c509b9152") : secret "maas-api-e2e-ait-4afba12a-serving-cert" not found Oct 29 23:22:57.433294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.433265 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.435174 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.435154 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.475826 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.467891 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw5dw\" (UniqueName: \"kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.955356 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.955315 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:57.959815 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:57.959159 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\") pod \"maas-api-e2e-ait-4afba12a-59b8885475-v4tg6\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:58.133074 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:58.133034 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:58.454459 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:58.454426 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6"] Oct 29 23:22:58.729040 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:58.728955 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" event={"ID":"1d7577c1-350c-4fcb-b6e2-053c509b9152","Type":"ContainerStarted","Data":"6b8140fc44a9187694bafe10a40e9c4bb29a92d53372157d696d1e23965a9fa1"} Oct 29 23:22:59.713454 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:59.713422 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:22:59.735394 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:59.735360 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" event={"ID":"1d7577c1-350c-4fcb-b6e2-053c509b9152","Type":"ContainerStarted","Data":"343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012"} Oct 29 23:22:59.735563 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:59.735442 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:22:59.809820 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:22:59.809746 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" podStartSLOduration=2.427697009 podStartE2EDuration="2.809722099s" totalImagesPullingTime="382.02509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:59.790980934 +0000 UTC m=+541.481634242" watchObservedRunningTime="2026-10-29 23:22:59.809722099 +0000 UTC m=+541.500375407" Oct 29 23:23:00.673040 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:00.673007 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:23:00.717647 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:00.717613 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:23:01.679749 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:01.679702 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 29 23:23:01.679928 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:01.679769 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 29 23:23:02.688095 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:02.688067 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:23:03.764115 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:03.764081 5976 generic.go:356] "Generic (PLEG): container finished" podID="68a058f1-c110-4729-8a4e-56d5a0925457" containerID="50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2" exitCode=0 Oct 29 23:23:03.764539 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:03.764159 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" event={"ID":"68a058f1-c110-4729-8a4e-56d5a0925457","Type":"ContainerDied","Data":"50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2"} Oct 29 23:23:03.764621 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:03.764542 5976 scope.go:122] "RemoveContainer" containerID="50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2" Oct 29 23:23:03.765799 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:03.765767 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:03.765912 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:03.765853 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:03.765969 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:03.765933 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:04.771173 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:04.771132 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" event={"ID":"68a058f1-c110-4729-8a4e-56d5a0925457","Type":"ContainerStarted","Data":"2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd"} Oct 29 23:23:05.130640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.129991 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:23:05.130640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.130133 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:23:05.130640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.130183 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Oct 29 23:23:05.604582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.593077 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g"] Oct 29 23:23:05.628581 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.619643 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.639579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.632794 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-83198dc0-serving-cert\"" Oct 29 23:23:05.645601 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.640720 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g"] Oct 29 23:23:05.732163 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.732128 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:23:05.734443 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.734005 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjgzt\" (UniqueName: \"kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.734672 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.734647 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.734818 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.734799 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.735034 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.735016 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.748219 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.748196 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:23:05.838641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.837078 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.838641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.837131 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.838641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.837342 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.838641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.837467 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjgzt\" (UniqueName: \"kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.838641 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:05.837927 5976 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-serving-cert: secret "maas-api-e2e-derive-83198dc0-serving-cert" not found Oct 29 23:23:05.838641 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:05.837995 5976 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls podName:98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2 nodeName:}" failed. No retries permitted until 2026-10-29 23:23:06.337974175 +0000 UTC m=+548.028627481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls") pod "maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" (UID: "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2") : secret "maas-api-e2e-derive-83198dc0-serving-cert" not found Oct 29 23:23:05.839480 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.838957 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.843533 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.843098 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:05.863693 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:05.863611 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjgzt\" (UniqueName: \"kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:06.134008 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:06.133923 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:23:06.134222 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:06.134200 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Oct 29 23:23:06.359397 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:06.359363 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:06.362004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:06.361969 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\") pod \"maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:06.555143 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:06.555100 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:06.907905 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:06.907865 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g"] Oct 29 23:23:06.939253 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:06.939216 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a19f90_88d9_4f8b_a4b2_f3ec2e7866a2.slice/crio-d16b97891af4cd84330111ee8453212892b43f309929931c68d6389887e8bd9c WatchSource:0}: Error finding container d16b97891af4cd84330111ee8453212892b43f309929931c68d6389887e8bd9c: Status 404 returned error can't find the container with id d16b97891af4cd84330111ee8453212892b43f309929931c68d6389887e8bd9c Oct 29 23:23:07.130582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:07.130089 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:23:07.130582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:07.130154 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Oct 29 23:23:07.801579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:07.798163 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" event={"ID":"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2","Type":"ContainerStarted","Data":"fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22"} Oct 29 23:23:07.801913 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:07.801882 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" event={"ID":"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2","Type":"ContainerStarted","Data":"d16b97891af4cd84330111ee8453212892b43f309929931c68d6389887e8bd9c"} Oct 29 23:23:07.803041 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:07.803019 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:07.854148 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:07.853537 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" podStartSLOduration=2.441588439 podStartE2EDuration="2.853521634s" totalImagesPullingTime="411.933195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:07.852525924 +0000 UTC m=+549.543179228" watchObservedRunningTime="2026-10-29 23:23:07.853521634 +0000 UTC m=+549.544174940" Oct 29 23:23:08.136635 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:08.135969 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:23:08.136635 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:08.136031 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Oct 29 23:23:09.133670 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:09.130465 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:23:09.133670 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:09.130534 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Oct 29 23:23:10.156827 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:10.156784 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:23:10.160112 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:10.158073 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:23:10.160750 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:10.160695 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:23:12.854223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:12.854190 5976 generic.go:356] "Generic (PLEG): container finished" podID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerID="9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737" exitCode=0 Oct 29 23:23:12.854643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:12.854259 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" event={"ID":"56f114db-a6a4-4e5a-8080-a935c8785b7d","Type":"ContainerDied","Data":"9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737"} Oct 29 23:23:12.854724 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:12.854705 5976 scope.go:122] "RemoveContainer" containerID="9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737" Oct 29 23:23:12.856018 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:12.855986 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:12.856109 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:12.856056 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:12.856109 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:12.856087 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:13.861448 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:13.861415 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" event={"ID":"56f114db-a6a4-4e5a-8080-a935c8785b7d","Type":"ContainerStarted","Data":"b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2"} Oct 29 23:23:14.832148 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:14.832118 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:23:14.833394 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:14.833371 5976 patch_prober.go:29] interesting pod/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Oct 29 23:23:14.833505 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:14.833422 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Oct 29 23:23:14.840931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:14.840907 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:15.833242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:15.833194 5976 patch_prober.go:29] interesting pod/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Oct 29 23:23:15.833782 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:15.833264 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Oct 29 23:23:16.832481 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:16.832438 5976 patch_prober.go:29] interesting pod/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Oct 29 23:23:16.832689 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:16.832499 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Oct 29 23:23:17.753846 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:17.753796 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv"] Oct 29 23:23:17.833097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:17.833065 5976 patch_prober.go:29] interesting pod/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Oct 29 23:23:17.833279 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:17.833119 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Oct 29 23:23:18.661493 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:18.661455 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:23:18.832762 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:18.832725 5976 patch_prober.go:29] interesting pod/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Oct 29 23:23:18.833288 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:18.832791 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Oct 29 23:23:19.837196 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:19.837165 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:23:19.838242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:19.838217 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:23:20.068491 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:20.068446 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz"] Oct 29 23:23:22.755116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:22.755058 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" podUID="09119b16-1fb6-44c0-a136-49226df09437" containerName="payload-processing" containerID="cri-o://3f11e32a01c58b9e96c01d3a7a8ed968949ac23809dd830054db6c06c967bcf8" gracePeriod=25 Oct 29 23:23:22.834987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:22.834955 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5"] Oct 29 23:23:22.835225 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:22.835180 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" podUID="3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" containerName="maas-api" containerID="cri-o://5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376" gracePeriod=30 Oct 29 23:23:22.912837 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:22.912805 5976 generic.go:356] "Generic (PLEG): container finished" podID="09119b16-1fb6-44c0-a136-49226df09437" containerID="3f11e32a01c58b9e96c01d3a7a8ed968949ac23809dd830054db6c06c967bcf8" exitCode=0 Oct 29 23:23:22.912996 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:22.912886 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" event={"ID":"09119b16-1fb6-44c0-a136-49226df09437","Type":"ContainerDied","Data":"3f11e32a01c58b9e96c01d3a7a8ed968949ac23809dd830054db6c06c967bcf8"} Oct 29 23:23:23.107197 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.106904 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:23:23.167648 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.167614 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:23:23.280291 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.227008 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn"] Oct 29 23:23:23.280641 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.238534 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm\" (UniqueName: \"kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm\") pod \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " Oct 29 23:23:23.280934 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.268752 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm" pod "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" (UID: "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad"). InnerVolumeSpecName "kube-api-access-x2ctm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:23.281408 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.281367 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47\" (UniqueName: \"kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47\") pod \"09119b16-1fb6-44c0-a136-49226df09437\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " Oct 29 23:23:23.281493 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.281441 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs\") pod \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " Oct 29 23:23:23.281572 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.281491 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls\") pod \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " Oct 29 23:23:23.281572 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.281516 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca\") pod \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\" (UID: \"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad\") " Oct 29 23:23:23.281687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.281661 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume\") pod \"09119b16-1fb6-44c0-a136-49226df09437\" (UID: \"09119b16-1fb6-44c0-a136-49226df09437\") " Oct 29 23:23:23.282450 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.282427 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2ctm\" (UniqueName: \"kubernetes.io/projected/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-kube-api-access-x2ctm\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.282695 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.282666 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" podUID="0cb79da5-6c82-45c5-8907-158a0ee8dfdf" containerName="maas-api" containerID="cri-o://5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6" gracePeriod=30 Oct 29 23:23:23.282793 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.282767 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume" pod "09119b16-1fb6-44c0-a136-49226df09437" (UID: "09119b16-1fb6-44c0-a136-49226df09437"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:23.283758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.283347 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca" pod "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" (UID: "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:23.284800 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.284773 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs" pod "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" (UID: "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:23.285014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.284969 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls" pod "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" (UID: "3e70ad2c-ee7e-433b-ac0d-4d89ca71acad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:23.285246 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.285226 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47" pod "09119b16-1fb6-44c0-a136-49226df09437" (UID: "09119b16-1fb6-44c0-a136-49226df09437"). InnerVolumeSpecName "kube-api-access-bns47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:23.383018 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.382984 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bns47\" (UniqueName: \"kubernetes.io/projected/09119b16-1fb6-44c0-a136-49226df09437-kube-api-access-bns47\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.383018 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.383015 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.383018 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.383026 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.383258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.383035 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.383258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.383045 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09119b16-1fb6-44c0-a136-49226df09437-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.555179 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.555151 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:23:23.612073 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.612041 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll"] Oct 29 23:23:23.612275 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.612248 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" podUID="21739c2c-b526-4c3a-bf28-64e684fea426" containerName="maas-api" containerID="cri-o://1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d" gracePeriod=30 Oct 29 23:23:23.685969 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.685941 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca\") pod \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " Oct 29 23:23:23.686140 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.685998 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l\" (UniqueName: \"kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l\") pod \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " Oct 29 23:23:23.686140 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.686044 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls\") pod \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " Oct 29 23:23:23.686140 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.686101 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs\") pod \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\" (UID: \"0cb79da5-6c82-45c5-8907-158a0ee8dfdf\") " Oct 29 23:23:23.686395 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.686364 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca" pod "0cb79da5-6c82-45c5-8907-158a0ee8dfdf" (UID: "0cb79da5-6c82-45c5-8907-158a0ee8dfdf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:23.686596 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.686543 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.688362 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.688333 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l" pod "0cb79da5-6c82-45c5-8907-158a0ee8dfdf" (UID: "0cb79da5-6c82-45c5-8907-158a0ee8dfdf"). InnerVolumeSpecName "kube-api-access-fq89l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:23.688741 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.688719 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls" pod "0cb79da5-6c82-45c5-8907-158a0ee8dfdf" (UID: "0cb79da5-6c82-45c5-8907-158a0ee8dfdf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:23.688816 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.688747 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs" pod "0cb79da5-6c82-45c5-8907-158a0ee8dfdf" (UID: "0cb79da5-6c82-45c5-8907-158a0ee8dfdf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:23.787335 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.787296 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq89l\" (UniqueName: \"kubernetes.io/projected/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-kube-api-access-fq89l\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.787335 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.787338 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.787840 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.787353 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cb79da5-6c82-45c5-8907-158a0ee8dfdf-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:23.871906 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.871876 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:23:23.903715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.898334 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9\" (UniqueName: \"kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9\") pod \"21739c2c-b526-4c3a-bf28-64e684fea426\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " Oct 29 23:23:23.903715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.898605 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca\") pod \"21739c2c-b526-4c3a-bf28-64e684fea426\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " Oct 29 23:23:23.903715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.898645 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs\") pod \"21739c2c-b526-4c3a-bf28-64e684fea426\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " Oct 29 23:23:23.903715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.898692 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\") pod \"21739c2c-b526-4c3a-bf28-64e684fea426\" (UID: \"21739c2c-b526-4c3a-bf28-64e684fea426\") " Oct 29 23:23:23.903715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.899754 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca" pod "21739c2c-b526-4c3a-bf28-64e684fea426" (UID: "21739c2c-b526-4c3a-bf28-64e684fea426"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:23.905100 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.904680 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9" pod "21739c2c-b526-4c3a-bf28-64e684fea426" (UID: "21739c2c-b526-4c3a-bf28-64e684fea426"). InnerVolumeSpecName "kube-api-access-892b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:23.906465 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.906432 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls" pod "21739c2c-b526-4c3a-bf28-64e684fea426" (UID: "21739c2c-b526-4c3a-bf28-64e684fea426"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:23.908459 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.908407 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs" pod "21739c2c-b526-4c3a-bf28-64e684fea426" (UID: "21739c2c-b526-4c3a-bf28-64e684fea426"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:23.929619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.929584 5976 generic.go:356] "Generic (PLEG): container finished" podID="0cb79da5-6c82-45c5-8907-158a0ee8dfdf" containerID="5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6" exitCode=0 Oct 29 23:23:23.929778 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.929662 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" Oct 29 23:23:23.929778 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.929678 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" event={"ID":"0cb79da5-6c82-45c5-8907-158a0ee8dfdf","Type":"ContainerDied","Data":"5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6"} Oct 29 23:23:23.929778 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.929738 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn" event={"ID":"0cb79da5-6c82-45c5-8907-158a0ee8dfdf","Type":"ContainerDied","Data":"4bee63baf076847c2bd308887fc8f44bfd17aa3447b81223fa2d0d1ae86d8e2f"} Oct 29 23:23:23.929778 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.929767 5976 scope.go:122] "RemoveContainer" containerID="5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6" Oct 29 23:23:23.931396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.931364 5976 generic.go:356] "Generic (PLEG): container finished" podID="3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" containerID="5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376" exitCode=0 Oct 29 23:23:23.931514 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.931417 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" Oct 29 23:23:23.931514 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.931498 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" event={"ID":"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad","Type":"ContainerDied","Data":"5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376"} Oct 29 23:23:23.931653 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.931535 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5" event={"ID":"3e70ad2c-ee7e-433b-ac0d-4d89ca71acad","Type":"ContainerDied","Data":"99472e10fa89ee472714b69ad3bd6638aaf84ce334e18c7750fce075025b064c"} Oct 29 23:23:23.932982 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.932962 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" event={"ID":"09119b16-1fb6-44c0-a136-49226df09437","Type":"ContainerDied","Data":"75c1f5df0d0f165cc36e4f6250fbd522f5fb9e99f7749125d8047f858a526029"} Oct 29 23:23:23.933098 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.933042 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv" Oct 29 23:23:23.941825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.940889 5976 generic.go:356] "Generic (PLEG): container finished" podID="21739c2c-b526-4c3a-bf28-64e684fea426" containerID="1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d" exitCode=0 Oct 29 23:23:23.941825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.940981 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" event={"ID":"21739c2c-b526-4c3a-bf28-64e684fea426","Type":"ContainerDied","Data":"1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d"} Oct 29 23:23:23.941825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.941015 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" event={"ID":"21739c2c-b526-4c3a-bf28-64e684fea426","Type":"ContainerDied","Data":"0735012cfe0727384d692d80cdf3af44f0b141a0fb2659da02fbd37e2ff7c736"} Oct 29 23:23:23.941825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.941060 5976 scope.go:122] "RemoveContainer" containerID="5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6" Oct 29 23:23:23.941825 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.941154 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll" Oct 29 23:23:23.942142 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:23.942025 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6\": container with ID starting with 5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6 not found: ID does not exist" containerID="5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6" Oct 29 23:23:23.942142 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.942058 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6"} err="failed to get container status \"5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6\": rpc error: code = NotFound desc = could not find container \"5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6\": container with ID starting with 5d489a81fa1a5ff3deea1e9475d5c39edda5c6c1f442d69fc0802e29b32f68c6 not found: ID does not exist" Oct 29 23:23:23.942142 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.942081 5976 scope.go:122] "RemoveContainer" containerID="5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376" Oct 29 23:23:23.954351 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.954331 5976 scope.go:122] "RemoveContainer" containerID="5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376" Oct 29 23:23:23.954820 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:23.954784 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376\": container with ID starting with 5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376 not found: ID does not exist" containerID="5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376" Oct 29 23:23:23.954932 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.954830 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376"} err="failed to get container status \"5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376\": rpc error: code = NotFound desc = could not find container \"5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376\": container with ID starting with 5bf29e2f6301f7dbf9a1e0284c93c7aca136070f5054205952a1f748518ca376 not found: ID does not exist" Oct 29 23:23:23.954932 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.954852 5976 scope.go:122] "RemoveContainer" containerID="3f11e32a01c58b9e96c01d3a7a8ed968949ac23809dd830054db6c06c967bcf8" Oct 29 23:23:23.963281 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.963257 5976 scope.go:122] "RemoveContainer" containerID="1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d" Oct 29 23:23:23.971536 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.971513 5976 scope.go:122] "RemoveContainer" containerID="1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d" Oct 29 23:23:23.971825 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:23.971805 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d\": container with ID starting with 1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d not found: ID does not exist" containerID="1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d" Oct 29 23:23:23.971874 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:23.971834 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d"} err="failed to get container status \"1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d\": rpc error: code = NotFound desc = could not find container \"1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d\": container with ID starting with 1a296f6dc46ca8691a0044b37e6d9e5c1f996cfd27357c4a238c60b84195980d not found: ID does not exist" Oct 29 23:23:24.000066 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.000033 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21739c2c-b526-4c3a-bf28-64e684fea426-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:24.000066 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.000063 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:24.000228 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.000079 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21739c2c-b526-4c3a-bf28-64e684fea426-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:24.000228 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.000088 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-892b9\" (UniqueName: \"kubernetes.io/projected/21739c2c-b526-4c3a-bf28-64e684fea426-kube-api-access-892b9\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:24.009774 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.009745 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll"] Oct 29 23:23:24.014021 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.013997 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-85b460de-6f4495875f-rm7ll"] Oct 29 23:23:24.047579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.044420 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5"] Oct 29 23:23:24.048940 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.048907 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-46444d59-7f7dd779cf-2rbd5"] Oct 29 23:23:24.077868 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.077828 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv"] Oct 29 23:23:24.080183 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.080156 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-46444d59-778c555b4b-n8hqv"] Oct 29 23:23:24.132843 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.132759 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn"] Oct 29 23:23:24.134301 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.134273 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e687ff69-599876d56c-tf6bn"] Oct 29 23:23:24.432104 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.432068 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09119b16-1fb6-44c0-a136-49226df09437" path="/var/lib/kubelet/pods/09119b16-1fb6-44c0-a136-49226df09437/volumes" Oct 29 23:23:24.432736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.432714 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0cb79da5-6c82-45c5-8907-158a0ee8dfdf" path="/var/lib/kubelet/pods/0cb79da5-6c82-45c5-8907-158a0ee8dfdf/volumes" Oct 29 23:23:24.433281 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.433263 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21739c2c-b526-4c3a-bf28-64e684fea426" path="/var/lib/kubelet/pods/21739c2c-b526-4c3a-bf28-64e684fea426/volumes" Oct 29 23:23:24.434181 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.434161 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" path="/var/lib/kubelet/pods/3e70ad2c-ee7e-433b-ac0d-4d89ca71acad/volumes" Oct 29 23:23:24.968590 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:24.968520 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq"] Oct 29 23:23:25.069311 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.069233 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" podUID="875b0738-5e69-4dcb-954d-5d66d15c6260" containerName="payload-pre-processing" containerID="cri-o://e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280" gracePeriod=25 Oct 29 23:23:25.097151 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.097117 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt"] Oct 29 23:23:25.097438 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.097411 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" containerID="cri-o://2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd" gracePeriod=30 Oct 29 23:23:25.160895 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.160855 5976 patch_prober.go:29] interesting pod/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 29 23:23:25.161071 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.160926 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 29 23:23:25.316523 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.316494 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:23:25.321689 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.321663 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk\" (UniqueName: \"kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk\") pod \"875b0738-5e69-4dcb-954d-5d66d15c6260\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " Oct 29 23:23:25.321849 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.321762 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume\") pod \"875b0738-5e69-4dcb-954d-5d66d15c6260\" (UID: \"875b0738-5e69-4dcb-954d-5d66d15c6260\") " Oct 29 23:23:25.322218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.322186 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume" pod "875b0738-5e69-4dcb-954d-5d66d15c6260" (UID: "875b0738-5e69-4dcb-954d-5d66d15c6260"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:25.324219 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.324192 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk" pod "875b0738-5e69-4dcb-954d-5d66d15c6260" (UID: "875b0738-5e69-4dcb-954d-5d66d15c6260"). InnerVolumeSpecName "kube-api-access-fz9tk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:25.423146 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.423110 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz9tk\" (UniqueName: \"kubernetes.io/projected/875b0738-5e69-4dcb-954d-5d66d15c6260-kube-api-access-fz9tk\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:25.423146 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.423145 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/875b0738-5e69-4dcb-954d-5d66d15c6260-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:25.441203 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.441168 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj"] Oct 29 23:23:25.441987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.441944 5976 cpu_manager.go:414] "containerMap: removing container" podUID="3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" containerName="maas-api" Oct 29 23:23:25.441987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.441968 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" containerName="maas-api" Oct 29 23:23:25.441987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.441981 5976 cpu_manager.go:414] "containerMap: removing container" podUID="875b0738-5e69-4dcb-954d-5d66d15c6260" containerName="payload-pre-processing" Oct 29 23:23:25.441987 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.441988 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="875b0738-5e69-4dcb-954d-5d66d15c6260" containerName="payload-pre-processing" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442002 5976 cpu_manager.go:414] "containerMap: removing container" podUID="09119b16-1fb6-44c0-a136-49226df09437" containerName="payload-processing" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442009 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09119b16-1fb6-44c0-a136-49226df09437" containerName="payload-processing" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442018 5976 cpu_manager.go:414] "containerMap: removing container" podUID="21739c2c-b526-4c3a-bf28-64e684fea426" containerName="maas-api" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442024 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21739c2c-b526-4c3a-bf28-64e684fea426" containerName="maas-api" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442038 5976 cpu_manager.go:414] "containerMap: removing container" podUID="0cb79da5-6c82-45c5-8907-158a0ee8dfdf" containerName="maas-api" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442045 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0cb79da5-6c82-45c5-8907-158a0ee8dfdf" containerName="maas-api" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442166 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e70ad2c-ee7e-433b-ac0d-4d89ca71acad" containerName="maas-api" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442177 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="875b0738-5e69-4dcb-954d-5d66d15c6260" containerName="payload-pre-processing" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442186 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="09119b16-1fb6-44c0-a136-49226df09437" containerName="payload-processing" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442197 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="21739c2c-b526-4c3a-bf28-64e684fea426" containerName="maas-api" Oct 29 23:23:25.442294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.442205 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="0cb79da5-6c82-45c5-8907-158a0ee8dfdf" containerName="maas-api" Oct 29 23:23:25.444830 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.444808 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.465368 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.465345 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-105882-openshift-default-dockercfg-d9v6v\"" Oct 29 23:23:25.494389 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.494306 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj"] Oct 29 23:23:25.524583 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524536 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.524583 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524588 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.524809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524616 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl855\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.524809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524752 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.524809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524786 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.524948 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524817 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.524948 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524883 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.525030 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524954 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.525030 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.524972 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626182 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626145 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626182 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626182 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626205 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl855\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626339 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626384 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626423 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626460 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626592 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626605 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626625 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626882 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626723 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.626933 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626867 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.627070 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.626941 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.627230 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.627209 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.628783 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.628759 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.628890 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.628856 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.642969 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.642941 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl855\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.643104 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.643082 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.760184 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.760080 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:25.958901 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.958863 5976 generic.go:356] "Generic (PLEG): container finished" podID="875b0738-5e69-4dcb-954d-5d66d15c6260" containerID="e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280" exitCode=0 Oct 29 23:23:25.959091 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.958934 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" Oct 29 23:23:25.959091 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.958957 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" event={"ID":"875b0738-5e69-4dcb-954d-5d66d15c6260","Type":"ContainerDied","Data":"e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280"} Oct 29 23:23:25.959091 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.959030 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz" event={"ID":"875b0738-5e69-4dcb-954d-5d66d15c6260","Type":"ContainerDied","Data":"6dea0c9a2b4e103fe390adf8019eac637406f83bc5b4fff56cd1791d3cd269bc"} Oct 29 23:23:25.959091 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.959060 5976 scope.go:122] "RemoveContainer" containerID="e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280" Oct 29 23:23:25.975677 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.975660 5976 scope.go:122] "RemoveContainer" containerID="e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280" Oct 29 23:23:25.975987 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:25.975958 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280\": container with ID starting with e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280 not found: ID does not exist" containerID="e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280" Oct 29 23:23:25.976029 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:25.975983 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280"} err="failed to get container status \"e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280\": rpc error: code = NotFound desc = could not find container \"e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280\": container with ID starting with e337c9bdad85fcdbc975ca61fc36c8a52da14fd2049e9611f05a55cb6ac39280 not found: ID does not exist" Oct 29 23:23:26.004051 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.004021 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz"] Oct 29 23:23:26.007096 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.007075 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-85b460de-5dd9bc6fd7-v99xz"] Oct 29 23:23:26.073543 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.072695 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj"] Oct 29 23:23:26.077858 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:26.077824 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baace46_5f61_4993_b4f2_5eae802dc533.slice/crio-8639cb4f5a886dd4c1468e3ee939e17f14a0446697803020395a1379ac24315b WatchSource:0}: Error finding container 8639cb4f5a886dd4c1468e3ee939e17f14a0446697803020395a1379ac24315b: Status 404 returned error can't find the container with id 8639cb4f5a886dd4c1468e3ee939e17f14a0446697803020395a1379ac24315b Oct 29 23:23:26.084520 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.083108 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:26.084520 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.083212 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:26.086452 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.084742 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:26.446404 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.445946 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="875b0738-5e69-4dcb-954d-5d66d15c6260" path="/var/lib/kubelet/pods/875b0738-5e69-4dcb-954d-5d66d15c6260/volumes" Oct 29 23:23:26.965033 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.964995 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" event={"ID":"2baace46-5f61-4993-b4f2-5eae802dc533","Type":"ContainerStarted","Data":"1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77"} Oct 29 23:23:26.965227 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:26.965061 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" event={"ID":"2baace46-5f61-4993-b4f2-5eae802dc533","Type":"ContainerStarted","Data":"8639cb4f5a886dd4c1468e3ee939e17f14a0446697803020395a1379ac24315b"} Oct 29 23:23:27.024699 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.024545 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podStartSLOduration=2.024526151 podStartE2EDuration="2.024526151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:27.013513906 +0000 UTC m=+568.704167213" watchObservedRunningTime="2026-10-29 23:23:27.024526151 +0000 UTC m=+568.715179461" Oct 29 23:23:27.255588 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:27.255488 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:23:27.761072 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.761039 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:27.766328 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.766300 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:27.960787 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.960754 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6"] Oct 29 23:23:27.961004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.960982 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" podUID="1d7577c1-350c-4fcb-b6e2-053c509b9152" containerName="maas-api" containerID="cri-o://343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012" gracePeriod=30 Oct 29 23:23:27.972812 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.972634 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:27.991016 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:27.990986 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:28.253396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.253369 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:23:28.357414 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.357328 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\") pod \"1d7577c1-350c-4fcb-b6e2-053c509b9152\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " Oct 29 23:23:28.357414 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.357371 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs\") pod \"1d7577c1-350c-4fcb-b6e2-053c509b9152\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " Oct 29 23:23:28.357610 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.357495 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca\") pod \"1d7577c1-350c-4fcb-b6e2-053c509b9152\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " Oct 29 23:23:28.357610 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.357537 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw\" (UniqueName: \"kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw\") pod \"1d7577c1-350c-4fcb-b6e2-053c509b9152\" (UID: \"1d7577c1-350c-4fcb-b6e2-053c509b9152\") " Oct 29 23:23:28.357880 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.357854 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca" pod "1d7577c1-350c-4fcb-b6e2-053c509b9152" (UID: "1d7577c1-350c-4fcb-b6e2-053c509b9152"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:28.359682 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.359651 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls" pod "1d7577c1-350c-4fcb-b6e2-053c509b9152" (UID: "1d7577c1-350c-4fcb-b6e2-053c509b9152"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:28.359818 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.359794 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw" pod "1d7577c1-350c-4fcb-b6e2-053c509b9152" (UID: "1d7577c1-350c-4fcb-b6e2-053c509b9152"). InnerVolumeSpecName "kube-api-access-gw5dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:28.359883 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.359812 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs" pod "1d7577c1-350c-4fcb-b6e2-053c509b9152" (UID: "1d7577c1-350c-4fcb-b6e2-053c509b9152"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:28.458321 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.458294 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7577c1-350c-4fcb-b6e2-053c509b9152-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:28.458431 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.458324 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw5dw\" (UniqueName: \"kubernetes.io/projected/1d7577c1-350c-4fcb-b6e2-053c509b9152-kube-api-access-gw5dw\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:28.458431 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.458338 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:28.458431 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.458350 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7577c1-350c-4fcb-b6e2-053c509b9152-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:28.978430 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.978387 5976 generic.go:356] "Generic (PLEG): container finished" podID="1d7577c1-350c-4fcb-b6e2-053c509b9152" containerID="343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012" exitCode=0 Oct 29 23:23:28.978659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.978441 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" event={"ID":"1d7577c1-350c-4fcb-b6e2-053c509b9152","Type":"ContainerDied","Data":"343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012"} Oct 29 23:23:28.978659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.978457 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" Oct 29 23:23:28.978659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.978520 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6" event={"ID":"1d7577c1-350c-4fcb-b6e2-053c509b9152","Type":"ContainerDied","Data":"6b8140fc44a9187694bafe10a40e9c4bb29a92d53372157d696d1e23965a9fa1"} Oct 29 23:23:28.978659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.978548 5976 scope.go:122] "RemoveContainer" containerID="343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012" Oct 29 23:23:28.988314 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.988296 5976 scope.go:122] "RemoveContainer" containerID="343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012" Oct 29 23:23:28.988630 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:28.988605 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012\": container with ID starting with 343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012 not found: ID does not exist" containerID="343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012" Oct 29 23:23:28.988630 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:28.988634 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012"} err="failed to get container status \"343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012\": rpc error: code = NotFound desc = could not find container \"343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012\": container with ID starting with 343df0cc6afbf93e5f0df8a515128bed86e48b2153f67799580517cb4b1ad012 not found: ID does not exist" Oct 29 23:23:29.019968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:29.019925 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6"] Oct 29 23:23:29.029136 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:29.029110 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4afba12a-59b8885475-v4tg6"] Oct 29 23:23:29.461936 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:29.461901 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq"] Oct 29 23:23:29.462823 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:29.462162 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" containerID="cri-o://b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2" gracePeriod=30 Oct 29 23:23:29.969614 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:29.969567 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" podUID="661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" containerName="payload-pre-processing" containerID="cri-o://7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d" gracePeriod=25 Oct 29 23:23:30.225326 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.225272 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:23:30.281146 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.281113 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume\") pod \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " Oct 29 23:23:30.281290 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.281268 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4\" (UniqueName: \"kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4\") pod \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\" (UID: \"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2\") " Oct 29 23:23:30.281610 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.281577 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume" pod "661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" (UID: "661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:30.283829 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.283800 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4" pod "661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" (UID: "661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2"). InnerVolumeSpecName "kube-api-access-dbss4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:30.357655 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.357630 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:23:30.382247 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382220 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382284 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382355 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382397 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382587 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382457 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382587 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382505 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:30.382587 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382521 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382587 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382570 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382602 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382628 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy\") pod \"68a058f1-c110-4729-8a4e-56d5a0925457\" (UID: \"68a058f1-c110-4729-8a4e-56d5a0925457\") " Oct 29 23:23:30.382809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382728 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:30.382946 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382908 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:30.383004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382939 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:30.383004 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.382969 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:30.383451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383252 5976 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.383451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383403 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbss4\" (UniqueName: \"kubernetes.io/projected/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-kube-api-access-dbss4\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.383451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383421 5976 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68a058f1-c110-4729-8a4e-56d5a0925457-istiod-ca-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.383451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383435 5976 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-workload-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.383451 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383448 5976 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-data\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.383967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383462 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.383967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.383475 5976 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-credential-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.384874 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.384852 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:23:30.385022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.385003 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:30.385169 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.385149 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "kube-api-access-vm8s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:30.385276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.385209 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy" pod "68a058f1-c110-4729-8a4e-56d5a0925457" (UID: "68a058f1-c110-4729-8a4e-56d5a0925457"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:30.431278 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.431243 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1d7577c1-350c-4fcb-b6e2-053c509b9152" path="/var/lib/kubelet/pods/1d7577c1-350c-4fcb-b6e2-053c509b9152/volumes" Oct 29 23:23:30.484899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.484804 5976 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-istio-token\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.484899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.484842 5976 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68a058f1-c110-4729-8a4e-56d5a0925457-istio-podinfo\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.484899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.484856 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm8s6\" (UniqueName: \"kubernetes.io/projected/68a058f1-c110-4729-8a4e-56d5a0925457-kube-api-access-vm8s6\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.484899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.484870 5976 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68a058f1-c110-4729-8a4e-56d5a0925457-istio-envoy\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:30.999809 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.999766 5976 generic.go:356] "Generic (PLEG): container finished" podID="68a058f1-c110-4729-8a4e-56d5a0925457" containerID="2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd" exitCode=0 Oct 29 23:23:31.000014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.999842 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" event={"ID":"68a058f1-c110-4729-8a4e-56d5a0925457","Type":"ContainerDied","Data":"2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd"} Oct 29 23:23:31.000014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.999899 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" Oct 29 23:23:31.000014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.999943 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt" event={"ID":"68a058f1-c110-4729-8a4e-56d5a0925457","Type":"ContainerDied","Data":"e12c000cf435fabe6a66e77f80c03583b4e45759457590e2a1b7a0c9aae1258f"} Oct 29 23:23:31.000014 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:30.999976 5976 scope.go:122] "RemoveContainer" containerID="2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd" Oct 29 23:23:31.001677 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.001649 5976 generic.go:356] "Generic (PLEG): container finished" podID="661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" containerID="7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d" exitCode=0 Oct 29 23:23:31.001748 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.001699 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" Oct 29 23:23:31.001748 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.001727 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" event={"ID":"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2","Type":"ContainerDied","Data":"7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d"} Oct 29 23:23:31.001907 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.001833 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq" event={"ID":"661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2","Type":"ContainerDied","Data":"260475a268f14c239574ded1443d215a2fab1afb092c3aead7258d54a45d29f5"} Oct 29 23:23:31.009477 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.009458 5976 scope.go:122] "RemoveContainer" containerID="50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2" Oct 29 23:23:31.018101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.018080 5976 scope.go:122] "RemoveContainer" containerID="2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd" Oct 29 23:23:31.018385 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:31.018362 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd\": container with ID starting with 2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd not found: ID does not exist" containerID="2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd" Oct 29 23:23:31.018456 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.018399 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd"} err="failed to get container status \"2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd\": rpc error: code = NotFound desc = could not find container \"2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd\": container with ID starting with 2007f407f1dd26d99991662d7b47a081ee7688f5fc01a7e51438c8cabccedbbd not found: ID does not exist" Oct 29 23:23:31.018456 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.018426 5976 scope.go:122] "RemoveContainer" containerID="50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2" Oct 29 23:23:31.018714 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:31.018697 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2\": container with ID starting with 50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2 not found: ID does not exist" containerID="50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2" Oct 29 23:23:31.018758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.018724 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2"} err="failed to get container status \"50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2\": rpc error: code = NotFound desc = could not find container \"50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2\": container with ID starting with 50b140355bc9b29479027b14846c3122c4b737b86f28641181e44b352dace8a2 not found: ID does not exist" Oct 29 23:23:31.018758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.018745 5976 scope.go:122] "RemoveContainer" containerID="7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d" Oct 29 23:23:31.026846 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.026823 5976 scope.go:122] "RemoveContainer" containerID="7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d" Oct 29 23:23:31.027104 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:31.027085 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d\": container with ID starting with 7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d not found: ID does not exist" containerID="7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d" Oct 29 23:23:31.027149 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.027112 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d"} err="failed to get container status \"7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d\": rpc error: code = NotFound desc = could not find container \"7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d\": container with ID starting with 7445e98978b172dbe9ae05379cab6aa1567afe7854fccee34c3ddaed0df3d02d not found: ID does not exist" Oct 29 23:23:31.053169 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.053110 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt"] Oct 29 23:23:31.062537 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.062504 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-46444d59-openshift-default-6cbcd65d85-ms9kt"] Oct 29 23:23:31.087230 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.087198 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq"] Oct 29 23:23:31.090450 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:31.090425 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4afba12a-6769fbff79-bxmxq"] Oct 29 23:23:32.404774 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.404740 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d"] Oct 29 23:23:32.405207 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405180 5976 cpu_manager.go:414] "containerMap: removing container" podUID="661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" containerName="payload-pre-processing" Oct 29 23:23:32.405207 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405203 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" containerName="payload-pre-processing" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405233 5976 cpu_manager.go:414] "containerMap: removing container" podUID="1d7577c1-350c-4fcb-b6e2-053c509b9152" containerName="maas-api" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405239 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1d7577c1-350c-4fcb-b6e2-053c509b9152" containerName="maas-api" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405245 5976 cpu_manager.go:414] "containerMap: removing container" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405250 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405257 5976 cpu_manager.go:414] "containerMap: removing container" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405261 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405356 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" containerName="payload-pre-processing" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405368 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="1d7577c1-350c-4fcb-b6e2-053c509b9152" containerName="maas-api" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405373 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" Oct 29 23:23:32.405411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.405380 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" containerName="istio-proxy" Oct 29 23:23:32.409508 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.409486 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.429420 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.429391 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2" path="/var/lib/kubelet/pods/661c20e3-d7b9-41bd-bb7e-55e6c3bd1dd2/volumes" Oct 29 23:23:32.429843 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.429830 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68a058f1-c110-4729-8a4e-56d5a0925457" path="/var/lib/kubelet/pods/68a058f1-c110-4729-8a4e-56d5a0925457/volumes" Oct 29 23:23:32.430478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.430424 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d"] Oct 29 23:23:32.485774 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.485742 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-105882\"" Oct 29 23:23:32.508466 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.508420 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.508681 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.508520 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwshn\" (UniqueName: \"kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn\") pod \"payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.530469 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.530431 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj"] Oct 29 23:23:32.534104 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.534074 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.551579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.551366 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj"] Oct 29 23:23:32.609585 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.609534 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.609777 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.609752 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.609832 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.609801 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwshn\" (UniqueName: \"kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn\") pod \"payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.609922 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.609905 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9rhh\" (UniqueName: \"kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh\") pod \"payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.610479 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.610453 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.622862 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.622833 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-105882-dockercfg-rrnkb\"" Oct 29 23:23:32.626545 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.626522 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwshn\" (UniqueName: \"kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn\") pod \"payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.711200 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.711100 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9rhh\" (UniqueName: \"kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh\") pod \"payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.711200 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.711166 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.711873 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.711852 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.721006 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.720977 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:32.728403 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.728379 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9rhh\" (UniqueName: \"kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh\") pod \"payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.854320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.854281 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:32.910417 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.910306 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj"] Oct 29 23:23:32.917424 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.914886 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:32.931743 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.931716 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj"] Oct 29 23:23:32.932746 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:32.932719 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-105882-serving-cert\"" Oct 29 23:23:33.015275 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.015137 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.015358 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.015270 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.015358 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.015319 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.015883 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.015497 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh7tr\" (UniqueName: \"kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.015883 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.015522 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d"] Oct 29 23:23:33.018026 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:33.018002 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794401e9_08b7_4490_8314_84c5db83d537.slice/crio-9aed6ad753c1ecf394b52bb312173a7b904747f931e34a0bdc926f3c017b45d8 WatchSource:0}: Error finding container 9aed6ad753c1ecf394b52bb312173a7b904747f931e34a0bdc926f3c017b45d8: Status 404 returned error can't find the container with id 9aed6ad753c1ecf394b52bb312173a7b904747f931e34a0bdc926f3c017b45d8 Oct 29 23:23:33.116613 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.116565 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.116801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.116647 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.116801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.116672 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.116801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.116713 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh7tr\" (UniqueName: \"kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.117344 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.117321 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.119066 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.119045 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.119473 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.119450 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.136139 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.136114 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh7tr\" (UniqueName: \"kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr\") pod \"maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.154874 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.154780 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj"] Oct 29 23:23:33.157180 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:33.157153 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8079fbb5_7e98_4688_a4ef_d0e7e536b9f8.slice/crio-3d458d3145971ae63d27fe9d50e6f8b5ee0f1e2022ae6b492a39e28dce412c96 WatchSource:0}: Error finding container 3d458d3145971ae63d27fe9d50e6f8b5ee0f1e2022ae6b492a39e28dce412c96: Status 404 returned error can't find the container with id 3d458d3145971ae63d27fe9d50e6f8b5ee0f1e2022ae6b492a39e28dce412c96 Oct 29 23:23:33.229882 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.229856 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:33.439882 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.439846 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww"] Oct 29 23:23:33.446766 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.445927 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.461540 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.460916 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww"] Oct 29 23:23:33.465011 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.464983 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-bed4a2-dockercfg-pfnmb\"" Oct 29 23:23:33.465148 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.465078 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-bed4a2\"" Oct 29 23:23:33.520952 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.520916 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.521143 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.520971 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zbjd\" (UniqueName: \"kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd\") pod \"payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.528977 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.528939 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj"] Oct 29 23:23:33.530901 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:33.530875 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503cc8b1_d5b6_4cb2_9708_65a8280fe3b0.slice/crio-c8e3445b45c0020fd066f65c58b30803f155647bd2ea98a22396f0c95ffa41b9 WatchSource:0}: Error finding container c8e3445b45c0020fd066f65c58b30803f155647bd2ea98a22396f0c95ffa41b9: Status 404 returned error can't find the container with id c8e3445b45c0020fd066f65c58b30803f155647bd2ea98a22396f0c95ffa41b9 Oct 29 23:23:33.622263 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.622228 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zbjd\" (UniqueName: \"kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd\") pod \"payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.622464 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.622352 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.623032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.623012 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.638967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.638943 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zbjd\" (UniqueName: \"kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd\") pod \"payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:33.767702 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:33.767667 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:34.020437 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.020384 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" event={"ID":"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8","Type":"ContainerStarted","Data":"f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b"} Oct 29 23:23:34.020659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.020449 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" event={"ID":"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8","Type":"ContainerStarted","Data":"3d458d3145971ae63d27fe9d50e6f8b5ee0f1e2022ae6b492a39e28dce412c96"} Oct 29 23:23:34.020659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.020600 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:34.022124 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.022102 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" event={"ID":"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0","Type":"ContainerStarted","Data":"7fba09c49e13b360e27a8cf0532a018835bd2ff3823036a5847999422ed318ab"} Oct 29 23:23:34.022253 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.022149 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" event={"ID":"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0","Type":"ContainerStarted","Data":"c8e3445b45c0020fd066f65c58b30803f155647bd2ea98a22396f0c95ffa41b9"} Oct 29 23:23:34.022253 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.022176 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:34.024206 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.024180 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" event={"ID":"794401e9-08b7-4490-8314-84c5db83d537","Type":"ContainerStarted","Data":"d714b4ec2a61ccac0c5cc0fe2a5b3e9209cd8ef8a985eb438e4fa425e97cc63d"} Oct 29 23:23:34.024307 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.024230 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" event={"ID":"794401e9-08b7-4490-8314-84c5db83d537","Type":"ContainerStarted","Data":"9aed6ad753c1ecf394b52bb312173a7b904747f931e34a0bdc926f3c017b45d8"} Oct 29 23:23:34.024307 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.024288 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:34.054037 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.053934 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" podStartSLOduration=2.053920522 podStartE2EDuration="2.053920522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:34.053626059 +0000 UTC m=+575.744279366" watchObservedRunningTime="2026-10-29 23:23:34.053920522 +0000 UTC m=+575.744573828" Oct 29 23:23:34.066357 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.066317 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww"] Oct 29 23:23:34.071402 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:34.071374 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1b9014_b9fd_44b5_ac22_1434700c1928.slice/crio-1bba770d8112a17e3c7143b7fb495b3cf295e2bba04f1e7e2150749a9610fcac WatchSource:0}: Error finding container 1bba770d8112a17e3c7143b7fb495b3cf295e2bba04f1e7e2150749a9610fcac: Status 404 returned error can't find the container with id 1bba770d8112a17e3c7143b7fb495b3cf295e2bba04f1e7e2150749a9610fcac Oct 29 23:23:34.087765 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.087718 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" podStartSLOduration=1.744294996 podStartE2EDuration="2.087703232s" totalImagesPullingTime="343.408236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:34.086329336 +0000 UTC m=+575.776982644" watchObservedRunningTime="2026-10-29 23:23:34.087703232 +0000 UTC m=+575.778356540" Oct 29 23:23:34.119525 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.119481 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" podStartSLOduration=2.11946969 podStartE2EDuration="2.11946969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:34.118411866 +0000 UTC m=+575.809065172" watchObservedRunningTime="2026-10-29 23:23:34.11946969 +0000 UTC m=+575.810122996" Oct 29 23:23:34.719694 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.719656 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg"] Oct 29 23:23:34.723481 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.723456 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.735406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.735384 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-bacddc-dockercfg-r2qws\"" Oct 29 23:23:34.735710 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.735692 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-bacddc\"" Oct 29 23:23:34.741407 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.741378 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.741516 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.741417 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l4bg\" (UniqueName: \"kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg\") pod \"payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.746820 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.746790 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg"] Oct 29 23:23:34.757637 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.757614 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:23:34.771521 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.771476 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt"] Oct 29 23:23:34.772409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.772374 5976 cpu_manager.go:414] "containerMap: removing container" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" Oct 29 23:23:34.772409 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.772404 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" Oct 29 23:23:34.772586 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.772456 5976 cpu_manager.go:414] "containerMap: removing container" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" Oct 29 23:23:34.772586 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.772465 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" Oct 29 23:23:34.772659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.772637 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" Oct 29 23:23:34.775248 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.775228 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:34.796393 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.796366 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt"] Oct 29 23:23:34.844216 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.844163 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:34.844404 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.844247 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsc5x\" (UniqueName: \"kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x\") pod \"payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:34.844466 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.844403 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.844466 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.844450 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l4bg\" (UniqueName: \"kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg\") pod \"payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.845924 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.845896 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume\") pod \"payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.861526 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.861492 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l4bg\" (UniqueName: \"kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg\") pod \"payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:34.892186 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.892151 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t"] Oct 29 23:23:34.892876 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.892853 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerName="istio-proxy" Oct 29 23:23:34.895383 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.895361 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:34.907157 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.907136 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-bed4a2-serving-cert\"" Oct 29 23:23:34.917813 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.917781 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t"] Oct 29 23:23:34.945054 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945021 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945194 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945084 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945194 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945140 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945312 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945207 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945312 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945238 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945312 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945273 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945444 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945328 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:34.945444 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945343 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945444 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945415 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945534 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945475 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy\") pod \"56f114db-a6a4-4e5a-8080-a935c8785b7d\" (UID: \"56f114db-a6a4-4e5a-8080-a935c8785b7d\") " Oct 29 23:23:34.945833 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945768 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:34.945937 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.945829 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:34.946073 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946048 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:34.946303 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946274 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:34.946389 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946335 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkndd\" (UniqueName: \"kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:34.946443 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946387 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsc5x\" (UniqueName: \"kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x\") pod \"payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:34.946443 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946410 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:34.946548 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946440 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:34.946765 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946743 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:34.946901 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.946887 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:34.947040 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.947029 5976 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-credential-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:34.947127 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.947116 5976 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-data\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:34.947201 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.947192 5976 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:34.947273 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.947264 5976 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56f114db-a6a4-4e5a-8080-a935c8785b7d-istiod-ca-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:34.947350 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.947340 5976 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-workload-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:34.947542 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.947516 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:34.948349 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.948323 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:34.948958 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.948934 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:23:34.949134 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.949113 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:23:34.949790 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.949769 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7" pod "56f114db-a6a4-4e5a-8080-a935c8785b7d" (UID: "56f114db-a6a4-4e5a-8080-a935c8785b7d"). InnerVolumeSpecName "kube-api-access-kgzm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:34.962920 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:34.962899 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsc5x\" (UniqueName: \"kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x\") pod \"payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:35.031221 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.031128 5976 generic.go:356] "Generic (PLEG): container finished" podID="56f114db-a6a4-4e5a-8080-a935c8785b7d" containerID="b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2" exitCode=0 Oct 29 23:23:35.031221 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.031181 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" Oct 29 23:23:35.031406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.031228 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" event={"ID":"56f114db-a6a4-4e5a-8080-a935c8785b7d","Type":"ContainerDied","Data":"b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2"} Oct 29 23:23:35.031406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.031283 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq" event={"ID":"56f114db-a6a4-4e5a-8080-a935c8785b7d","Type":"ContainerDied","Data":"747c060f223d2b88c3107721b7ca1fd05d8b030998dbdb964342c30dff277f6c"} Oct 29 23:23:35.031406 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.031306 5976 scope.go:122] "RemoveContainer" containerID="b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2" Oct 29 23:23:35.033294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.033266 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" event={"ID":"4c1b9014-b9fd-44b5-ac22-1434700c1928","Type":"ContainerStarted","Data":"ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0"} Oct 29 23:23:35.033432 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.033318 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" event={"ID":"4c1b9014-b9fd-44b5-ac22-1434700c1928","Type":"ContainerStarted","Data":"1bba770d8112a17e3c7143b7fb495b3cf295e2bba04f1e7e2150749a9610fcac"} Oct 29 23:23:35.041217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.041200 5976 scope.go:122] "RemoveContainer" containerID="9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737" Oct 29 23:23:35.048699 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.048666 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkndd\" (UniqueName: \"kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.048829 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.048760 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.048896 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.048841 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.048965 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.048948 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.049159 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.049136 5976 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-envoy\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:35.049235 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.049167 5976 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-token\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:35.049235 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.049182 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgzm7\" (UniqueName: \"kubernetes.io/projected/56f114db-a6a4-4e5a-8080-a935c8785b7d-kube-api-access-kgzm7\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:35.049235 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.049201 5976 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56f114db-a6a4-4e5a-8080-a935c8785b7d-istio-podinfo\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:35.050041 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.050019 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.050569 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.050533 5976 scope.go:122] "RemoveContainer" containerID="b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2" Oct 29 23:23:35.050890 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:35.050857 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2\": container with ID starting with b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2 not found: ID does not exist" containerID="b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2" Oct 29 23:23:35.050992 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.050904 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2"} err="failed to get container status \"b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2\": rpc error: code = NotFound desc = could not find container \"b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2\": container with ID starting with b6cb1f946c18ab2a5cfafd411667a77eec9c279e601df6928a5ae4af1a1f48f2 not found: ID does not exist" Oct 29 23:23:35.050992 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.050926 5976 scope.go:122] "RemoveContainer" containerID="9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737" Oct 29 23:23:35.051272 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:35.051251 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737\": container with ID starting with 9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737 not found: ID does not exist" containerID="9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737" Oct 29 23:23:35.051333 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.051285 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737"} err="failed to get container status \"9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737\": rpc error: code = NotFound desc = could not find container \"9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737\": container with ID starting with 9a4205f5ee4153e8e2d275be435695adad2d10840c33b6c539beec3b214c2737 not found: ID does not exist" Oct 29 23:23:35.051539 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.051517 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.051892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.051578 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.056743 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.056702 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:35.064761 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.064740 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkndd\" (UniqueName: \"kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd\") pod \"maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.075984 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.075934 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" podStartSLOduration=2.075920621 podStartE2EDuration="2.075920621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:35.075178533 +0000 UTC m=+576.765831840" watchObservedRunningTime="2026-10-29 23:23:35.075920621 +0000 UTC m=+576.766573927" Oct 29 23:23:35.087327 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.087299 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:35.105668 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.105639 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq"] Oct 29 23:23:35.112278 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.112234 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4afba12a-openshift-default-8599d5468f-6bkbq"] Oct 29 23:23:35.219604 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.208763 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:35.363960 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.363823 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg"] Oct 29 23:23:35.367705 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:35.367674 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401c84c2_675f_4455_bb07_dd6e281bb97d.slice/crio-832bcfc1a5de6a8535169d76140a93ea9ad879d8224affd54fd12734dfd7c450 WatchSource:0}: Error finding container 832bcfc1a5de6a8535169d76140a93ea9ad879d8224affd54fd12734dfd7c450: Status 404 returned error can't find the container with id 832bcfc1a5de6a8535169d76140a93ea9ad879d8224affd54fd12734dfd7c450 Oct 29 23:23:35.405656 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.405620 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt"] Oct 29 23:23:35.409950 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:35.409921 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10871cb6_f432_4c76_ac1c_15d085082be3.slice/crio-47824323487cc8e3006b077507863f8eac4ad170a002ef81d3daa46d3348125d WatchSource:0}: Error finding container 47824323487cc8e3006b077507863f8eac4ad170a002ef81d3daa46d3348125d: Status 404 returned error can't find the container with id 47824323487cc8e3006b077507863f8eac4ad170a002ef81d3daa46d3348125d Oct 29 23:23:35.520322 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:35.520289 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t"] Oct 29 23:23:35.526114 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:35.526086 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5a0a78_5d1e_407d_aa4c_97e7c06a7531.slice/crio-add83aca360dfaee90299a417cd1cdc1e8bd32cb0059e6834e7ff58e9c4b2790 WatchSource:0}: Error finding container add83aca360dfaee90299a417cd1cdc1e8bd32cb0059e6834e7ff58e9c4b2790: Status 404 returned error can't find the container with id add83aca360dfaee90299a417cd1cdc1e8bd32cb0059e6834e7ff58e9c4b2790 Oct 29 23:23:36.039879 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.039776 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" event={"ID":"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531","Type":"ContainerStarted","Data":"d47db69b32f7b615c87ab6482cd9c92881eb65900daa0c4d643781d8536a3abe"} Oct 29 23:23:36.040296 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.039878 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" event={"ID":"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531","Type":"ContainerStarted","Data":"add83aca360dfaee90299a417cd1cdc1e8bd32cb0059e6834e7ff58e9c4b2790"} Oct 29 23:23:36.040296 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.039903 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:36.041485 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.041456 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" event={"ID":"401c84c2-675f-4455-bb07-dd6e281bb97d","Type":"ContainerStarted","Data":"57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7"} Oct 29 23:23:36.041584 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.041509 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" event={"ID":"401c84c2-675f-4455-bb07-dd6e281bb97d","Type":"ContainerStarted","Data":"832bcfc1a5de6a8535169d76140a93ea9ad879d8224affd54fd12734dfd7c450"} Oct 29 23:23:36.041584 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.041539 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:36.043757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.043730 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" event={"ID":"10871cb6-f432-4c76-ac1c-15d085082be3","Type":"ContainerStarted","Data":"36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd"} Oct 29 23:23:36.043850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.043801 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" event={"ID":"10871cb6-f432-4c76-ac1c-15d085082be3","Type":"ContainerStarted","Data":"47824323487cc8e3006b077507863f8eac4ad170a002ef81d3daa46d3348125d"} Oct 29 23:23:36.043984 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.043968 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:36.073407 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.073357 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" podStartSLOduration=1.815293224 podStartE2EDuration="2.073344306s" totalImagesPullingTime="258.051082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:36.072396618 +0000 UTC m=+577.763049936" watchObservedRunningTime="2026-10-29 23:23:36.073344306 +0000 UTC m=+577.763997606" Oct 29 23:23:36.111672 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.111617 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" podStartSLOduration=2.111602644 podStartE2EDuration="2.111602644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:36.11067726 +0000 UTC m=+577.801330569" watchObservedRunningTime="2026-10-29 23:23:36.111602644 +0000 UTC m=+577.802255952" Oct 29 23:23:36.147359 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.147308 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" podStartSLOduration=2.147294585 podStartE2EDuration="2.147294585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:36.14580073 +0000 UTC m=+577.836454037" watchObservedRunningTime="2026-10-29 23:23:36.147294585 +0000 UTC m=+577.837947891" Oct 29 23:23:36.429765 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.429735 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56f114db-a6a4-4e5a-8080-a935c8785b7d" path="/var/lib/kubelet/pods/56f114db-a6a4-4e5a-8080-a935c8785b7d/volumes" Oct 29 23:23:36.911927 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.911890 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q"] Oct 29 23:23:36.915527 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.915500 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:36.928589 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.928543 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-bacddc-serving-cert\"" Oct 29 23:23:36.940090 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.940063 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q"] Oct 29 23:23:36.966848 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.966820 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:36.967013 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.966875 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:36.967013 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.966988 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:36.967138 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:36.967027 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb2mc\" (UniqueName: \"kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.049275 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.049246 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:37.068483 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.068447 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.068671 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.068616 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb2mc\" (UniqueName: \"kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.068739 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.068702 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.068820 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.068808 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.070022 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.069992 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.071356 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.071333 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.071679 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.071659 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.086603 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.086533 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb2mc\" (UniqueName: \"kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc\") pod \"maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.228759 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.228665 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:37.546481 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:37.546428 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q"] Oct 29 23:23:37.548982 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:37.548952 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e1ad1e_b9cf_41ba_add0_7e25fb08550f.slice/crio-29d04e2561104459d73988e1104727a42f52a28bc03fad345c950375b6e27294 WatchSource:0}: Error finding container 29d04e2561104459d73988e1104727a42f52a28bc03fad345c950375b6e27294: Status 404 returned error can't find the container with id 29d04e2561104459d73988e1104727a42f52a28bc03fad345c950375b6e27294 Oct 29 23:23:38.056208 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:38.056172 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" event={"ID":"68e1ad1e-b9cf-41ba-add0-7e25fb08550f","Type":"ContainerStarted","Data":"a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02"} Oct 29 23:23:38.056642 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:38.056230 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" event={"ID":"68e1ad1e-b9cf-41ba-add0-7e25fb08550f","Type":"ContainerStarted","Data":"29d04e2561104459d73988e1104727a42f52a28bc03fad345c950375b6e27294"} Oct 29 23:23:38.095216 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:38.095173 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" podStartSLOduration=1.743378643 podStartE2EDuration="2.095159334s" totalImagesPullingTime="351.780691ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:38.094625258 +0000 UTC m=+579.785278565" watchObservedRunningTime="2026-10-29 23:23:38.095159334 +0000 UTC m=+579.785812640" Oct 29 23:23:38.785433 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:38.785385 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g"] Oct 29 23:23:38.785704 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:38.785669 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" podUID="98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" containerName="maas-api" containerID="cri-o://fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22" gracePeriod=30 Oct 29 23:23:39.059468 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.059378 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:39.082122 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.082079 5976 generic.go:356] "Generic (PLEG): container finished" podID="98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" containerID="fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22" exitCode=0 Oct 29 23:23:39.083318 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.083295 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" Oct 29 23:23:39.083743 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.083291 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" event={"ID":"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2","Type":"ContainerDied","Data":"fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22"} Oct 29 23:23:39.083840 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.083827 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g" event={"ID":"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2","Type":"ContainerDied","Data":"d16b97891af4cd84330111ee8453212892b43f309929931c68d6389887e8bd9c"} Oct 29 23:23:39.083915 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.083867 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:39.083969 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.083906 5976 scope.go:122] "RemoveContainer" containerID="fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22" Oct 29 23:23:39.088433 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.088410 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs\") pod \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " Oct 29 23:23:39.088433 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.088447 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca\") pod \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " Oct 29 23:23:39.088614 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.088518 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt\" (UniqueName: \"kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt\") pod \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " Oct 29 23:23:39.088614 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.088539 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\") pod \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\" (UID: \"98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2\") " Oct 29 23:23:39.089407 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.089381 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca" pod "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" (UID: "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:39.091353 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.091316 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls" pod "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" (UID: "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:39.091540 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.091518 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs" pod "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" (UID: "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:39.091617 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.091577 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt" pod "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" (UID: "98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2"). InnerVolumeSpecName "kube-api-access-mjgzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:39.095953 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.095929 5976 scope.go:122] "RemoveContainer" containerID="fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22" Oct 29 23:23:39.096307 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:39.096279 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22\": container with ID starting with fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22 not found: ID does not exist" containerID="fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22" Oct 29 23:23:39.096379 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.096315 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22"} err="failed to get container status \"fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22\": rpc error: code = NotFound desc = could not find container \"fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22\": container with ID starting with fa090d0dbb3214030b28092daba0bb327c91c3064a628a48479349877faf4b22 not found: ID does not exist" Oct 29 23:23:39.189378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.189334 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:39.189378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.189372 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:39.189378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.189386 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjgzt\" (UniqueName: \"kubernetes.io/projected/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-kube-api-access-mjgzt\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:39.189654 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.189399 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:23:39.428725 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.428695 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g"] Oct 29 23:23:39.437997 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:39.437958 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-83198dc0-848b6bffd6-2xp2g"] Oct 29 23:23:40.043882 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:40.043853 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:23:40.431628 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:40.431600 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" path="/var/lib/kubelet/pods/98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2/volumes" Oct 29 23:23:42.054652 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:42.054625 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:23:43.777413 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.777376 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg"] Oct 29 23:23:43.777931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.777910 5976 cpu_manager.go:414] "containerMap: removing container" podUID="98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" containerName="maas-api" Oct 29 23:23:43.777931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.777928 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" containerName="maas-api" Oct 29 23:23:43.778101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.778023 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="98a19f90-88d9-4f8b-a4b2-f3ec2e7866a2" containerName="maas-api" Oct 29 23:23:43.780501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.780484 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.805664 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.796843 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-b0153c-serving-cert\"" Oct 29 23:23:43.814514 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.814489 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg"] Oct 29 23:23:43.853704 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.853665 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.853858 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.853809 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.853858 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.853847 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.853944 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.853882 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c894b\" (UniqueName: \"kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.955398 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.955363 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.955398 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.955400 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.955692 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.955435 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c894b\" (UniqueName: \"kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.955692 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.955663 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.956137 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.956109 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.958061 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.958038 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.958169 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.958153 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:43.975522 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:43.975502 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c894b\" (UniqueName: \"kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b\") pod \"maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:44.123873 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:44.123770 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:44.437762 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:44.437731 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg"] Oct 29 23:23:44.442746 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:44.442715 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f9c5bf7_7563_411d_abd7_34b88953f681.slice/crio-6c77d1fcd9feaa5a89c349d7b68c56e55a85b410f91ee6ecf69a974ad58182e1 WatchSource:0}: Error finding container 6c77d1fcd9feaa5a89c349d7b68c56e55a85b410f91ee6ecf69a974ad58182e1: Status 404 returned error can't find the container with id 6c77d1fcd9feaa5a89c349d7b68c56e55a85b410f91ee6ecf69a974ad58182e1 Oct 29 23:23:45.037314 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:45.036921 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:23:45.037724 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:45.037697 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:23:45.119101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:45.118312 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:23:45.143622 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:45.143179 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" event={"ID":"0f9c5bf7-7563-411d-abd7-34b88953f681","Type":"ContainerStarted","Data":"fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04"} Oct 29 23:23:45.143622 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:45.143241 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" event={"ID":"0f9c5bf7-7563-411d-abd7-34b88953f681","Type":"ContainerStarted","Data":"6c77d1fcd9feaa5a89c349d7b68c56e55a85b410f91ee6ecf69a974ad58182e1"} Oct 29 23:23:45.143960 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:45.143927 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:47.052150 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:47.052118 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:23:47.053318 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:47.053297 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:23:47.095894 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:47.095831 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" podStartSLOduration=3.781370207 podStartE2EDuration="4.095817258s" totalImagesPullingTime="314.447051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:45.216023181 +0000 UTC m=+586.906676490" watchObservedRunningTime="2026-10-29 23:23:47.095817258 +0000 UTC m=+588.786470565" Oct 29 23:23:48.059719 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:48.059690 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:23:50.175379 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:50.175345 5976 generic.go:356] "Generic (PLEG): container finished" podID="2baace46-5f61-4993-b4f2-5eae802dc533" containerID="1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77" exitCode=0 Oct 29 23:23:50.175875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:50.175421 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" event={"ID":"2baace46-5f61-4993-b4f2-5eae802dc533","Type":"ContainerDied","Data":"1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77"} Oct 29 23:23:50.175875 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:50.175858 5976 scope.go:122] "RemoveContainer" containerID="1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77" Oct 29 23:23:50.177399 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:50.177373 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:50.177461 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:50.177443 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:50.177496 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:50.177474 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:23:51.182819 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:51.182782 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" event={"ID":"2baace46-5f61-4993-b4f2-5eae802dc533","Type":"ContainerStarted","Data":"e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89"} Oct 29 23:23:51.766386 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:51.762692 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:51.766386 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:51.762857 5976 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 29 23:23:51.766386 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:51.762913 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 29 23:23:52.161330 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:52.161295 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:23:52.760788 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:52.760746 5976 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 29 23:23:52.761275 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:52.760820 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 29 23:23:53.761326 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:53.761286 5976 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 29 23:23:53.761844 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:53.761391 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 29 23:23:54.012601 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.012478 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x"] Oct 29 23:23:54.016661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.016626 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.029180 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.029157 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-b2c5f2-serving-cert\"" Oct 29 23:23:54.040567 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.040517 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x"] Oct 29 23:23:54.119837 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.119771 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.119999 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.119857 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.119999 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.119966 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.120071 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.120014 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqp4\" (UniqueName: \"kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.221157 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.221117 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.221668 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.221638 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.221735 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.221707 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.221792 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.221749 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqp4\" (UniqueName: \"kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.221851 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.221818 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.224450 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.224399 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.224450 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.224404 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.245615 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.245578 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqp4\" (UniqueName: \"kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4\") pod \"maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.330446 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.330352 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:54.631352 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.630911 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x"] Oct 29 23:23:54.634180 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:23:54.634139 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d2695a9_caa9_4f8d_87a4_7a11d11ee905.slice/crio-464986b2f157957922580de9a9f80f54ae81bc98be4d1224e8ed461f49d78dea WatchSource:0}: Error finding container 464986b2f157957922580de9a9f80f54ae81bc98be4d1224e8ed461f49d78dea: Status 404 returned error can't find the container with id 464986b2f157957922580de9a9f80f54ae81bc98be4d1224e8ed461f49d78dea Oct 29 23:23:54.761453 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.761415 5976 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 29 23:23:54.761867 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:54.761482 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 29 23:23:55.235544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:55.235508 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" event={"ID":"7d2695a9-caa9-4f8d-87a4-7a11d11ee905","Type":"ContainerStarted","Data":"35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c"} Oct 29 23:23:55.235751 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:55.235593 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" event={"ID":"7d2695a9-caa9-4f8d-87a4-7a11d11ee905","Type":"ContainerStarted","Data":"464986b2f157957922580de9a9f80f54ae81bc98be4d1224e8ed461f49d78dea"} Oct 29 23:23:55.236193 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:55.236173 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:23:55.762047 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:55.762010 5976 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 29 23:23:55.762656 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:55.762620 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 29 23:23:56.849280 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:56.849235 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:56.850114 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:56.850088 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:56.851041 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:56.851009 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:23:56.897848 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:23:56.897785 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" podStartSLOduration=3.477588239 podStartE2EDuration="3.897769516s" totalImagesPullingTime="420.181277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:55.309216376 +0000 UTC m=+596.999869686" watchObservedRunningTime="2026-10-29 23:23:56.897769516 +0000 UTC m=+598.588423061" Oct 29 23:23:57.255222 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:23:57.255183 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:24:01.248162 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:01.248128 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:24:27.254901 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:24:27.254857 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:24:28.703976 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.703940 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm"] Oct 29 23:24:28.708414 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.708391 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.729528 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.729505 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"openshift-service-ca.crt\"" Oct 29 23:24:28.729736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.729649 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"kube-root-ca.crt\"" Oct 29 23:24:28.729736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.729667 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"premium-w4-bed4a2-kserve-self-signed-certs\"" Oct 29 23:24:28.729872 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.729782 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"default-dockercfg-ch2fz\"" Oct 29 23:24:28.732967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.732941 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm"] Oct 29 23:24:28.807252 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.807209 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.807423 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.807285 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.807423 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.807398 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.807501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.807453 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.807501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.807497 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.807619 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.807598 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zs29\" (UniqueName: \"kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.909788 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.909750 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.910002 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.909827 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.910002 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.909885 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.910002 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.909942 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.910002 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.909989 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zs29\" (UniqueName: \"kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.910314 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.910025 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.911188 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.910447 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.912190 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.912167 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.912378 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.912352 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.915038 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.913799 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.921249 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.921187 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:28.929915 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:28.929887 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zs29\" (UniqueName: \"kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29\") pod \"premium-w4-bed4a2-kserve-54d4c78456-8tfqm\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:29.022105 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:29.022016 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:29.317657 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:29.317627 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm"] Oct 29 23:24:29.319446 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:24:29.319419 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfce5317d_1178_41c8_a65f_b9adafed35b4.slice/crio-bfb5db7cca248b3cbfbfcf90c5bff14573f5ce9776f2141f05453cc35b425959 WatchSource:0}: Error finding container bfb5db7cca248b3cbfbfcf90c5bff14573f5ce9776f2141f05453cc35b425959: Status 404 returned error can't find the container with id bfb5db7cca248b3cbfbfcf90c5bff14573f5ce9776f2141f05453cc35b425959 Oct 29 23:24:29.430411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:29.430367 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" event={"ID":"fce5317d-1178-41c8-a65f-b9adafed35b4","Type":"ContainerStarted","Data":"3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9"} Oct 29 23:24:29.430411 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:29.430409 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" event={"ID":"fce5317d-1178-41c8-a65f-b9adafed35b4","Type":"ContainerStarted","Data":"bfb5db7cca248b3cbfbfcf90c5bff14573f5ce9776f2141f05453cc35b425959"} Oct 29 23:24:29.466059 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:29.466009 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" podStartSLOduration=1.465994052 podStartE2EDuration="1.465994052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:29.463398557 +0000 UTC m=+631.154051864" watchObservedRunningTime="2026-10-29 23:24:29.465994052 +0000 UTC m=+631.156647358" Oct 29 23:24:30.022196 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:30.022158 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:39.022861 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:39.022782 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:39.036639 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:39.036612 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:39.504413 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:24:39.504376 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:24:57.255080 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:24:57.255041 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:25:11.637413 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.637155 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh"] Oct 29 23:25:11.641886 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.641861 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.654943 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.654918 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-bed4a2-openshift-default-dockercfg-bgcfk\"" Oct 29 23:25:11.663986 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.663921 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh"] Oct 29 23:25:11.725137 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725081 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8v8x\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725377 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725169 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725377 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725203 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725377 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725293 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725377 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725346 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725590 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725393 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725590 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725416 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725590 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725498 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.725590 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.725566 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.826659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826623 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.826847 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826679 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.826847 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826790 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.826847 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826827 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.826975 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826867 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.826975 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826919 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8v8x\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827088 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.826992 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827088 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827011 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827088 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827043 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827088 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827079 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827310 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827293 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827368 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827336 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827523 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827494 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.827661 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.827626 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.829246 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.829213 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.829382 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.829347 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.843033 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.843004 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.843502 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.843477 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8v8x\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:11.955671 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:11.955634 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:12.269733 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.269701 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh"] Oct 29 23:25:12.271900 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:25:12.271872 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d08e0b4_6eba_492b_a2e1_64c6770b51cc.slice/crio-913c92660d254c688b4bd47fcf513c6f08df3b667f75ca7aa76882eccd3b48d5 WatchSource:0}: Error finding container 913c92660d254c688b4bd47fcf513c6f08df3b667f75ca7aa76882eccd3b48d5: Status 404 returned error can't find the container with id 913c92660d254c688b4bd47fcf513c6f08df3b667f75ca7aa76882eccd3b48d5 Oct 29 23:25:12.275093 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.275055 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:25:12.275330 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.275309 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:25:12.275480 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.275461 5976 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 29 23:25:12.665573 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.665527 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" event={"ID":"0d08e0b4-6eba-492b-a2e1-64c6770b51cc","Type":"ContainerStarted","Data":"45b4560a5779462933d65282077f61644ff96faa5634f8513c76442106e84ecd"} Oct 29 23:25:12.665980 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.665590 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" event={"ID":"0d08e0b4-6eba-492b-a2e1-64c6770b51cc","Type":"ContainerStarted","Data":"913c92660d254c688b4bd47fcf513c6f08df3b667f75ca7aa76882eccd3b48d5"} Oct 29 23:25:12.705988 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.705934 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podStartSLOduration=1.705917334 podStartE2EDuration="1.705917334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:12.703874618 +0000 UTC m=+674.394527927" watchObservedRunningTime="2026-10-29 23:25:12.705917334 +0000 UTC m=+674.396570641" Oct 29 23:25:12.956794 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:12.956701 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:13.957797 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:13.957763 5976 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 29 23:25:13.958397 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:13.958364 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 29 23:25:14.957100 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:14.957064 5976 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 29 23:25:14.957281 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:14.957118 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 29 23:25:15.956570 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:15.956525 5976 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 29 23:25:15.956990 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:15.956625 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 29 23:25:16.957047 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:16.957012 5976 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 29 23:25:16.957446 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:16.957072 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 29 23:25:17.956970 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:17.956934 5976 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 29 23:25:17.957156 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:17.956991 5976 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 29 23:25:18.960687 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:18.960656 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:18.961087 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:18.960935 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:18.961703 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:25:18.961684 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:25:27.255143 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:25:27.255105 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:25:57.256143 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:25:57.256106 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:26:27.254482 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:26:27.254443 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:26:57.256866 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:26:57.256826 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:27:02.900060 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.900024 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw"] Oct 29 23:27:02.904194 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.904168 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:02.928143 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.928118 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw"] Oct 29 23:27:02.935751 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.935724 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"e2e-conflict-a-251c968b-kserve-self-signed-certs\"" Oct 29 23:27:02.991573 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.991516 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:02.991734 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.991648 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:02.991734 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.991679 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:02.991829 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.991769 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxxnt\" (UniqueName: \"kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:02.991829 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.991821 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:02.991931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:02.991916 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.092957 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.092920 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093148 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093097 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093190 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093147 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093190 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093172 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093203 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxxnt\" (UniqueName: \"kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093226 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093590 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093525 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093720 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093525 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.093720 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.093689 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.095374 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.095354 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.095717 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.095699 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.110456 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.110431 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxxnt\" (UniqueName: \"kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt\") pod \"e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.218889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.218801 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:03.531312 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:03.531277 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw"] Oct 29 23:27:03.533332 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:27:03.533304 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1926ef61_cb42_4099_8459_35868cbb4510.slice/crio-fc2f6a81f117c3ca1f8edbe1c397b4fe8d0d9cbe4b3056e43e3720be752d2e4c WatchSource:0}: Error finding container fc2f6a81f117c3ca1f8edbe1c397b4fe8d0d9cbe4b3056e43e3720be752d2e4c: Status 404 returned error can't find the container with id fc2f6a81f117c3ca1f8edbe1c397b4fe8d0d9cbe4b3056e43e3720be752d2e4c Oct 29 23:27:04.350484 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:04.350452 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" event={"ID":"1926ef61-cb42-4099-8459-35868cbb4510","Type":"ContainerStarted","Data":"01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2"} Oct 29 23:27:04.350484 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:04.350491 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" event={"ID":"1926ef61-cb42-4099-8459-35868cbb4510","Type":"ContainerStarted","Data":"fc2f6a81f117c3ca1f8edbe1c397b4fe8d0d9cbe4b3056e43e3720be752d2e4c"} Oct 29 23:27:04.385296 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:04.385242 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" podStartSLOduration=2.38522819 podStartE2EDuration="2.38522819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:04.384928118 +0000 UTC m=+786.075581426" watchObservedRunningTime="2026-10-29 23:27:04.38522819 +0000 UTC m=+786.075881498" Oct 29 23:27:05.218931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:05.218897 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:13.219978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:13.219940 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:13.233475 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:13.233448 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:13.412806 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:13.412780 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:17.271931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:17.271873 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj"] Oct 29 23:27:17.302885 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:17.302826 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d"] Oct 29 23:27:19.544165 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.544124 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj"] Oct 29 23:27:19.548300 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.548277 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.569788 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.569750 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"e2e-conflict-b-251c968b-kserve-self-signed-certs\"" Oct 29 23:27:19.572374 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.572347 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj"] Oct 29 23:27:19.602288 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.602254 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.602479 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.602304 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.602479 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.602367 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqdk\" (UniqueName: \"kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.602479 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.602420 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.602682 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.602609 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.602746 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.602725 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704084 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704053 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704291 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704104 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704291 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704235 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704291 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704275 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqdk\" (UniqueName: \"kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704473 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704342 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704473 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704464 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704600 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704540 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704662 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704610 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.704721 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.704666 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.707162 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.707131 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.707504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.707485 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.721017 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.720983 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqdk\" (UniqueName: \"kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk\") pod \"e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:19.864753 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:19.864666 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:20.199916 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:20.199883 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj"] Oct 29 23:27:20.202538 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:27:20.202510 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadfe7f80_3f7d_4527_820b_6bfd43ce8ba0.slice/crio-a949e68757094df5fe3791ae498e25b44e1316e48d12973dd11d56a51bcee227 WatchSource:0}: Error finding container a949e68757094df5fe3791ae498e25b44e1316e48d12973dd11d56a51bcee227: Status 404 returned error can't find the container with id a949e68757094df5fe3791ae498e25b44e1316e48d12973dd11d56a51bcee227 Oct 29 23:27:20.447794 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:20.447757 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" event={"ID":"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0","Type":"ContainerStarted","Data":"4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550"} Oct 29 23:27:20.447977 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:20.447811 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" event={"ID":"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0","Type":"ContainerStarted","Data":"a949e68757094df5fe3791ae498e25b44e1316e48d12973dd11d56a51bcee227"} Oct 29 23:27:20.484789 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:20.484688 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" podStartSLOduration=1.484675454 podStartE2EDuration="1.484675454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:20.483733356 +0000 UTC m=+802.174386665" watchObservedRunningTime="2026-10-29 23:27:20.484675454 +0000 UTC m=+802.175328783" Oct 29 23:27:20.865081 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:20.864997 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:22.272420 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:22.272369 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerName="payload-processing" containerID="cri-o://f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b" gracePeriod=25 Oct 29 23:27:22.304222 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:22.304167 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" podUID="794401e9-08b7-4490-8314-84c5db83d537" containerName="payload-pre-processing" containerID="cri-o://d714b4ec2a61ccac0c5cc0fe2a5b3e9209cd8ef8a985eb438e4fa425e97cc63d" gracePeriod=25 Oct 29 23:27:25.035440 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:25.035396 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" podUID="794401e9-08b7-4490-8314-84c5db83d537" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:27:25.035973 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:25.035747 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:27:27.255346 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:27.255302 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:27:29.028704 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.028665 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x"] Oct 29 23:27:29.029161 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.028892 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" podUID="7d2695a9-caa9-4f8d-87a4-7a11d11ee905" containerName="maas-api" containerID="cri-o://35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c" gracePeriod=30 Oct 29 23:27:29.301291 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.301206 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:27:29.411003 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.410973 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls\") pod \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " Oct 29 23:27:29.411174 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.411121 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs\") pod \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " Oct 29 23:27:29.411228 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.411179 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca\") pod \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " Oct 29 23:27:29.411265 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.411223 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4\" (UniqueName: \"kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4\") pod \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\" (UID: \"7d2695a9-caa9-4f8d-87a4-7a11d11ee905\") " Oct 29 23:27:29.411603 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.411574 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca" pod "7d2695a9-caa9-4f8d-87a4-7a11d11ee905" (UID: "7d2695a9-caa9-4f8d-87a4-7a11d11ee905"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:29.413699 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.413664 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls" pod "7d2695a9-caa9-4f8d-87a4-7a11d11ee905" (UID: "7d2695a9-caa9-4f8d-87a4-7a11d11ee905"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:29.413822 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.413714 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs" pod "7d2695a9-caa9-4f8d-87a4-7a11d11ee905" (UID: "7d2695a9-caa9-4f8d-87a4-7a11d11ee905"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:29.413903 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.413885 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4" pod "7d2695a9-caa9-4f8d-87a4-7a11d11ee905" (UID: "7d2695a9-caa9-4f8d-87a4-7a11d11ee905"). InnerVolumeSpecName "kube-api-access-nwqp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:29.509745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.509698 5976 generic.go:356] "Generic (PLEG): container finished" podID="7d2695a9-caa9-4f8d-87a4-7a11d11ee905" containerID="35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c" exitCode=0 Oct 29 23:27:29.509937 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.509868 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" event={"ID":"7d2695a9-caa9-4f8d-87a4-7a11d11ee905","Type":"ContainerDied","Data":"35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c"} Oct 29 23:27:29.509937 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.509923 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" event={"ID":"7d2695a9-caa9-4f8d-87a4-7a11d11ee905","Type":"ContainerDied","Data":"464986b2f157957922580de9a9f80f54ae81bc98be4d1224e8ed461f49d78dea"} Oct 29 23:27:29.510062 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.509952 5976 scope.go:122] "RemoveContainer" containerID="35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c" Oct 29 23:27:29.510131 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.510117 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x" Oct 29 23:27:29.512380 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.512352 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.512504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.512382 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.512504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.512397 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.512504 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.512411 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwqp4\" (UniqueName: \"kubernetes.io/projected/7d2695a9-caa9-4f8d-87a4-7a11d11ee905-kube-api-access-nwqp4\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.528539 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.528512 5976 scope.go:122] "RemoveContainer" containerID="35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c" Oct 29 23:27:29.532412 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:29.530908 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c\": container with ID starting with 35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c not found: ID does not exist" containerID="35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c" Oct 29 23:27:29.532412 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.531029 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c"} err="failed to get container status \"35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c\": rpc error: code = NotFound desc = could not find container \"35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c\": container with ID starting with 35a591d89073ed8c631bf1e8a5f4b758ae5523ea454cc5a9c3ab96778cf5e53c not found: ID does not exist" Oct 29 23:27:29.570832 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.570748 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x"] Oct 29 23:27:29.575787 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.575730 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-b2c5f2-6444b9b6f4-xdh4x"] Oct 29 23:27:29.865447 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.865362 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:29.881336 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:29.881304 5976 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:30.430250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:30.430217 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d2695a9-caa9-4f8d-87a4-7a11d11ee905" path="/var/lib/kubelet/pods/7d2695a9-caa9-4f8d-87a4-7a11d11ee905/volumes" Oct 29 23:27:30.527234 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:30.527207 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:35.035334 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:35.035293 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" podUID="794401e9-08b7-4490-8314-84c5db83d537" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:27:35.035752 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:35.035338 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:27:35.679897 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:35.679862 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj"] Oct 29 23:27:37.320031 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.319995 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj"] Oct 29 23:27:37.320843 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.320811 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" podUID="503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" containerName="maas-api" containerID="cri-o://7fba09c49e13b360e27a8cf0532a018835bd2ff3823036a5847999422ed318ab" gracePeriod=30 Oct 29 23:27:37.554384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.554352 5976 generic.go:356] "Generic (PLEG): container finished" podID="503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" containerID="7fba09c49e13b360e27a8cf0532a018835bd2ff3823036a5847999422ed318ab" exitCode=0 Oct 29 23:27:37.554594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.554436 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" event={"ID":"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0","Type":"ContainerDied","Data":"7fba09c49e13b360e27a8cf0532a018835bd2ff3823036a5847999422ed318ab"} Oct 29 23:27:37.639271 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.638073 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:27:37.724776 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.724730 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca\") pod \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " Oct 29 23:27:37.724968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.724798 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr\" (UniqueName: \"kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr\") pod \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " Oct 29 23:27:37.724968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.724831 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls\") pod \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " Oct 29 23:27:37.724968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.724883 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs\") pod \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\" (UID: \"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0\") " Oct 29 23:27:37.725324 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.725177 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca" pod "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" (UID: "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:37.725610 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.725337 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:37.727443 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.727409 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr" pod "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" (UID: "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0"). InnerVolumeSpecName "kube-api-access-xh7tr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:37.728137 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.728021 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls" pod "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" (UID: "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:37.728137 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.728091 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs" pod "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" (UID: "503cc8b1-d5b6-4cb2-9708-65a8280fe3b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:37.836700 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.801327 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg"] Oct 29 23:27:37.838250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.838038 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh7tr\" (UniqueName: \"kubernetes.io/projected/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-kube-api-access-xh7tr\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:37.838250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.838208 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:37.838250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.838227 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:37.850761 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:37.850706 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" podUID="0f9c5bf7-7563-411d-abd7-34b88953f681" containerName="maas-api" containerID="cri-o://fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04" gracePeriod=30 Oct 29 23:27:38.203579 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.203186 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:27:38.247885 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.247397 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs\") pod \"0f9c5bf7-7563-411d-abd7-34b88953f681\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " Oct 29 23:27:38.248219 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.248196 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca\") pod \"0f9c5bf7-7563-411d-abd7-34b88953f681\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " Oct 29 23:27:38.248794 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.248771 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls\") pod \"0f9c5bf7-7563-411d-abd7-34b88953f681\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " Oct 29 23:27:38.249262 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.249241 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b\" (UniqueName: \"kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b\") pod \"0f9c5bf7-7563-411d-abd7-34b88953f681\" (UID: \"0f9c5bf7-7563-411d-abd7-34b88953f681\") " Oct 29 23:27:38.249831 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.248705 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca" pod "0f9c5bf7-7563-411d-abd7-34b88953f681" (UID: "0f9c5bf7-7563-411d-abd7-34b88953f681"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:38.249831 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.249805 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f9c5bf7-7563-411d-abd7-34b88953f681-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:38.267674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.253656 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs" pod "0f9c5bf7-7563-411d-abd7-34b88953f681" (UID: "0f9c5bf7-7563-411d-abd7-34b88953f681"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:38.267674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.255451 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls" pod "0f9c5bf7-7563-411d-abd7-34b88953f681" (UID: "0f9c5bf7-7563-411d-abd7-34b88953f681"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:38.267674 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.255933 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b" pod "0f9c5bf7-7563-411d-abd7-34b88953f681" (UID: "0f9c5bf7-7563-411d-abd7-34b88953f681"). InnerVolumeSpecName "kube-api-access-c894b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:38.351047 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.351005 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:38.351047 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.351047 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f9c5bf7-7563-411d-abd7-34b88953f681-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:38.351660 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.351063 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c894b\" (UniqueName: \"kubernetes.io/projected/0f9c5bf7-7563-411d-abd7-34b88953f681-kube-api-access-c894b\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:38.561634 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.561534 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" Oct 29 23:27:38.562137 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.561546 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj" event={"ID":"503cc8b1-d5b6-4cb2-9708-65a8280fe3b0","Type":"ContainerDied","Data":"c8e3445b45c0020fd066f65c58b30803f155647bd2ea98a22396f0c95ffa41b9"} Oct 29 23:27:38.562263 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.562190 5976 scope.go:122] "RemoveContainer" containerID="7fba09c49e13b360e27a8cf0532a018835bd2ff3823036a5847999422ed318ab" Oct 29 23:27:38.563508 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.563479 5976 generic.go:356] "Generic (PLEG): container finished" podID="0f9c5bf7-7563-411d-abd7-34b88953f681" containerID="fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04" exitCode=0 Oct 29 23:27:38.563662 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.563545 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" Oct 29 23:27:38.563662 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.563602 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" event={"ID":"0f9c5bf7-7563-411d-abd7-34b88953f681","Type":"ContainerDied","Data":"fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04"} Oct 29 23:27:38.563662 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.563642 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg" event={"ID":"0f9c5bf7-7563-411d-abd7-34b88953f681","Type":"ContainerDied","Data":"6c77d1fcd9feaa5a89c349d7b68c56e55a85b410f91ee6ecf69a974ad58182e1"} Oct 29 23:27:38.571993 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.571976 5976 scope.go:122] "RemoveContainer" containerID="fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04" Oct 29 23:27:38.582216 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.582192 5976 scope.go:122] "RemoveContainer" containerID="fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04" Oct 29 23:27:38.582529 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:38.582499 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04\": container with ID starting with fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04 not found: ID does not exist" containerID="fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04" Oct 29 23:27:38.582652 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.582525 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04"} err="failed to get container status \"fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04\": rpc error: code = NotFound desc = could not find container \"fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04\": container with ID starting with fc1e65b4d08eed6085febf7c1d1a0575272be1fc9fd0ab15df4c1c49f1457e04 not found: ID does not exist" Oct 29 23:27:38.610694 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.610664 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj"] Oct 29 23:27:38.620362 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.620334 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-105882-67ccd74d4b-mvnbj"] Oct 29 23:27:38.645764 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.645731 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg"] Oct 29 23:27:38.652251 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:38.652217 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b0153c-cb9c9897-f65qg"] Oct 29 23:27:40.430410 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:40.430374 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f9c5bf7-7563-411d-abd7-34b88953f681" path="/var/lib/kubelet/pods/0f9c5bf7-7563-411d-abd7-34b88953f681/volumes" Oct 29 23:27:40.430882 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:40.430814 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" path="/var/lib/kubelet/pods/503cc8b1-d5b6-4cb2-9708-65a8280fe3b0/volumes" Oct 29 23:27:42.591145 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.591119 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:27:42.591681 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.591658 5976 generic.go:356] "Generic (PLEG): container finished" podID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerID="f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b" exitCode=0 Oct 29 23:27:42.591744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.591728 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" event={"ID":"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8","Type":"ContainerDied","Data":"f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b"} Oct 29 23:27:42.591801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.591780 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" event={"ID":"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8","Type":"ContainerDied","Data":"3d458d3145971ae63d27fe9d50e6f8b5ee0f1e2022ae6b492a39e28dce412c96"} Oct 29 23:27:42.591860 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.591809 5976 scope.go:122] "RemoveContainer" containerID="f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b" Oct 29 23:27:42.593487 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.593463 5976 generic.go:356] "Generic (PLEG): container finished" podID="794401e9-08b7-4490-8314-84c5db83d537" containerID="d714b4ec2a61ccac0c5cc0fe2a5b3e9209cd8ef8a985eb438e4fa425e97cc63d" exitCode=0 Oct 29 23:27:42.593680 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.593534 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" event={"ID":"794401e9-08b7-4490-8314-84c5db83d537","Type":"ContainerDied","Data":"d714b4ec2a61ccac0c5cc0fe2a5b3e9209cd8ef8a985eb438e4fa425e97cc63d"} Oct 29 23:27:42.600971 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.600916 5976 scope.go:122] "RemoveContainer" containerID="f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b" Oct 29 23:27:42.601212 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:42.601188 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b\": container with ID starting with f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b not found: ID does not exist" containerID="f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b" Oct 29 23:27:42.601272 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.601226 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b"} err="failed to get container status \"f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b\": rpc error: code = NotFound desc = could not find container \"f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b\": container with ID starting with f0e569d7b871a29ec452d2912ff61bd8aa3b68407a57297045d884efec14bd8b not found: ID does not exist" Oct 29 23:27:42.621966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.621944 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:27:42.700824 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.700792 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn\" (UniqueName: \"kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn\") pod \"794401e9-08b7-4490-8314-84c5db83d537\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " Oct 29 23:27:42.701032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.700873 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh\" (UniqueName: \"kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh\") pod \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " Oct 29 23:27:42.701032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.700913 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume\") pod \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\" (UID: \"8079fbb5-7e98-4688-a4ef-d0e7e536b9f8\") " Oct 29 23:27:42.701032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.701004 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume\") pod \"794401e9-08b7-4490-8314-84c5db83d537\" (UID: \"794401e9-08b7-4490-8314-84c5db83d537\") " Oct 29 23:27:42.701373 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.701344 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume" pod "8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" (UID: "8079fbb5-7e98-4688-a4ef-d0e7e536b9f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:42.701373 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.701389 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume" pod "794401e9-08b7-4490-8314-84c5db83d537" (UID: "794401e9-08b7-4490-8314-84c5db83d537"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:42.702964 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.702944 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn" pod "794401e9-08b7-4490-8314-84c5db83d537" (UID: "794401e9-08b7-4490-8314-84c5db83d537"). InnerVolumeSpecName "kube-api-access-dwshn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:42.703545 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.703528 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh" pod "8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" (UID: "8079fbb5-7e98-4688-a4ef-d0e7e536b9f8"). InnerVolumeSpecName "kube-api-access-w9rhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:42.806217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.806009 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/794401e9-08b7-4490-8314-84c5db83d537-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.806217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.806045 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwshn\" (UniqueName: \"kubernetes.io/projected/794401e9-08b7-4490-8314-84c5db83d537-kube-api-access-dwshn\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.806217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.806060 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9rhh\" (UniqueName: \"kubernetes.io/projected/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-kube-api-access-w9rhh\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.806217 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:42.806073 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:43.599758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.599678 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" Oct 29 23:27:43.599758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.599722 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d" event={"ID":"794401e9-08b7-4490-8314-84c5db83d537","Type":"ContainerDied","Data":"9aed6ad753c1ecf394b52bb312173a7b904747f931e34a0bdc926f3c017b45d8"} Oct 29 23:27:43.600264 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.599780 5976 scope.go:122] "RemoveContainer" containerID="d714b4ec2a61ccac0c5cc0fe2a5b3e9209cd8ef8a985eb438e4fa425e97cc63d" Oct 29 23:27:43.600734 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.600716 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj" Oct 29 23:27:43.649570 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.649523 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj"] Oct 29 23:27:43.662745 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.662716 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-105882-c5d97fdcb-6lqfj"] Oct 29 23:27:43.719761 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.719731 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d"] Oct 29 23:27:43.733708 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.733662 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-105882-7f8c955999-dkw9d"] Oct 29 23:27:43.763387 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:43.763352 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw"] Oct 29 23:27:44.429925 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:44.429886 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="794401e9-08b7-4490-8314-84c5db83d537" path="/var/lib/kubelet/pods/794401e9-08b7-4490-8314-84c5db83d537/volumes" Oct 29 23:27:44.430410 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:44.430395 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" path="/var/lib/kubelet/pods/8079fbb5-7e98-4688-a4ef-d0e7e536b9f8/volumes" Oct 29 23:27:47.753607 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:47.753572 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj"] Oct 29 23:27:47.754128 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:47.753808 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" containerID="cri-o://e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89" gracePeriod=30 Oct 29 23:27:48.999169 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:48.999135 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm"] Oct 29 23:27:49.410898 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:49.410859 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg"] Oct 29 23:27:49.447758 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:49.447722 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt"] Oct 29 23:27:50.702236 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:50.702195 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" podUID="adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" containerName="main" containerID="cri-o://4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550" gracePeriod=45 Oct 29 23:27:50.961134 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:50.961073 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:51.038317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038282 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir\") pod \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " Oct 29 23:27:51.038501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038328 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home\") pod \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " Oct 29 23:27:51.038501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038412 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm\") pod \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " Oct 29 23:27:51.038501 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038452 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk\" (UniqueName: \"kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk\") pod \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " Oct 29 23:27:51.038685 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038600 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home" pod "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" (UID: "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:51.038685 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038610 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir" pod "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" (UID: "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:51.038805 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038775 5976 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tmp-dir\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:51.038805 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.038797 5976 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-home\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:51.040829 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.040796 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm" pod "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" (UID: "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:51.040971 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.040833 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk" pod "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" (UID: "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0"). InnerVolumeSpecName "kube-api-access-xbqdk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:51.139978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.139943 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs\" (UniqueName: \"kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs\") pod \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " Oct 29 23:27:51.139978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.139982 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache\") pod \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\" (UID: \"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0\") " Oct 29 23:27:51.140268 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.140251 5976 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-dshm\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:51.140337 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.140273 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbqdk\" (UniqueName: \"kubernetes.io/projected/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-kube-api-access-xbqdk\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:51.140337 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.140269 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache" pod "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" (UID: "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:51.142109 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.142080 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs" pod "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" (UID: "adfe7f80-3f7d-4527-820b-6bfd43ce8ba0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:51.240893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.240812 5976 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-tls-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:51.240893 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.240838 5976 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0-model-cache\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:51.645050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.645011 5976 generic.go:356] "Generic (PLEG): container finished" podID="adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" containerID="4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550" exitCode=0 Oct 29 23:27:51.645252 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.645079 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" Oct 29 23:27:51.645252 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.645095 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" event={"ID":"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0","Type":"ContainerDied","Data":"4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550"} Oct 29 23:27:51.645252 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.645150 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj" event={"ID":"adfe7f80-3f7d-4527-820b-6bfd43ce8ba0","Type":"ContainerDied","Data":"a949e68757094df5fe3791ae498e25b44e1316e48d12973dd11d56a51bcee227"} Oct 29 23:27:51.645252 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.645174 5976 scope.go:122] "RemoveContainer" containerID="4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550" Oct 29 23:27:51.654424 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.654406 5976 scope.go:122] "RemoveContainer" containerID="4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550" Oct 29 23:27:51.654715 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:51.654695 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550\": container with ID starting with 4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550 not found: ID does not exist" containerID="4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550" Oct 29 23:27:51.654785 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.654723 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550"} err="failed to get container status \"4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550\": rpc error: code = NotFound desc = could not find container \"4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550\": container with ID starting with 4782eac32455d12226a1a4ed9a77e695524a5749a3f8107f4ee3b63104090550 not found: ID does not exist" Oct 29 23:27:51.689690 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.689657 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj"] Oct 29 23:27:51.699225 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:51.699194 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-b-251c968b-kserve-664bb4445c-ffkmj"] Oct 29 23:27:52.429092 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:52.429061 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" path="/var/lib/kubelet/pods/adfe7f80-3f7d-4527-820b-6bfd43ce8ba0/volumes" Oct 29 23:27:53.016931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.016907 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:27:53.059491 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059411 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059491 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059469 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059577 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059623 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059651 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059691 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059736 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059720 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059997 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059756 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.059997 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059839 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token\") pod \"2baace46-5f61-4993-b4f2-5eae802dc533\" (UID: \"2baace46-5f61-4993-b4f2-5eae802dc533\") " Oct 29 23:27:53.060144 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059838 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.060144 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.059957 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.060144 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060050 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.060308 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060089 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:53.060308 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060225 5976 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.060308 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060242 5976 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2baace46-5f61-4993-b4f2-5eae802dc533-istiod-ca-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.060308 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060256 5976 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-data\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.060308 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060266 5976 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-credential-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.060594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.060349 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.062473 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.062446 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.062473 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.062460 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "kube-api-access-hl855". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:53.062699 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.062490 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:27:53.062699 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.062512 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token" pod "2baace46-5f61-4993-b4f2-5eae802dc533" (UID: "2baace46-5f61-4993-b4f2-5eae802dc533"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:53.161772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.161736 5976 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-istio-token\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.161772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.161762 5976 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-istio-envoy\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.161772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.161773 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl855\" (UniqueName: \"kubernetes.io/projected/2baace46-5f61-4993-b4f2-5eae802dc533-kube-api-access-hl855\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.161772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.161782 5976 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2baace46-5f61-4993-b4f2-5eae802dc533-istio-podinfo\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.162043 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.161792 5976 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2baace46-5f61-4993-b4f2-5eae802dc533-workload-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.657959 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.657925 5976 generic.go:356] "Generic (PLEG): container finished" podID="2baace46-5f61-4993-b4f2-5eae802dc533" containerID="e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89" exitCode=0 Oct 29 23:27:53.658367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.657973 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" Oct 29 23:27:53.658367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.658009 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" event={"ID":"2baace46-5f61-4993-b4f2-5eae802dc533","Type":"ContainerDied","Data":"e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89"} Oct 29 23:27:53.658367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.658057 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj" event={"ID":"2baace46-5f61-4993-b4f2-5eae802dc533","Type":"ContainerDied","Data":"8639cb4f5a886dd4c1468e3ee939e17f14a0446697803020395a1379ac24315b"} Oct 29 23:27:53.658367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.658076 5976 scope.go:122] "RemoveContainer" containerID="e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89" Oct 29 23:27:53.667719 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.667697 5976 scope.go:122] "RemoveContainer" containerID="1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77" Oct 29 23:27:53.675919 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.675902 5976 scope.go:122] "RemoveContainer" containerID="e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89" Oct 29 23:27:53.676174 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:53.676155 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89\": container with ID starting with e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89 not found: ID does not exist" containerID="e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89" Oct 29 23:27:53.676250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.676189 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89"} err="failed to get container status \"e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89\": rpc error: code = NotFound desc = could not find container \"e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89\": container with ID starting with e045862fa26f7d1d1ec017106427b07717fc992f023b1173536f3d8569fd3f89 not found: ID does not exist" Oct 29 23:27:53.676250 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.676213 5976 scope.go:122] "RemoveContainer" containerID="1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77" Oct 29 23:27:53.676471 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:53.676454 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77\": container with ID starting with 1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77 not found: ID does not exist" containerID="1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77" Oct 29 23:27:53.676509 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.676476 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77"} err="failed to get container status \"1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77\": rpc error: code = NotFound desc = could not find container \"1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77\": container with ID starting with 1bb96ebae42eb5020fb6342b16ae03e9bbe83c26428a4ac7e40d20aae6b58f77 not found: ID does not exist" Oct 29 23:27:53.710262 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.710224 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj"] Oct 29 23:27:53.719375 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:53.719347 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-lmhpj"] Oct 29 23:27:54.412611 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:54.412530 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerName="payload-processing" containerID="cri-o://57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7" gracePeriod=25 Oct 29 23:27:54.430892 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:54.430863 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" path="/var/lib/kubelet/pods/2baace46-5f61-4993-b4f2-5eae802dc533/volumes" Oct 29 23:27:54.450808 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:54.450767 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" containerName="payload-pre-processing" containerID="cri-o://36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd" gracePeriod=25 Oct 29 23:27:54.755201 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:54.750884 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww"] Oct 29 23:27:57.050974 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:57.050932 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:27:57.256162 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:57.256121 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:27:58.057753 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:58.057717 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:27:58.784446 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:58.784383 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" podUID="1926ef61-cb42-4099-8459-35868cbb4510" containerName="main" containerID="cri-o://01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2" gracePeriod=45 Oct 29 23:27:59.051279 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.051247 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:59.127840 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.127794 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm\") pod \"1926ef61-cb42-4099-8459-35868cbb4510\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.127879 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home\") pod \"1926ef61-cb42-4099-8459-35868cbb4510\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.127987 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir\") pod \"1926ef61-cb42-4099-8459-35868cbb4510\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128030 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache\") pod \"1926ef61-cb42-4099-8459-35868cbb4510\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128096 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt\" (UniqueName: \"kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt\") pod \"1926ef61-cb42-4099-8459-35868cbb4510\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128134 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home" pod "1926ef61-cb42-4099-8459-35868cbb4510" (UID: "1926ef61-cb42-4099-8459-35868cbb4510"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128158 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs\" (UniqueName: \"kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs\") pod \"1926ef61-cb42-4099-8459-35868cbb4510\" (UID: \"1926ef61-cb42-4099-8459-35868cbb4510\") " Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128180 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir" pod "1926ef61-cb42-4099-8459-35868cbb4510" (UID: "1926ef61-cb42-4099-8459-35868cbb4510"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:59.128317 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128261 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache" pod "1926ef61-cb42-4099-8459-35868cbb4510" (UID: "1926ef61-cb42-4099-8459-35868cbb4510"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:59.128716 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128513 5976 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-home\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:59.128716 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128532 5976 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-tmp-dir\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:59.128716 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.128546 5976 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-model-cache\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:59.130043 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.130023 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm" pod "1926ef61-cb42-4099-8459-35868cbb4510" (UID: "1926ef61-cb42-4099-8459-35868cbb4510"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:59.130196 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.130177 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt" pod "1926ef61-cb42-4099-8459-35868cbb4510" (UID: "1926ef61-cb42-4099-8459-35868cbb4510"). InnerVolumeSpecName "kube-api-access-kxxnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:59.130301 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.130286 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs" pod "1926ef61-cb42-4099-8459-35868cbb4510" (UID: "1926ef61-cb42-4099-8459-35868cbb4510"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:59.229157 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.229072 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxxnt\" (UniqueName: \"kubernetes.io/projected/1926ef61-cb42-4099-8459-35868cbb4510-kube-api-access-kxxnt\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:59.229157 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.229105 5976 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1926ef61-cb42-4099-8459-35868cbb4510-tls-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:59.229157 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.229114 5976 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1926ef61-cb42-4099-8459-35868cbb4510-dshm\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:27:59.691236 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.691198 5976 generic.go:356] "Generic (PLEG): container finished" podID="1926ef61-cb42-4099-8459-35868cbb4510" containerID="01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2" exitCode=0 Oct 29 23:27:59.691403 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.691245 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" Oct 29 23:27:59.691403 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.691262 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" event={"ID":"1926ef61-cb42-4099-8459-35868cbb4510","Type":"ContainerDied","Data":"01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2"} Oct 29 23:27:59.691403 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.691301 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw" event={"ID":"1926ef61-cb42-4099-8459-35868cbb4510","Type":"ContainerDied","Data":"fc2f6a81f117c3ca1f8edbe1c397b4fe8d0d9cbe4b3056e43e3720be752d2e4c"} Oct 29 23:27:59.691403 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.691323 5976 scope.go:122] "RemoveContainer" containerID="01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2" Oct 29 23:27:59.700300 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.700279 5976 scope.go:122] "RemoveContainer" containerID="01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2" Oct 29 23:27:59.700572 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:27:59.700534 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2\": container with ID starting with 01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2 not found: ID does not exist" containerID="01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2" Oct 29 23:27:59.700626 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.700577 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2"} err="failed to get container status \"01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2\": rpc error: code = NotFound desc = could not find container \"01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2\": container with ID starting with 01fdc487d52f0578c54e18bd52e53dd43960030d12138005ea7904a8da4b96e2 not found: ID does not exist" Oct 29 23:27:59.733075 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.733042 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw"] Oct 29 23:27:59.742494 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.742466 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/e2e-conflict-a-251c968b-kserve-77985658cf-bxjgw"] Oct 29 23:27:59.751979 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:27:59.751945 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerName="payload-processing" containerID="cri-o://ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0" gracePeriod=25 Oct 29 23:28:00.429134 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:00.429101 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1926ef61-cb42-4099-8459-35868cbb4510" path="/var/lib/kubelet/pods/1926ef61-cb42-4099-8459-35868cbb4510/volumes" Oct 29 23:28:04.020342 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.020277 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" podUID="fce5317d-1178-41c8-a65f-b9adafed35b4" containerName="main" containerID="cri-o://3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9" gracePeriod=45 Oct 29 23:28:04.223298 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.223263 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q"] Oct 29 23:28:04.224241 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.223530 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" podUID="68e1ad1e-b9cf-41ba-add0-7e25fb08550f" containerName="maas-api" containerID="cri-o://a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02" gracePeriod=30 Oct 29 23:28:04.351771 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.351743 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:28:04.490339 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.490316 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:28:04.499539 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499518 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs\" (UniqueName: \"kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs\") pod \"fce5317d-1178-41c8-a65f-b9adafed35b4\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " Oct 29 23:28:04.499632 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499590 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache\") pod \"fce5317d-1178-41c8-a65f-b9adafed35b4\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " Oct 29 23:28:04.499688 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499662 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir\") pod \"fce5317d-1178-41c8-a65f-b9adafed35b4\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " Oct 29 23:28:04.499748 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499735 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home\") pod \"fce5317d-1178-41c8-a65f-b9adafed35b4\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " Oct 29 23:28:04.499803 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499769 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm\") pod \"fce5317d-1178-41c8-a65f-b9adafed35b4\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " Oct 29 23:28:04.499865 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499829 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29\" (UniqueName: \"kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29\") pod \"fce5317d-1178-41c8-a65f-b9adafed35b4\" (UID: \"fce5317d-1178-41c8-a65f-b9adafed35b4\") " Oct 29 23:28:04.499919 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499892 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache" pod "fce5317d-1178-41c8-a65f-b9adafed35b4" (UID: "fce5317d-1178-41c8-a65f-b9adafed35b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:04.499969 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.499925 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir" pod "fce5317d-1178-41c8-a65f-b9adafed35b4" (UID: "fce5317d-1178-41c8-a65f-b9adafed35b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:04.500052 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.500029 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home" pod "fce5317d-1178-41c8-a65f-b9adafed35b4" (UID: "fce5317d-1178-41c8-a65f-b9adafed35b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:04.500303 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.500279 5976 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-model-cache\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.500396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.500306 5976 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-tmp-dir\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.500396 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.500320 5976 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-home\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.502039 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.502015 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs" pod "fce5317d-1178-41c8-a65f-b9adafed35b4" (UID: "fce5317d-1178-41c8-a65f-b9adafed35b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:28:04.502039 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.502024 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm" pod "fce5317d-1178-41c8-a65f-b9adafed35b4" (UID: "fce5317d-1178-41c8-a65f-b9adafed35b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:04.502167 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.502151 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29" pod "fce5317d-1178-41c8-a65f-b9adafed35b4" (UID: "fce5317d-1178-41c8-a65f-b9adafed35b4"). InnerVolumeSpecName "kube-api-access-4zs29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:04.600939 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.600856 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls\") pod \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " Oct 29 23:28:04.600939 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.600903 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc\" (UniqueName: \"kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc\") pod \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " Oct 29 23:28:04.600939 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.600938 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca\") pod \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " Oct 29 23:28:04.601218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.600976 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs\") pod \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\" (UID: \"68e1ad1e-b9cf-41ba-add0-7e25fb08550f\") " Oct 29 23:28:04.601218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.601144 5976 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce5317d-1178-41c8-a65f-b9adafed35b4-dshm\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.601218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.601156 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zs29\" (UniqueName: \"kubernetes.io/projected/fce5317d-1178-41c8-a65f-b9adafed35b4-kube-api-access-4zs29\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.601218 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.601165 5976 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce5317d-1178-41c8-a65f-b9adafed35b4-tls-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.601470 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.601329 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca" pod "68e1ad1e-b9cf-41ba-add0-7e25fb08550f" (UID: "68e1ad1e-b9cf-41ba-add0-7e25fb08550f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:04.603285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.603260 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc" pod "68e1ad1e-b9cf-41ba-add0-7e25fb08550f" (UID: "68e1ad1e-b9cf-41ba-add0-7e25fb08550f"). InnerVolumeSpecName "kube-api-access-fb2mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:04.603285 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.603268 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs" pod "68e1ad1e-b9cf-41ba-add0-7e25fb08550f" (UID: "68e1ad1e-b9cf-41ba-add0-7e25fb08550f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:28:04.603417 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.603283 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls" pod "68e1ad1e-b9cf-41ba-add0-7e25fb08550f" (UID: "68e1ad1e-b9cf-41ba-add0-7e25fb08550f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:28:04.706754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.705260 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb2mc\" (UniqueName: \"kubernetes.io/projected/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-kube-api-access-fb2mc\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.706754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.705299 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.706754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.705313 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.706754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.705326 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68e1ad1e-b9cf-41ba-add0-7e25fb08550f-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:04.735879 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.735839 5976 generic.go:356] "Generic (PLEG): container finished" podID="68e1ad1e-b9cf-41ba-add0-7e25fb08550f" containerID="a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02" exitCode=0 Oct 29 23:28:04.736045 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.735892 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" Oct 29 23:28:04.736045 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.735891 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" event={"ID":"68e1ad1e-b9cf-41ba-add0-7e25fb08550f","Type":"ContainerDied","Data":"a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02"} Oct 29 23:28:04.736045 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.736019 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q" event={"ID":"68e1ad1e-b9cf-41ba-add0-7e25fb08550f","Type":"ContainerDied","Data":"29d04e2561104459d73988e1104727a42f52a28bc03fad345c950375b6e27294"} Oct 29 23:28:04.736045 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.736043 5976 scope.go:122] "RemoveContainer" containerID="a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02" Oct 29 23:28:04.737288 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.737268 5976 generic.go:356] "Generic (PLEG): container finished" podID="fce5317d-1178-41c8-a65f-b9adafed35b4" containerID="3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9" exitCode=0 Oct 29 23:28:04.737362 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.737318 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" Oct 29 23:28:04.737362 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.737323 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" event={"ID":"fce5317d-1178-41c8-a65f-b9adafed35b4","Type":"ContainerDied","Data":"3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9"} Oct 29 23:28:04.737362 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.737357 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm" event={"ID":"fce5317d-1178-41c8-a65f-b9adafed35b4","Type":"ContainerDied","Data":"bfb5db7cca248b3cbfbfcf90c5bff14573f5ce9776f2141f05453cc35b425959"} Oct 29 23:28:04.746283 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.746259 5976 scope.go:122] "RemoveContainer" containerID="a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02" Oct 29 23:28:04.746627 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:04.746595 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02\": container with ID starting with a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02 not found: ID does not exist" containerID="a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02" Oct 29 23:28:04.746703 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.746634 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02"} err="failed to get container status \"a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02\": rpc error: code = NotFound desc = could not find container \"a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02\": container with ID starting with a425ee5c675fa28679705c86906b646b981016a95bc954422a309032db84df02 not found: ID does not exist" Oct 29 23:28:04.746703 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.746659 5976 scope.go:122] "RemoveContainer" containerID="3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9" Oct 29 23:28:04.755911 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.755884 5976 scope.go:122] "RemoveContainer" containerID="3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9" Oct 29 23:28:04.756202 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:04.756185 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9\": container with ID starting with 3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9 not found: ID does not exist" containerID="3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9" Oct 29 23:28:04.756245 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.756209 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9"} err="failed to get container status \"3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9\": rpc error: code = NotFound desc = could not find container \"3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9\": container with ID starting with 3821039ab95783ad7464d73d76da7970d61dc246f3935accf2920980a9ae90d9 not found: ID does not exist" Oct 29 23:28:04.788532 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.788500 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm"] Oct 29 23:28:04.797913 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.797888 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/premium-w4-bed4a2-kserve-54d4c78456-8tfqm"] Oct 29 23:28:04.821086 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.821058 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q"] Oct 29 23:28:04.825111 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:04.825081 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-bacddc-5f6df8d474-p9h4q"] Oct 29 23:28:06.428793 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:06.428752 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68e1ad1e-b9cf-41ba-add0-7e25fb08550f" path="/var/lib/kubelet/pods/68e1ad1e-b9cf-41ba-add0-7e25fb08550f/volumes" Oct 29 23:28:06.429366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:06.429311 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fce5317d-1178-41c8-a65f-b9adafed35b4" path="/var/lib/kubelet/pods/fce5317d-1178-41c8-a65f-b9adafed35b4/volumes" Oct 29 23:28:07.050984 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:07.050948 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:28:07.051171 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:07.050948 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:28:08.058307 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:08.058271 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:28:12.549702 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.549664 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t"] Oct 29 23:28:12.550178 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.549926 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" podUID="2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" containerName="maas-api" containerID="cri-o://d47db69b32f7b615c87ab6482cd9c92881eb65900daa0c4d643781d8536a3abe" gracePeriod=30 Oct 29 23:28:12.779010 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.778974 5976 generic.go:356] "Generic (PLEG): container finished" podID="2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" containerID="d47db69b32f7b615c87ab6482cd9c92881eb65900daa0c4d643781d8536a3abe" exitCode=0 Oct 29 23:28:12.779144 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.779042 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" event={"ID":"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531","Type":"ContainerDied","Data":"d47db69b32f7b615c87ab6482cd9c92881eb65900daa0c4d643781d8536a3abe"} Oct 29 23:28:12.796753 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.796723 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:28:12.889500 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.889390 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd\" (UniqueName: \"kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd\") pod \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " Oct 29 23:28:12.889500 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.889457 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca\") pod \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " Oct 29 23:28:12.889757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.889507 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs\") pod \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " Oct 29 23:28:12.889757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.889640 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls\") pod \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\" (UID: \"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531\") " Oct 29 23:28:12.889886 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.889854 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca" pod "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" (UID: "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:12.890085 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.890058 5976 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-openshift-service-ca\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:12.891819 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.891789 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs" pod "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" (UID: "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:28:12.891946 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.891813 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls" pod "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" (UID: "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:28:12.891946 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.891859 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd" pod "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" (UID: "2b5a0a78-5d1e-407d-aa4c-97e7c06a7531"). InnerVolumeSpecName "kube-api-access-jkndd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:12.991435 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.991395 5976 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-metrics-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:12.991435 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.991432 5976 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-maas-api-tls\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:12.991696 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:12.991446 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkndd\" (UniqueName: \"kubernetes.io/projected/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531-kube-api-access-jkndd\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:13.784582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:13.784524 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" Oct 29 23:28:13.784582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:13.784547 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t" event={"ID":"2b5a0a78-5d1e-407d-aa4c-97e7c06a7531","Type":"ContainerDied","Data":"add83aca360dfaee90299a417cd1cdc1e8bd32cb0059e6834e7ff58e9c4b2790"} Oct 29 23:28:13.785090 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:13.784628 5976 scope.go:122] "RemoveContainer" containerID="d47db69b32f7b615c87ab6482cd9c92881eb65900daa0c4d643781d8536a3abe" Oct 29 23:28:13.834280 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:13.834240 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t"] Oct 29 23:28:13.843240 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:13.843209 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-bed4a2-d88796d6f-b5v4t"] Oct 29 23:28:14.429961 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.429935 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" path="/var/lib/kubelet/pods/2b5a0a78-5d1e-407d-aa4c-97e7c06a7531/volumes" Oct 29 23:28:14.701422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.701395 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:28:14.736808 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.736784 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:28:14.791614 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.791579 5976 generic.go:356] "Generic (PLEG): container finished" podID="10871cb6-f432-4c76-ac1c-15d085082be3" containerID="36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd" exitCode=0 Oct 29 23:28:14.792101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.791641 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" Oct 29 23:28:14.792101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.791669 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" event={"ID":"10871cb6-f432-4c76-ac1c-15d085082be3","Type":"ContainerDied","Data":"36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd"} Oct 29 23:28:14.792101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.791728 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt" event={"ID":"10871cb6-f432-4c76-ac1c-15d085082be3","Type":"ContainerDied","Data":"47824323487cc8e3006b077507863f8eac4ad170a002ef81d3daa46d3348125d"} Oct 29 23:28:14.792101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.791760 5976 scope.go:122] "RemoveContainer" containerID="36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd" Oct 29 23:28:14.794358 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.794331 5976 generic.go:356] "Generic (PLEG): container finished" podID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerID="57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7" exitCode=0 Oct 29 23:28:14.794476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.794366 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" Oct 29 23:28:14.794476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.794401 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" event={"ID":"401c84c2-675f-4455-bb07-dd6e281bb97d","Type":"ContainerDied","Data":"57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7"} Oct 29 23:28:14.794476 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.794442 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg" event={"ID":"401c84c2-675f-4455-bb07-dd6e281bb97d","Type":"ContainerDied","Data":"832bcfc1a5de6a8535169d76140a93ea9ad879d8224affd54fd12734dfd7c450"} Oct 29 23:28:14.801006 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.800987 5976 scope.go:122] "RemoveContainer" containerID="36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd" Oct 29 23:28:14.801291 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:14.801255 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd\": container with ID starting with 36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd not found: ID does not exist" containerID="36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd" Oct 29 23:28:14.801343 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.801301 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd"} err="failed to get container status \"36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd\": rpc error: code = NotFound desc = could not find container \"36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd\": container with ID starting with 36bdcd9ce15155cbabeb780ea40977ae87ffd290afb0907fadec16cda5d06abd not found: ID does not exist" Oct 29 23:28:14.801343 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.801318 5976 scope.go:122] "RemoveContainer" containerID="57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7" Oct 29 23:28:14.809373 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.809351 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg\" (UniqueName: \"kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg\") pod \"401c84c2-675f-4455-bb07-dd6e281bb97d\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " Oct 29 23:28:14.809643 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.809618 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume\") pod \"401c84c2-675f-4455-bb07-dd6e281bb97d\" (UID: \"401c84c2-675f-4455-bb07-dd6e281bb97d\") " Oct 29 23:28:14.810099 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.810014 5976 scope.go:122] "RemoveContainer" containerID="57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7" Oct 29 23:28:14.810238 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.810214 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume" pod "401c84c2-675f-4455-bb07-dd6e281bb97d" (UID: "401c84c2-675f-4455-bb07-dd6e281bb97d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:14.810330 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:14.810311 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7\": container with ID starting with 57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7 not found: ID does not exist" containerID="57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7" Oct 29 23:28:14.810387 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.810342 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7"} err="failed to get container status \"57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7\": rpc error: code = NotFound desc = could not find container \"57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7\": container with ID starting with 57101fac626c5402907f4b554c5004bc80f782925df095406d3685f954f8f5b7 not found: ID does not exist" Oct 29 23:28:14.811689 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.811666 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg" pod "401c84c2-675f-4455-bb07-dd6e281bb97d" (UID: "401c84c2-675f-4455-bb07-dd6e281bb97d"). InnerVolumeSpecName "kube-api-access-6l4bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:14.911082 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.911044 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume\") pod \"10871cb6-f432-4c76-ac1c-15d085082be3\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " Oct 29 23:28:14.911260 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.911190 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x\" (UniqueName: \"kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x\") pod \"10871cb6-f432-4c76-ac1c-15d085082be3\" (UID: \"10871cb6-f432-4c76-ac1c-15d085082be3\") " Oct 29 23:28:14.911424 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.911401 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume" pod "10871cb6-f432-4c76-ac1c-15d085082be3" (UID: "10871cb6-f432-4c76-ac1c-15d085082be3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:14.911462 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.911430 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l4bg\" (UniqueName: \"kubernetes.io/projected/401c84c2-675f-4455-bb07-dd6e281bb97d-kube-api-access-6l4bg\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:14.911462 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.911450 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c84c2-675f-4455-bb07-dd6e281bb97d-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:14.913421 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:14.913395 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x" pod "10871cb6-f432-4c76-ac1c-15d085082be3" (UID: "10871cb6-f432-4c76-ac1c-15d085082be3"). InnerVolumeSpecName "kube-api-access-bsc5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:15.012347 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:15.012259 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10871cb6-f432-4c76-ac1c-15d085082be3-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:15.012347 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:15.012291 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsc5x\" (UniqueName: \"kubernetes.io/projected/10871cb6-f432-4c76-ac1c-15d085082be3-kube-api-access-bsc5x\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:15.134449 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:15.134419 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt"] Oct 29 23:28:15.136954 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:15.136932 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-bacddc-868dbfb775-qrvdt"] Oct 29 23:28:15.164772 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:15.164737 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg"] Oct 29 23:28:15.166992 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:15.166962 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w2-bacddc-99cd6f984-z54xg"] Oct 29 23:28:16.429816 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:16.429781 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" path="/var/lib/kubelet/pods/10871cb6-f432-4c76-ac1c-15d085082be3/volumes" Oct 29 23:28:16.430266 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:16.430251 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" path="/var/lib/kubelet/pods/401c84c2-675f-4455-bb07-dd6e281bb97d/volumes" Oct 29 23:28:17.050750 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:17.050712 5976 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Oct 29 23:28:20.003925 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.003882 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:28:20.050795 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.050717 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume\") pod \"4c1b9014-b9fd-44b5-ac22-1434700c1928\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " Oct 29 23:28:20.050946 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.050853 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd\" (UniqueName: \"kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd\") pod \"4c1b9014-b9fd-44b5-ac22-1434700c1928\" (UID: \"4c1b9014-b9fd-44b5-ac22-1434700c1928\") " Oct 29 23:28:20.051127 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.051106 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume" pod "4c1b9014-b9fd-44b5-ac22-1434700c1928" (UID: "4c1b9014-b9fd-44b5-ac22-1434700c1928"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:20.053019 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.052991 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd" pod "4c1b9014-b9fd-44b5-ac22-1434700c1928" (UID: "4c1b9014-b9fd-44b5-ac22-1434700c1928"). InnerVolumeSpecName "kube-api-access-2zbjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:20.151954 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.151918 5976 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c1b9014-b9fd-44b5-ac22-1434700c1928-plugins-config-volume\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:20.151954 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.151946 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zbjd\" (UniqueName: \"kubernetes.io/projected/4c1b9014-b9fd-44b5-ac22-1434700c1928-kube-api-access-2zbjd\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:20.717753 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.717669 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh"] Oct 29 23:28:20.717961 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.717934 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" containerID="cri-o://45b4560a5779462933d65282077f61644ff96faa5634f8513c76442106e84ecd" gracePeriod=30 Oct 29 23:28:20.837968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.836582 5976 generic.go:356] "Generic (PLEG): container finished" podID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerID="ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0" exitCode=0 Oct 29 23:28:20.837968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.836773 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" event={"ID":"4c1b9014-b9fd-44b5-ac22-1434700c1928","Type":"ContainerDied","Data":"ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0"} Oct 29 23:28:20.837968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.836829 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" event={"ID":"4c1b9014-b9fd-44b5-ac22-1434700c1928","Type":"ContainerDied","Data":"1bba770d8112a17e3c7143b7fb495b3cf295e2bba04f1e7e2150749a9610fcac"} Oct 29 23:28:20.837968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.836859 5976 scope.go:122] "RemoveContainer" containerID="ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0" Oct 29 23:28:20.837968 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.837023 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww" Oct 29 23:28:20.847837 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.847804 5976 scope.go:122] "RemoveContainer" containerID="ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0" Oct 29 23:28:20.848163 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:20.848143 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0\": container with ID starting with ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0 not found: ID does not exist" containerID="ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0" Oct 29 23:28:20.848213 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.848171 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0"} err="failed to get container status \"ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0\": rpc error: code = NotFound desc = could not find container \"ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0\": container with ID starting with ee366c6765a844c98e11847ce8cdebd6652ef942509e15be900347717c83f7a0 not found: ID does not exist" Oct 29 23:28:20.883099 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.883070 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww"] Oct 29 23:28:20.887101 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:20.887076 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-bed4a2-5f8df47846-8wnww"] Oct 29 23:28:21.831855 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:21.831820 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5d94f994-t9489_f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86/authorino/0.log" Oct 29 23:28:22.428820 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:22.428784 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" path="/var/lib/kubelet/pods/4c1b9014-b9fd-44b5-ac22-1434700c1928/volumes" Oct 29 23:28:23.886563 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:23.886533 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:28:24.755438 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:24.755407 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:28:25.351714 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:25.351688 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:28:25.863273 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:25.863243 5976 generic.go:356] "Generic (PLEG): container finished" podID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerID="45b4560a5779462933d65282077f61644ff96faa5634f8513c76442106e84ecd" exitCode=0 Oct 29 23:28:25.863425 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:25.863327 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" event={"ID":"0d08e0b4-6eba-492b-a2e1-64c6770b51cc","Type":"ContainerDied","Data":"45b4560a5779462933d65282077f61644ff96faa5634f8513c76442106e84ecd"} Oct 29 23:28:25.969931 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:25.969906 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:28:26.005211 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005141 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005211 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005201 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005258 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005277 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005336 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005361 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005422 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005400 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005693 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005436 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005693 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005464 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy\") pod \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\" (UID: \"0d08e0b4-6eba-492b-a2e1-64c6770b51cc\") " Oct 29 23:28:26.005693 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005494 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:26.005693 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005578 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.005889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005720 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.005889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005859 5976 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istiod-ca-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.005889 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005880 5976 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-credential-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.006032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005896 5976 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-data\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.006032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005874 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.006032 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.005942 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.007757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.007731 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.007757 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.007752 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:28:26.008088 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.008059 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:26.008199 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.008101 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x" pod "0d08e0b4-6eba-492b-a2e1-64c6770b51cc" (UID: "0d08e0b4-6eba-492b-a2e1-64c6770b51cc"). InnerVolumeSpecName "kube-api-access-p8v8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:26.066308 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.066279 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5d94f994-t9489_f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86/authorino/0.log" Oct 29 23:28:26.107384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.107350 5976 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.107384 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.107381 5976 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-podinfo\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.107640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.107393 5976 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-workload-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.107640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.107410 5976 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-envoy\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.107640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.107423 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8v8x\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-kube-api-access-p8v8x\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.107640 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.107436 5976 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d08e0b4-6eba-492b-a2e1-64c6770b51cc-istio-token\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.869343 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.869255 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" event={"ID":"0d08e0b4-6eba-492b-a2e1-64c6770b51cc","Type":"ContainerDied","Data":"913c92660d254c688b4bd47fcf513c6f08df3b667f75ca7aa76882eccd3b48d5"} Oct 29 23:28:26.869343 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.869285 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh" Oct 29 23:28:26.869343 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.869329 5976 scope.go:122] "RemoveContainer" containerID="45b4560a5779462933d65282077f61644ff96faa5634f8513c76442106e84ecd" Oct 29 23:28:26.921368 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.921328 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh"] Oct 29 23:28:26.931026 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:26.930996 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-h5gbh"] Oct 29 23:28:27.255134 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:27.255098 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:28:28.428899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:28.428869 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" path="/var/lib/kubelet/pods/0d08e0b4-6eba-492b-a2e1-64c6770b51cc/volumes" Oct 29 23:28:36.167966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:36.167913 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:28:37.035478 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:37.035444 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:28:37.678817 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:37.678785 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:28:38.406943 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:38.406914 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67bfc64665-hc2bq_e28c29e6-4775-4930-92e1-fc23ea504d2a/maas-api/0.log" Oct 29 23:28:41.848234 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:41.848205 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-wssrn_4f71f6b1-8b9f-4220-b2d1-1c6435911ce6/postgres/0.log" Oct 29 23:28:43.284710 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:43.284680 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5d94f994-t9489_f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86/authorino/0.log" Oct 29 23:28:45.528294 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:45.528261 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:28:45.929002 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:45.928955 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:28:46.503255 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:46.503223 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:28:46.874331 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:46.874247 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-w4knm_31c47d1f-1807-4782-90c5-ed3bb8ad828b/istio-proxy/0.log" Oct 29 23:28:47.243873 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:47.243842 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:28:47.422876 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:47.422844 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:28:48.461533 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:48.461506 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-w6jhj_475cb2b8-3776-45d7-b48f-8bd79aef1c60/main/0.log" Oct 29 23:28:48.637922 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:48.637893 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7b998b79d9-gnzcb_9c7795e1-167b-4306-a138-a7b1afd3dd99/main/0.log" Oct 29 23:28:49.178223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:49.178191 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8pgfl8_8b723bd2-d498-4f3b-98eb-49638fd73dd7/main/0.log" Oct 29 23:28:49.567636 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:49.567469 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-jkhcl_0264bad4-fd17-400b-a7a8-28727eee0008/main/0.log" Oct 29 23:28:57.252810 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:28:57.252772 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:28:59.680664 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.680625 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vz8b8/must-gather-xq6x7"] Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681048 5976 cpu_manager.go:414] "containerMap: removing container" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" containerName="payload-pre-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681062 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" containerName="payload-pre-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681076 5976 cpu_manager.go:414] "containerMap: removing container" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerName="payload-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681083 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerName="payload-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681091 5976 cpu_manager.go:414] "containerMap: removing container" podUID="2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" containerName="maas-api" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681095 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" containerName="maas-api" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681103 5976 cpu_manager.go:414] "containerMap: removing container" podUID="fce5317d-1178-41c8-a65f-b9adafed35b4" containerName="main" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681107 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fce5317d-1178-41c8-a65f-b9adafed35b4" containerName="main" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681116 5976 cpu_manager.go:414] "containerMap: removing container" podUID="503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" containerName="maas-api" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681120 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" containerName="maas-api" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681127 5976 cpu_manager.go:414] "containerMap: removing container" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681132 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681140 5976 cpu_manager.go:414] "containerMap: removing container" podUID="0f9c5bf7-7563-411d-abd7-34b88953f681" containerName="maas-api" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681144 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f9c5bf7-7563-411d-abd7-34b88953f681" containerName="maas-api" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681153 5976 cpu_manager.go:414] "containerMap: removing container" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerName="payload-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681158 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerName="payload-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681165 5976 cpu_manager.go:414] "containerMap: removing container" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerName="payload-processing" Oct 29 23:28:59.681158 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681169 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerName="payload-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681175 5976 cpu_manager.go:414] "containerMap: removing container" podUID="68e1ad1e-b9cf-41ba-add0-7e25fb08550f" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681179 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68e1ad1e-b9cf-41ba-add0-7e25fb08550f" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681187 5976 cpu_manager.go:414] "containerMap: removing container" podUID="794401e9-08b7-4490-8314-84c5db83d537" containerName="payload-pre-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681192 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="794401e9-08b7-4490-8314-84c5db83d537" containerName="payload-pre-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681198 5976 cpu_manager.go:414] "containerMap: removing container" podUID="7d2695a9-caa9-4f8d-87a4-7a11d11ee905" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681202 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d2695a9-caa9-4f8d-87a4-7a11d11ee905" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681239 5976 cpu_manager.go:414] "containerMap: removing container" podUID="adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681244 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681255 5976 cpu_manager.go:414] "containerMap: removing container" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681259 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681274 5976 cpu_manager.go:414] "containerMap: removing container" podUID="1926ef61-cb42-4099-8459-35868cbb4510" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681277 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1926ef61-cb42-4099-8459-35868cbb4510" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681358 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="1926ef61-cb42-4099-8459-35868cbb4510" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681370 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="10871cb6-f432-4c76-ac1c-15d085082be3" containerName="payload-pre-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681380 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="401c84c2-675f-4455-bb07-dd6e281bb97d" containerName="payload-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681387 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b5a0a78-5d1e-407d-aa4c-97e7c06a7531" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681392 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="fce5317d-1178-41c8-a65f-b9adafed35b4" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681397 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="503cc8b1-d5b6-4cb2-9708-65a8280fe3b0" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681401 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681407 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f9c5bf7-7563-411d-abd7-34b88953f681" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681416 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="8079fbb5-7e98-4688-a4ef-d0e7e536b9f8" containerName="payload-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681424 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c1b9014-b9fd-44b5-ac22-1434700c1928" containerName="payload-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681432 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="68e1ad1e-b9cf-41ba-add0-7e25fb08550f" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681438 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="794401e9-08b7-4490-8314-84c5db83d537" containerName="payload-pre-processing" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681443 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d2695a9-caa9-4f8d-87a4-7a11d11ee905" containerName="maas-api" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681447 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="adfe7f80-3f7d-4527-820b-6bfd43ce8ba0" containerName="main" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681454 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d08e0b4-6eba-492b-a2e1-64c6770b51cc" containerName="istio-proxy" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681511 5976 cpu_manager.go:414] "containerMap: removing container" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681516 5976 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" Oct 29 23:28:59.682097 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.681723 5976 memory_manager.go:365] "RemoveStaleState removing state" podUID="2baace46-5f61-4993-b4f2-5eae802dc533" containerName="istio-proxy" Oct 29 23:28:59.686871 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.686853 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:28:59.707104 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.707079 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/must-gather-xq6x7"] Oct 29 23:28:59.710505 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.710480 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vz8b8\"/\"openshift-service-ca.crt\"" Oct 29 23:28:59.710803 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.710783 5976 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vz8b8\"/\"kube-root-ca.crt\"" Oct 29 23:28:59.710803 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.710789 5976 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vz8b8\"/\"default-dockercfg-bwshg\"" Oct 29 23:28:59.823382 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.823343 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzn8p\" (UniqueName: \"kubernetes.io/projected/4836d9f2-2531-46de-8849-837a68082382-kube-api-access-rzn8p\") pod \"must-gather-xq6x7\" (UID: \"4836d9f2-2531-46de-8849-837a68082382\") " pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:28:59.823601 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.823429 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4836d9f2-2531-46de-8849-837a68082382-must-gather-output\") pod \"must-gather-xq6x7\" (UID: \"4836d9f2-2531-46de-8849-837a68082382\") " pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:28:59.925000 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.924955 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4836d9f2-2531-46de-8849-837a68082382-must-gather-output\") pod \"must-gather-xq6x7\" (UID: \"4836d9f2-2531-46de-8849-837a68082382\") " pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:28:59.925219 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.925037 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzn8p\" (UniqueName: \"kubernetes.io/projected/4836d9f2-2531-46de-8849-837a68082382-kube-api-access-rzn8p\") pod \"must-gather-xq6x7\" (UID: \"4836d9f2-2531-46de-8849-837a68082382\") " pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:28:59.925397 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.925372 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4836d9f2-2531-46de-8849-837a68082382-must-gather-output\") pod \"must-gather-xq6x7\" (UID: \"4836d9f2-2531-46de-8849-837a68082382\") " pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:28:59.942435 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:28:59.942360 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzn8p\" (UniqueName: \"kubernetes.io/projected/4836d9f2-2531-46de-8849-837a68082382-kube-api-access-rzn8p\") pod \"must-gather-xq6x7\" (UID: \"4836d9f2-2531-46de-8849-837a68082382\") " pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:29:00.000513 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:00.000477 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/must-gather-xq6x7" Oct 29 23:29:00.293899 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:00.293808 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/must-gather-xq6x7"] Oct 29 23:29:00.297397 ip-10-0-137-132 kubenswrapper[5976]: W1029 23:29:00.297365 5976 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4836d9f2_2531_46de_8849_837a68082382.slice/crio-d6497aa5ae429c44f3aac18e2bdab6ffcba779b45c18c82c88baa0b5dfc4b5a1 WatchSource:0}: Error finding container d6497aa5ae429c44f3aac18e2bdab6ffcba779b45c18c82c88baa0b5dfc4b5a1: Status 404 returned error can't find the container with id d6497aa5ae429c44f3aac18e2bdab6ffcba779b45c18c82c88baa0b5dfc4b5a1 Oct 29 23:29:00.299452 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:00.299432 5976 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:29:01.026363 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:01.026330 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/must-gather-xq6x7" event={"ID":"4836d9f2-2531-46de-8849-837a68082382","Type":"ContainerStarted","Data":"d6497aa5ae429c44f3aac18e2bdab6ffcba779b45c18c82c88baa0b5dfc4b5a1"} Oct 29 23:29:02.037622 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:02.037578 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/must-gather-xq6x7" event={"ID":"4836d9f2-2531-46de-8849-837a68082382","Type":"ContainerStarted","Data":"f665074d5b42b276fdaa958bf1d55c9e2b9f862739edc73e365f514ad68f660e"} Oct 29 23:29:02.038080 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:02.037635 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/must-gather-xq6x7" event={"ID":"4836d9f2-2531-46de-8849-837a68082382","Type":"ContainerStarted","Data":"6e96cf8d0e951f526488b1b92e6b806209e8eebf45072c4c4370f0095d8e8bf7"} Oct 29 23:29:02.071130 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:02.071066 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-vz8b8/must-gather-xq6x7" podStartSLOduration=2.435654522 podStartE2EDuration="3.071051097s" totalImagesPullingTime="635.396575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:02.070994579 +0000 UTC m=+903.761647885" watchObservedRunningTime="2026-10-29 23:29:02.071051097 +0000 UTC m=+903.761704401" Oct 29 23:29:03.878072 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:03.878044 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6s4mw_ecb4e993-6e54-4680-8e52-4988c38199f0/global-pull-secret-syncer/0.log" Oct 29 23:29:04.828231 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:04.824806 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c47rv_afd5d371-4d02-428a-878a-f2b78f7f8e6c/konnectivity-agent/0.log" Oct 29 23:29:05.180272 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:05.180243 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-132.ec2.internal_2db034d2cac0da0a261053f0bada2678/haproxy/0.log" Oct 29 23:29:08.623457 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:08.620790 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:08.668589 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:08.666722 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:09.046609 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:09.044699 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:09.172243 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:09.172210 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:09.335166 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:09.335054 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:09.621544 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:09.621467 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:10.380584 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:10.380519 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm"] Oct 29 23:29:10.381734 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:10.381680 5976 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerName="istio-proxy" containerID="cri-o://56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba" gracePeriod=30 Oct 29 23:29:10.721575 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:10.718838 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:11.061081 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:11.060994 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:11.071966 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:11.071936 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:11.369725 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:11.369197 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:11.424367 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:11.424320 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:11.746258 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:11.746225 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:11.941134 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:11.941093 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5d94f994-t9489_f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86/authorino/0.log" Oct 29 23:29:12.767577 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:12.761821 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:13.073633 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:13.073242 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:13.150573 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:13.150513 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:13.449075 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:13.449042 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:13.472870 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:13.472837 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:13.732226 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:13.732140 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:14.270163 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.270126 5976 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq"] Oct 29 23:29:14.275064 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.275036 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.295191 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.295159 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq"] Oct 29 23:29:14.431843 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.431812 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-proc\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.432024 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.431854 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-podres\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.432024 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.432012 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4jbg\" (UniqueName: \"kubernetes.io/projected/54fa4e5a-32a9-403f-aabe-3205fda53944-kube-api-access-b4jbg\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.432117 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.432047 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-sys\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.432117 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.432069 5976 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-lib-modules\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533490 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533396 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-lib-modules\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533490 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533444 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-proc\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533519 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-proc\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533525 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-podres\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533587 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-podres\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533531 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-lib-modules\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.533754 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533715 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4jbg\" (UniqueName: \"kubernetes.io/projected/54fa4e5a-32a9-403f-aabe-3205fda53944-kube-api-access-b4jbg\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.534029 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533767 5976 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-sys\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.534029 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.533808 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54fa4e5a-32a9-403f-aabe-3205fda53944-sys\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.551223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.551190 5976 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4jbg\" (UniqueName: \"kubernetes.io/projected/54fa4e5a-32a9-403f-aabe-3205fda53944-kube-api-access-b4jbg\") pod \"perf-node-gather-daemonset-cr8xq\" (UID: \"54fa4e5a-32a9-403f-aabe-3205fda53944\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.588079 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.588044 5976 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:14.911223 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:14.911047 5976 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq"] Oct 29 23:29:15.176419 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.176331 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" event={"ID":"54fa4e5a-32a9-403f-aabe-3205fda53944","Type":"ContainerStarted","Data":"12abb248437e03884de38717e8210d83518692d3909b8d7259cec21361fbe580"} Oct 29 23:29:15.176419 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.176391 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" event={"ID":"54fa4e5a-32a9-403f-aabe-3205fda53944","Type":"ContainerStarted","Data":"35c464ee7d377d63dae8bd05ac9a946d73803b1b8cfbc8733d75dc7a8eb620eb"} Oct 29 23:29:15.176673 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.176463 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:15.210715 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.210651 5976 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" podStartSLOduration=1.210633303 podStartE2EDuration="1.210633303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:15.210295606 +0000 UTC m=+916.900948913" watchObservedRunningTime="2026-10-29 23:29:15.210633303 +0000 UTC m=+916.901286611" Oct 29 23:29:15.210965 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.210697 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lf6z7_6dab03a0-efe3-4b27-b982-66628c8dc8a1/kube-state-metrics/0.log" Oct 29 23:29:15.332116 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.332082 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lf6z7_6dab03a0-efe3-4b27-b982-66628c8dc8a1/kube-rbac-proxy-main/0.log" Oct 29 23:29:15.455783 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.455691 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-lf6z7_6dab03a0-efe3-4b27-b982-66628c8dc8a1/kube-rbac-proxy-self/0.log" Oct 29 23:29:15.614435 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.610156 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:15.687444 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.687414 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:29:15.692075 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.692048 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-h6sgt_959a0d7f-8036-42ad-bacd-bdeb7da391ec/monitoring-plugin/0.log" Oct 29 23:29:15.704985 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.704959 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:15.820054 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.819975 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4567x_fa38333f-05b6-4cac-bddf-9bc834ef25f8/node-exporter/0.log" Oct 29 23:29:15.846516 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846482 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846727 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846528 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846727 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846585 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846727 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846649 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846727 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846710 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846744 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846743 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:15.846967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846778 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846805 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.846967 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.846896 5976 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data\") pod \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\" (UID: \"31c47d1f-1807-4782-90c5-ed3bb8ad828b\") " Oct 29 23:29:15.847229 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847058 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:15.847229 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847099 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:15.847350 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847251 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:15.847350 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847318 5976 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-credential-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.847350 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847339 5976 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-certs\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.847515 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847355 5976 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-workload-socket\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.847515 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.847409 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:29:15.849603 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.849577 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:15.849727 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.849659 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "kube-api-access-f5vnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:29:15.849811 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.849793 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:29:15.849959 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.849943 5976 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo" pod "31c47d1f-1807-4782-90c5-ed3bb8ad828b" (UID: "31c47d1f-1807-4782-90c5-ed3bb8ad828b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:29:15.902622 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.902590 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:15.931182 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.931143 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:15.942992 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.942949 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4567x_fa38333f-05b6-4cac-bddf-9bc834ef25f8/kube-rbac-proxy/0.log" Oct 29 23:29:15.948152 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.948133 5976 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-data\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.948232 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.948155 5976 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-envoy\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.948232 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.948165 5976 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-podinfo\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.948232 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.948173 5976 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5vnf\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-kube-api-access-f5vnf\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.948232 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.948183 5976 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istio-token\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:15.948232 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:15.948191 5976 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31c47d1f-1807-4782-90c5-ed3bb8ad828b-istiod-ca-cert\") on node \"ip-10-0-137-132.ec2.internal\" DevicePath \"\"" Oct 29 23:29:16.007118 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.007085 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-w4knm_31c47d1f-1807-4782-90c5-ed3bb8ad828b/istio-proxy/0.log" Oct 29 23:29:16.022863 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.022840 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:16.059789 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.059754 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4567x_fa38333f-05b6-4cac-bddf-9bc834ef25f8/init-textfile/0.log" Oct 29 23:29:16.131046 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.130969 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:29:16.186242 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.186203 5976 generic.go:356] "Generic (PLEG): container finished" podID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" containerID="56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba" exitCode=0 Oct 29 23:29:16.186391 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.186253 5976 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" Oct 29 23:29:16.186391 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.186263 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" event={"ID":"31c47d1f-1807-4782-90c5-ed3bb8ad828b","Type":"ContainerDied","Data":"56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba"} Oct 29 23:29:16.186391 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.186336 5976 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm" event={"ID":"31c47d1f-1807-4782-90c5-ed3bb8ad828b","Type":"ContainerDied","Data":"ef66a2d815f2e3cd383e9e6d85b9476414de35bd96377df5941d02296d7a4c71"} Oct 29 23:29:16.186391 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.186361 5976 scope.go:122] "RemoveContainer" containerID="56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba" Oct 29 23:29:16.203320 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.203274 5976 scope.go:122] "RemoveContainer" containerID="56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba" Oct 29 23:29:16.203940 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.203693 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:29:16.204024 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:29:16.203991 5976 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba\": container with ID starting with 56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba not found: ID does not exist" containerID="56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba" Oct 29 23:29:16.204162 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.204138 5976 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba"} err="failed to get container status \"56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba\": rpc error: code = NotFound desc = could not find container \"56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba\": container with ID starting with 56b81239f0c49f48767c73451a22595acc5db4c89714de7d3f9242dd7f0236ba not found: ID does not exist" Oct 29 23:29:16.210857 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.210838 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:16.236031 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.236002 5976 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm"] Oct 29 23:29:16.245536 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.245511 5976 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-w4knm"] Oct 29 23:29:16.412182 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.412155 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:29:16.430528 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.430494 5976 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31c47d1f-1807-4782-90c5-ed3bb8ad828b" path="/var/lib/kubelet/pods/31c47d1f-1807-4782-90c5-ed3bb8ad828b/volumes" Oct 29 23:29:16.480026 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:16.479994 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:29:18.202226 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.202188 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5d94f994-t9489_f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86/authorino/0.log" Oct 29 23:29:18.225257 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.225227 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cb894cfdf-wdfbs_6751556e-9ac0-4344-b2bb-bbdff9044caa/telemeter-client/0.log" Oct 29 23:29:18.347276 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.347200 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cb894cfdf-wdfbs_6751556e-9ac0-4344-b2bb-bbdff9044caa/reload/0.log" Oct 29 23:29:18.439659 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.439615 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f5d94f994-t9489_f0a4d1fe-b1ca-40bc-ac4d-f0c4b5a27b86/authorino/0.log" Oct 29 23:29:18.469467 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.469358 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cb894cfdf-wdfbs_6751556e-9ac0-4344-b2bb-bbdff9044caa/kube-rbac-proxy/0.log" Oct 29 23:29:18.599762 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.599734 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-555fbcb47b-99nwc_ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/thanos-query/0.log" Oct 29 23:29:18.727239 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.727154 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-555fbcb47b-99nwc_ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/kube-rbac-proxy-web/0.log" Oct 29 23:29:18.847516 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.847487 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-555fbcb47b-99nwc_ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/kube-rbac-proxy/0.log" Oct 29 23:29:18.967922 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:18.967889 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-555fbcb47b-99nwc_ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/prom-label-proxy/0.log" Oct 29 23:29:19.087044 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:19.086976 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-555fbcb47b-99nwc_ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/kube-rbac-proxy-rules/0.log" Oct 29 23:29:19.209049 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:19.209021 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-555fbcb47b-99nwc_ea8f8b34-c3bc-4ae2-bb2e-ef04cec310a0/kube-rbac-proxy-metrics/0.log" Oct 29 23:29:21.201594 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:21.201546 5976 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-cr8xq" Oct 29 23:29:22.634657 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:22.634623 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5957f55f8f-qj9tl_a641c475-e6f7-44cd-956a-f92f90016662/console/0.log" Oct 29 23:29:25.742052 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:25.742024 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-5dbbbf75cc-lvmqc_fe332f4e-4408-4975-ac89-6d9efb52e180/cert-manager-webhook/0.log" Oct 29 23:29:25.910759 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:25.910731 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-webhook-5dbbbf75cc-lvmqc_fe332f4e-4408-4975-ac89-6d9efb52e180/cert-manager-webhook/0.log" Oct 29 23:29:26.273428 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:26.273400 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2dpmf_24ca50cb-c977-4fbd-848f-c4ff5f7be381/dns/0.log" Oct 29 23:29:26.391864 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:26.391834 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2dpmf_24ca50cb-c977-4fbd-848f-c4ff5f7be381/kube-rbac-proxy/0.log" Oct 29 23:29:26.733142 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:26.733114 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-7vkt9_0ad25176-a56f-43d8-900e-08927fac2bd9/manager/0.log" Oct 29 23:29:26.794436 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:26.794409 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-7vkt9_0ad25176-a56f-43d8-900e-08927fac2bd9/copy-manifests/0.log" Oct 29 23:29:26.819213 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:26.819187 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-7vkt9_0ad25176-a56f-43d8-900e-08927fac2bd9/manager/0.log" Oct 29 23:29:26.878582 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:26.878523 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-7vkt9_0ad25176-a56f-43d8-900e-08927fac2bd9/copy-manifests/0.log" Oct 29 23:29:27.144827 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:27.144742 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nnc2g_92eceb2e-00de-4593-84de-6e5878c81f4e/dns-node-resolver/0.log" Oct 29 23:29:27.277390 ip-10-0-137-132 kubenswrapper[5976]: E1029 23:29:27.277342 5976 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-b8w9r" containerName="extractor" Oct 29 23:29:27.901366 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:27.901338 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:27.986611 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:27.986584 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:27.995106 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:27.995080 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:28.087731 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.087701 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-6645466744-jv9mk_4d45ecb4-5446-463b-aec6-044fe6da70e4/manager/0.log" Oct 29 23:29:28.193122 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.193045 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:28.360744 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.360714 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:29:28.376653 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.376632 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:28.426691 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.426639 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:29:28.466592 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.466497 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b7d4f89c-l4v7h_d81acc9a-21a9-451d-af68-00f13882fe45/manager/0.log" Oct 29 23:29:28.481801 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.481766 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4qvsk_e743b094-7e5d-496c-a8fd-5f2b801b4cee/node-ca/0.log" Oct 29 23:29:28.722427 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.722318 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:28.817850 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:28.817810 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-j5n6w_1b19475e-e48a-46cb-b068-0ad4f09ede27/proxy/0.log" Oct 29 23:29:30.416616 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.416577 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:30.503246 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.503215 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:30.513044 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.513015 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:30.597790 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.597752 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:30.696698 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.696610 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:30.775731 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.775695 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:30.858904 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.858877 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:29:30.924049 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.924017 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:29:30.927690 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.927650 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:29:30.989978 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:30.989906 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:29:31.351749 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.351671 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:31.377083 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.377048 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-652qk_930fc656-25ef-4cf6-8248-49e5cbb51b08/discovery/0.log" Oct 29 23:29:31.478213 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.478179 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:31.550529 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.550502 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-z72pz_b7ad47e6-9afd-477f-b43d-abda37e95a84/kube-auth-proxy/0.log" Oct 29 23:29:31.664361 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.664335 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:31.823991 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.823954 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log" Oct 29 23:29:31.892977 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.892948 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5f78687d5b-lfxg6_138dd42f-4b7b-4dda-b27a-79056182c491/payload-processing/0.log" Oct 29 23:29:31.897905 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:31.897877 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-grxl9_a9b1150d-e419-493b-a0b2-8420d20cde91/istio-proxy/0.log" Oct 29 23:29:32.218050 ip-10-0-137-132 kubenswrapper[5976]: I1029 23:29:32.218017 5976 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7b98bb678c-t885f_579c94d3-d9cd-4aea-b845-1eb0a4908731/payload-pre-processing/0.log"